-- Logs begin at Wed 2022-06-08 05:50:14 UTC, end at Wed 2022-06-08 07:33:40 UTC. -- Jun 08 06:26:44.342461 dv-cinder-844920-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 08 06:26:44.351970 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 08 06:26:44.353981 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 8 06:26:44 2022] *** Jun 08 06:26:44.353981 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 08 06:26:44.353981 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 08 06:26:44.353981 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: nodename: dv-cinder-844920-1-iscsi Jun 08 06:26:44.353981 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: machine: x86_64 Jun 08 06:26:44.353981 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: clock source: unix Jun 08 06:26:44.353981 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: pcre jit disabled Jun 08 06:26:44.353981 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: detected number of CPU cores: 4 Jun 08 06:26:44.353981 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: current working directory: / Jun 08 06:26:44.353981 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: detected binary path: /usr/bin/uwsgi-core Jun 08 06:26:44.354589 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: your processes number limit is 47680 Jun 08 06:26:44.354589 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: your memory page size is 4096 bytes Jun 08 06:26:44.354589 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: detected max file descriptor number: 2048 Jun 08 06:26:44.354589 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: lock engine: pthread robust mutexes Jun 08 06:26:44.354589 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: thunder lock: enabled Jun 08 06:26:44.354589 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 08 06:26:44.354589 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 08 06:26:44.401443 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: Python main interpreter initialized at 0x55fce192f9c0 Jun 08 06:26:44.401443 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: python threads support enabled Jun 08 06:26:44.401443 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: your server socket listen backlog is limited to 100 connections Jun 08 06:26:44.401443 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: your mercy for graceful operations on workers is 90 seconds Jun 08 06:26:44.401769 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: mapped 403077 bytes (393 KB) for 2 cores Jun 08 06:26:44.401838 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: *** Operational MODE: preforking *** Jun 08 06:26:44.402071 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: *** uWSGI is running in multiple interpreter mode *** Jun 08 06:26:44.402071 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: spawned uWSGI master process (pid: 80752) Jun 08 06:26:44.402295 dv-cinder-844920-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 08 06:26:44.403384 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: spawned uWSGI worker 1 (pid: 80763, cores: 1) Jun 08 06:26:44.403384 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: spawned uWSGI worker 2 (pid: 80764, cores: 1) Jun 08 06:26:44.403384 dv-cinder-844920-1-iscsi devstack@keystone.service[80752]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 08 06:26:50.131792 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 06:26:50.131792 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: from cryptography.utils import int_from_bytes Jun 08 06:26:50.132561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 06:26:50.132561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: from cryptography.utils import int_from_bytes Jun 08 06:26:50.133038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 06:26:50.133038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: from cryptography.utils import int_from_bytes Jun 08 06:26:50.133472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 06:26:50.133472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: from cryptography.utils import int_from_bytes Jun 08 06:26:50.182067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 06:26:50.182290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 06:26:50.182479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] command line args: [] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 06:26:50.182787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 06:26:50.183199 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ================================================================================ {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 06:26:50.183325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 06:26:50.183451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] admin_token = **** {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.183537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 06:26:50.183696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] config_dir = [] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.183774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] command line args: [] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 06:26:50.183881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.183971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 06:26:50.184047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] config_source = [] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.184123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ================================================================================ {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 06:26:50.184226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] debug = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.184383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] admin_token = **** {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.184470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.184674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] config_dir = [] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.184796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.184881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.184972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.185038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] config_source = [] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.185157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] debug = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.185235 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.185370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.185479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.185611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.185701 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] list_limit = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.185804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.185878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] log_config_append = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.185978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.186050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.186115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] log_dir = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.186306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.186389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] log_file = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.186542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.186630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] list_limit = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.186747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] log_config_append = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.186868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.186963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.187045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.187117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] log_dir = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.187241 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] log_file = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.187333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.187414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.187492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.187582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.187722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.187810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.187973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.188070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.188220 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.188296 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.188405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.188523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.188597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.188770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.188848 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.188965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.189039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.189153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.189267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.189393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.189526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.189635 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.189715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.189943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.190128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.190283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.190361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] publish_errors = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.190441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.190559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.190724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.190807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.190978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.191222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.191304 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.191433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] publish_errors = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.191512 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.191623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.191700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] standard_threads = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.191855 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.192010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.192090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.192161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.192272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.192378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.192455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] use_journal = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.192604 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] use_json = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.192680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.192776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] use_stderr = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.192854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] standard_threads = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.192951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] use_syslog = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.193067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.193178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.193299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.193428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.193512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.193642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] use_journal = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.193724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.193821 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] use_json = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.193905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.194001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] use_stderr = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.194126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.194212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] use_syslog = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.194397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.194499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 06:26:50.194634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.194764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.194879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.195003 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.195112 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.195264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.195341 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.195505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.195582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.195755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.195839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.195996 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.196073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.196245 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.196322 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.196484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.196562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.196764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.196892 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.196968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.197090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.197241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.197360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.197435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.197505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.197661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.197748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.197902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.197979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.198134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.198212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.198408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.198495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.198668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.198746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.198917 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.198995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.199161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.199246 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.199389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.199735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.199888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.199972 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.200113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.200205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.200346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.200424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.200589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.200667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.200833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.200917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.201059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.201136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.201284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.201361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.201528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.201613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.201763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.201845 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.201996 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.202107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.202287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.202408 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.202508 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.202609 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.202704 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.202798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.202927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.203040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.203152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.203236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.203365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.203443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.203590 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.203679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.203815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.203893 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.204047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.204137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.204288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.204377 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.204515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.204594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.204747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.204828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.204975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.205064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.205206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.205291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.205433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.205553 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.205677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.205761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.205904 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.205983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.206136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.206218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.206427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.206506 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.206671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.206751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.206903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.206984 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.207137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.207218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.207364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.207443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.207602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.207685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.207832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.207909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.208066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.208150 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.208292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.208381 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.208530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.208608 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.208764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.208843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.208988 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.209067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.209220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.209298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.209443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.209522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.209686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.209775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.209926 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.210015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.210169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.210279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.210429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.210507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.210660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.210746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.210893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.210973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.211124 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.211202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.211368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.211445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.211603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.211682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.211836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.211914 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.212074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.212152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.212307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.212475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.212557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.212628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.212758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.212835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.212990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.213080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.213222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.213301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.213464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.213547 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.213705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.213791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.213946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.214029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.214182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.214306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.214459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.214549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.214694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.214779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.214929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.215007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.215162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.215248 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.215388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.215473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.215615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.215693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.215840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.215926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.216073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.216152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.216299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.216382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.216534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.216620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.216764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.216845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.216995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.217078 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.217227 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.217318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.217466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.217544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.217697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.217775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.217939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.218024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.218164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] auth.external = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.218286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.218413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.218494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.218665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.218749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.218922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.219000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.219148 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] auth.password = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.219225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.219375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] auth.token = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.219487 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.219613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.219700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] auth.external = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.219843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.219923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.220084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.220163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.220311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.220398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.220552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.220631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] auth.password = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.220794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.220873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] auth.token = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.221019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.221105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.221250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] credential.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.221335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.221493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.221572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.221724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.221808 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.221965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.222548 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.222729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.222808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.222970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.223123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.223208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.223281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] credential.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.223442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.223520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.223689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.223774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.223923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.224002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.224164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.224241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.224412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.224491 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.224648 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.224726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.224915 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.224992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.225157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.225236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.225397 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.225474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.225630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] federation.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.225713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.225866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.225945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.226109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.226188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.226375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.226458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.226603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.226683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.226847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.226926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.227082 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.227161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] federation.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.227332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.227420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.227566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.227646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.227817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.227897 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.228053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.228133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.228298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.228377 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.228531 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.228609 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.228775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.228855 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.229011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.229089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.229243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.229320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.229476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.229557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.229732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.229971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.230222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.231186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.231445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.231704 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.231970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.232047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.232235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.232312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.232476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.232555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.232716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.232794 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.232958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.233036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.233210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.233290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.233464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.233543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.233718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.233796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.233958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.234037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.234199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.234325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.234464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.234544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.234717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.234803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.234957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.235036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.235190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.235268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.235430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.235509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.235662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.235740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.235899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.235985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.236142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.236221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.236382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.236460 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.236629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.236719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.236861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.236941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.237102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.237180 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.237345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.237431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.237579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.238282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.238405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.238484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.238653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.238744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.238883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.238963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.239122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.239201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.239353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.239439 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.239590 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.239669 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.239827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.239906 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.240073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.240159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.240306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.240383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.240540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.240617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.240771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.240856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.241014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.241092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.241243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.241321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.241473 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.241559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.241718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.241795 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.241960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.242039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.242192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.242297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.242461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.242540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.242695 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.242774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.242924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.243016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.243164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.243243 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.243414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.243493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.243643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.243729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.243884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.243962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.244124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.244202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.244360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.244446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.244592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.244678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.244822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.244901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.245056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.245143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.245289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.245369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.245524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.245603 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.245752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.245849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.245995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.246075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.246232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.246376 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.246495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.246583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.246736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.246813 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.246976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.247054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.247203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.247289 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.247450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.247527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.247683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.247761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.247917 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.248066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.248140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.248211 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.248372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.248450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.248616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.248703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.248861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.248939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.249096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.249174 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.249333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.249417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.249563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.249642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.249798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.249876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.250036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.250122 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.250297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.250380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.250537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.250616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.250781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.250861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.251014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.251091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.251240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.251317 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.251472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.251552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.251709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] resource.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.251787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.251947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.252023 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.252189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.252267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.252426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.252531 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.252658 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.252733 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.252899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.252978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.253129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.253206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] resource.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.253397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.253481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.253632 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.253712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.253870 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.253949 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.254102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] role.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.254182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.254368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] role.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.254450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.254598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.254677 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.254845 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.254924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.255084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.255163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.255327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.255404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.255564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] role.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.255640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.255805 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.255884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] role.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.256038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.256115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.256279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.256356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.256522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.256602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.256750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.256829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.256996 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.257075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.257241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.257321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.257484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.257564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.257728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.257807 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.257976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.258115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.258194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.258372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.258476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.258621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.258712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.258868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.258953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.259114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.259229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.259359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.259581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.259659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.259818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.259896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.260072 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.260158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.260309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.260387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.260536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.260615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.260765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.260851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.260993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.261073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.261243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.261321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.261493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.261579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.261732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.261809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.261962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.262040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.262195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.262301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.262447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.262525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.262680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] token.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.262760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.262917 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.263003 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.263160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.263239 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.263393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.263472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.263642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.263727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.263878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.263956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.264109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.264187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] token.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.264348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.264433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.264585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.264663 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.264828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.264907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.265065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.265171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.265302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.265399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.265534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.265614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.265777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.265864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.266020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.266102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.266299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.266381 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.266506 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.266598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.266753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.266830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.266992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.267070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.connection = **** {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.267241 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.267329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.267492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.267572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.267725 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.267803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.267961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.268046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.268195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.268275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.268432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.268510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.connection = **** {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.268666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.268755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.268927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.269014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.269173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.269252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.269408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.269487 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.269649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.269736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.269886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.269965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.270132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.270211 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.270389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.270482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.270633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.270713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.270861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.270940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.271097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.271185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.271330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.271409 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.271481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 06:26:50.271579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.271819 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.272067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.272301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.272543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.272782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 06:26:50.272954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 06:26:50.300922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.301156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.301380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.301742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.301980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.302207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.309708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.310675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.337772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.338003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.338724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.338962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.395126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.395736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.444817 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.444946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.445052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.445158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.511336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.511561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.511766 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.511851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.511989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.512072 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.512209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.512291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.512441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.512551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.512628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.512844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.536098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.536329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.536529 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.536614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.536761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.536913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.536992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.537063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.537187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.537273 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.537399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.537481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.537614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.537829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.548272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.548647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.560985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.561094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.561213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.561296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.561436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.561518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.561655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.561736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.561870 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.561953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.562084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.562165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.562323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.562419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 06:26:50.580206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.580419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 06:26:50.580502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.580713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 06:26:50.580806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.580950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 06:26:50.581031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.581222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.581302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 06:26:50.581998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.582088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.582271 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.582353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.582528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.582607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.582777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.593334 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.593596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.593737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.593868 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.594011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.594301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.594384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.594732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.603036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.603569 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.606354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.606637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.606870 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.606950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.607144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.607236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.607424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.607504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.607703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.607782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.607977 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.608065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.608230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.608308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.608493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.608572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.608757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.608836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.609019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.609097 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.609286 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.609550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.635563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.635889 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.637179 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.637459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.637539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.637743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.642906 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.643140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.643220 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.643415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.643506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.643690 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.651351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.651481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.651596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.651758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.656099 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.656225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.656388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.656510 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.656672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.656797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.656958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.657038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.657236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.657315 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.657512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.657592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.657783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.657861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.658161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.658268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.677424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.677516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.677703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.677784 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.682277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.682440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.685995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.686077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.686317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.686401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.691363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.691473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.694981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.695094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.698612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.698792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.698907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.699094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.699176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.699381 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.699742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.699940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.700021 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.700221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.700309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.700501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.719759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.720037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.720242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.720336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.720526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.720607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.720806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.721071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.728976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.729619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.732322 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.732631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.732851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.733129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.735727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.736004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.736243 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.736324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.736525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.736617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.736811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.736893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.737100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.737389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.750147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.750459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.750742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.750920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.751025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.751205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.751296 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.751493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.751573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.751777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.751857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.752062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.752345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.752622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.770144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.771268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.773409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.774579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.776955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.778063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.778589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.779715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.780221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.780494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.780771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.781359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.781639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.781925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.788631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.789970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.790259 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.791629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.793595 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.793880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.794156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.794448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.795012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.795305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.795594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.795884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.803556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.803839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.804118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.805075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.805361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.805643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.812164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.812438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.812717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.812993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.813263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.813546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.813680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 06:26:50.813816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.813961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.814086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.814260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.814382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.814545 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.814649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.814820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.814901 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.815100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.815187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.815376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.815455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.815651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.816219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.816449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.816721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.816993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.817271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.817545 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.817805 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 06:26:50.854519 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fce192f9c0 pid: 80764 (default app) Jun 08 06:26:50.856608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fce192f9c0 pid: 80763 (default app) Jun 08 06:26:50.857843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4f682-f0da-4dae-8e66-728e4415eb10 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:26:50.858131 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4f682-f0da-4dae-8e66-728e4415eb10 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:26:50.858434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4f682-f0da-4dae-8e66-728e4415eb10 None None] PATH_INFO: `/v3` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:26:50.862565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Wed Jun 8 06:26:50 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:26:59.640899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33064c0a-1af3-49e4-9b60-376e834a3224 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:26:59.641462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33064c0a-1af3-49e4-9b60-376e834a3224 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:26:59.641462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33064c0a-1af3-49e4-9b60-376e834a3224 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:26:59.646292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:26:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:26:59.651501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efa640-04fa-480c-8a6b-b536065a0669 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:26:59.651887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efa640-04fa-480c-8a6b-b536065a0669 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:26:59.652061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efa640-04fa-480c-8a6b-b536065a0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:26:59.720281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: INFO dbcounter [None req-50efa640-04fa-480c-8a6b-b536065a0669 None None] Registered counter for database keystone Jun 08 06:26:59.741869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG oslo_db.sqlalchemy.engines [None req-50efa640-04fa-480c-8a6b-b536065a0669 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 06:26:59.748024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writer thread running {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 06:27:00.034555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG passlib.handlers.bcrypt [None req-50efa640-04fa-480c-8a6b-b536065a0669 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80764) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 08 06:27:00.034892 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG passlib.handlers.bcrypt [None req-50efa640-04fa-480c-8a6b-b536065a0669 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80764) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 08 06:27:00.097509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-50efa640-04fa-480c-8a6b-b536065a0669 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:00.099140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-50efa640-04fa-480c-8a6b-b536065a0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:00.223461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:26:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 573 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 08 06:27:00.401359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33064c0a-1af3-49e4-9b60-376e834a3224 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:00.473547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: INFO dbcounter [None req-33064c0a-1af3-49e4-9b60-376e834a3224 None None] Registered counter for database keystone Jun 08 06:27:00.492337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG oslo_db.sqlalchemy.engines [None req-33064c0a-1af3-49e4-9b60-376e834a3224 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 06:27:00.498466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writer thread running {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 06:27:00.722168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33064c0a-1af3-49e4-9b60-376e834a3224 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:00.726353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fd3fa-1f7d-4c2e-bb0f-55e15679b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:00.726998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd3fa-1f7d-4c2e-bb0f-55e15679b486 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:00.727280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd3fa-1f7d-4c2e-bb0f-55e15679b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:00.727554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd3fa-1f7d-4c2e-bb0f-55e15679b486 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:00.735473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fd3fa-1f7d-4c2e-bb0f-55e15679b486 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:00.786613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7b5fd3fa-1f7d-4c2e-bb0f-55e15679b486 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 08 06:27:00.786949 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fd3fa-1f7d-4c2e-bb0f-55e15679b486 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:00.796118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Jun 8 06:27:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:27:00.802118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efa640-04fa-480c-8a6b-b536065a0669 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:00.816685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efa640-04fa-480c-8a6b-b536065a0669 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:00.821114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910015e8-f9e2-496a-93ba-0bdf4ce0ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:00.822225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910015e8-f9e2-496a-93ba-0bdf4ce0ef8f admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:00.822537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910015e8-f9e2-496a-93ba-0bdf4ce0ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:00.822812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910015e8-f9e2-496a-93ba-0bdf4ce0ef8f admin admin] PATH_INFO: `/v3/projects/87773f44fe964196963231d64fa11c8f` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:00.824295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910015e8-f9e2-496a-93ba-0bdf4ce0ef8f admin admin] RBAC: Authorizing `identity:get_project(project_id=87773f44fe964196963231d64fa11c8f)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:00.874007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: WARNING keystone.common.rbac_enforcer.enforcer [None req-910015e8-f9e2-496a-93ba-0bdf4ce0ef8f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 08 06:27:00.874363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910015e8-f9e2-496a-93ba-0bdf4ce0ef8f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:00.880546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Wed Jun 8 06:27:00 2022] GET /identity/v3/projects/87773f44fe964196963231d64fa11c8f => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:03.071674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16be2b-5dfc-4807-a8df-e4c7e010c995 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:03.072204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16be2b-5dfc-4807-a8df-e4c7e010c995 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:03.072204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16be2b-5dfc-4807-a8df-e4c7e010c995 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:03.076585 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:03.082511 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344adda7-f238-4526-8a0e-659fdf277236 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:03.082955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344adda7-f238-4526-8a0e-659fdf277236 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:03.083118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344adda7-f238-4526-8a0e-659fdf277236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:03.101843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-344adda7-f238-4526-8a0e-659fdf277236 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:03.103365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-344adda7-f238-4526-8a0e-659fdf277236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:03.110968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 08 06:27:03.133838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16be2b-5dfc-4807-a8df-e4c7e010c995 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:03.146319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16be2b-5dfc-4807-a8df-e4c7e010c995 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:03.150507 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f54cd7-a660-463c-8e72-8a8df910af1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:03.151140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54cd7-a660-463c-8e72-8a8df910af1f admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:03.151424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54cd7-a660-463c-8e72-8a8df910af1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:03.151698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54cd7-a660-463c-8e72-8a8df910af1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:03.159870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f54cd7-a660-463c-8e72-8a8df910af1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:03.161620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f54cd7-a660-463c-8e72-8a8df910af1f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:03.170226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Jun 8 06:27:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:27:03.176141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344adda7-f238-4526-8a0e-659fdf277236 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:03.185034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344adda7-f238-4526-8a0e-659fdf277236 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:03.189335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ad480-eda2-4e2b-aec2-26cffcb18ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:03.190188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ad480-eda2-4e2b-aec2-26cffcb18ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:03.190506 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ad480-eda2-4e2b-aec2-26cffcb18ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:03.190781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ad480-eda2-4e2b-aec2-26cffcb18ab0 admin admin] PATH_INFO: `/v3/users/d3b20259d4d74838a9e50d6db7cf7a75` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:03.192146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ad480-eda2-4e2b-aec2-26cffcb18ab0 admin admin] RBAC: Authorizing `identity:get_user(user_id=d3b20259d4d74838a9e50d6db7cf7a75)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:03.193936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ad480-eda2-4e2b-aec2-26cffcb18ab0 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:03.195504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Wed Jun 8 06:27:03 2022] GET /identity/v3/users/d3b20259d4d74838a9e50d6db7cf7a75 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:05.491881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705f69-4bad-4772-99f2-4416009e7b57 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:05.492369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705f69-4bad-4772-99f2-4416009e7b57 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:05.492369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705f69-4bad-4772-99f2-4416009e7b57 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:05.493716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:05.498820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a179acb-badb-4130-ae81-1d263141529d None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:05.499242 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a179acb-badb-4130-ae81-1d263141529d None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:05.499380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a179acb-badb-4130-ae81-1d263141529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:05.504625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e706a-1be7-4aff-8430-b262d58760d1 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:05.504916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e706a-1be7-4aff-8430-b262d58760d1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:05.505201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e706a-1be7-4aff-8430-b262d58760d1 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:05.506510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:05.511497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef3ec-0979-4ef6-9dc2-82c2d5655983 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:05.511788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef3ec-0979-4ef6-9dc2-82c2d5655983 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:05.512072 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef3ec-0979-4ef6-9dc2-82c2d5655983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:05.515852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-7a179acb-badb-4130-ae81-1d263141529d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:05.517006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-7a179acb-badb-4130-ae81-1d263141529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:05.551597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG passlib.handlers.bcrypt [None req-5cdef3ec-0979-4ef6-9dc2-82c2d5655983 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80763) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 08 06:27:05.552018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG passlib.handlers.bcrypt [None req-5cdef3ec-0979-4ef6-9dc2-82c2d5655983 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80763) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 08 06:27:05.595630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:27:05.599080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5cdef3ec-0979-4ef6-9dc2-82c2d5655983 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:05.600670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5cdef3ec-0979-4ef6-9dc2-82c2d5655983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:05.618363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a179acb-badb-4130-ae81-1d263141529d None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:05.641202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:05.699950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:27:05.722346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a179acb-badb-4130-ae81-1d263141529d None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:05.722769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdef3ec-0979-4ef6-9dc2-82c2d5655983 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:05.755156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b19f7-2164-4fb0-8bc1-67c56e45ecc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:05.755884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b19f7-2164-4fb0-8bc1-67c56e45ecc7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:05.756167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b19f7-2164-4fb0-8bc1-67c56e45ecc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:05.756444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b19f7-2164-4fb0-8bc1-67c56e45ecc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:05.769265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b19f7-2164-4fb0-8bc1-67c56e45ecc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-903b19f7-2164-4fb0-8bc1-67c56e45ecc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:05.780301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:05.781251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:05.782168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:27:05.787739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b19f7-2164-4fb0-8bc1-67c56e45ecc7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:05.824932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdef3ec-0979-4ef6-9dc2-82c2d5655983 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:05.827491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:05.861395 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc730b2-3247-4cfa-83cc-d6342d8ae792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:05.862350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc730b2-3247-4cfa-83cc-d6342d8ae792 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:05.862639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc730b2-3247-4cfa-83cc-d6342d8ae792 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:05.862921 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc730b2-3247-4cfa-83cc-d6342d8ae792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:05.868582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:05.886571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b19f7-2164-4fb0-8bc1-67c56e45ecc7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:05.919700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cd596-4b33-49a5-b03f-9a6737b31522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:05.920365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd596-4b33-49a5-b03f-9a6737b31522 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:05.920650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd596-4b33-49a5-b03f-9a6737b31522 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:05.920933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd596-4b33-49a5-b03f-9a6737b31522 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:05.921682 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cd596-4b33-49a5-b03f-9a6737b31522 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:05.921992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cd596-4b33-49a5-b03f-9a6737b31522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:05.923425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cd596-4b33-49a5-b03f-9a6737b31522 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:05.930299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc730b2-3247-4cfa-83cc-d6342d8ae792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:05.931919 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc730b2-3247-4cfa-83cc-d6342d8ae792 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:05.934849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:05.940748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cd596-4b33-49a5-b03f-9a6737b31522 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:06.029692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 06:27:06.035093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc730b2-3247-4cfa-83cc-d6342d8ae792 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:06.037735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:06.040620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cd596-4b33-49a5-b03f-9a6737b31522 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:06.074287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990004c7-27cd-452d-91f2-6b4c6509df3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:06.075422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990004c7-27cd-452d-91f2-6b4c6509df3a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:06.075697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990004c7-27cd-452d-91f2-6b4c6509df3a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:06.075964 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990004c7-27cd-452d-91f2-6b4c6509df3a None admin] PATH_INFO: `/v3/users/d3b20259d4d74838a9e50d6db7cf7a75` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:06.077155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990004c7-27cd-452d-91f2-6b4c6509df3a None admin] RBAC: Authorizing `identity:get_user(user_id=d3b20259d4d74838a9e50d6db7cf7a75)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:06.078629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990004c7-27cd-452d-91f2-6b4c6509df3a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:06.080228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:05 2022] GET /identity/v3/users/d3b20259d4d74838a9e50d6db7cf7a75 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:06.085985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990004c7-27cd-452d-91f2-6b4c6509df3a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:06.099943 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:06.134885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc730b2-3247-4cfa-83cc-d6342d8ae792 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:06.170862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef23fcd-5f66-4121-98d2-9770d331777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:06.171658 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef23fcd-5f66-4121-98d2-9770d331777c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:06.171943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef23fcd-5f66-4121-98d2-9770d331777c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:06.172218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef23fcd-5f66-4121-98d2-9770d331777c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:06.186889 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990004c7-27cd-452d-91f2-6b4c6509df3a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:06.191673 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef23fcd-5f66-4121-98d2-9770d331777c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:06.193142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef23fcd-5f66-4121-98d2-9770d331777c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3ef23fcd-5f66-4121-98d2-9770d331777c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:27:06.213920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:06.214959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:06.216051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:27:06.216051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:27:06.216051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:27:06.216051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:06.216051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:27:06.220899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef23fcd-5f66-4121-98d2-9770d331777c None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:06.221868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b40f94-333e-427c-ac01-c541b8edc1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:06.222699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b40f94-333e-427c-ac01-c541b8edc1ed None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:06.222979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b40f94-333e-427c-ac01-c541b8edc1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:06.223251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b40f94-333e-427c-ac01-c541b8edc1ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:06.224419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b40f94-333e-427c-ac01-c541b8edc1ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:06.225862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b40f94-333e-427c-ac01-c541b8edc1ed None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:06.227485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:06.233035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b40f94-333e-427c-ac01-c541b8edc1ed None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:06.276606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:06.312689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:06.320115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef23fcd-5f66-4121-98d2-9770d331777c None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:06.331104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b40f94-333e-427c-ac01-c541b8edc1ed None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:06.353209 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02454382-275e-4f07-8d88-5f56a8c4fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:06.353865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02454382-275e-4f07-8d88-5f56a8c4fe8b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:06.354136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02454382-275e-4f07-8d88-5f56a8c4fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:06.354447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02454382-275e-4f07-8d88-5f56a8c4fe8b None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:06.355163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02454382-275e-4f07-8d88-5f56a8c4fe8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:06.355464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02454382-275e-4f07-8d88-5f56a8c4fe8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:06.356849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02454382-275e-4f07-8d88-5f56a8c4fe8b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:06.365041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f847ae4-7448-4e3a-91b1-1c5bfdcb6b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:06.365692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f847ae4-7448-4e3a-91b1-1c5bfdcb6b38 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:06.365979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f847ae4-7448-4e3a-91b1-1c5bfdcb6b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:06.366278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f847ae4-7448-4e3a-91b1-1c5bfdcb6b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:06.367118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f847ae4-7448-4e3a-91b1-1c5bfdcb6b38 None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.domain.id=default, user.id=d3b20259d4d74838a9e50d6db7cf7a75) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:06.367428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f847ae4-7448-4e3a-91b1-1c5bfdcb6b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:06.368860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f847ae4-7448-4e3a-91b1-1c5bfdcb6b38 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:06.374356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:06.375534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 11/21] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Jun 8 06:27:06 2022] GET /identity/v3/role_assignments?user.id=d3b20259d4d74838a9e50d6db7cf7a75&scope.domain.id=default&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:08.905884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70af4c-9d98-4a58-97bf-c87188bf2a18 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:08.906980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70af4c-9d98-4a58-97bf-c87188bf2a18 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:08.907490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70af4c-9d98-4a58-97bf-c87188bf2a18 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:08.909144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:08.914484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a975-f5fd-4051-9ebb-e7f4f6a3a7de None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:08.915338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a975-f5fd-4051-9ebb-e7f4f6a3a7de None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:08.915811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a975-f5fd-4051-9ebb-e7f4f6a3a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:08.939047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-5800a975-f5fd-4051-9ebb-e7f4f6a3a7de None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:08.941217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5800a975-f5fd-4051-9ebb-e7f4f6a3a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:09.035981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:09.067309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70af4c-9d98-4a58-97bf-c87188bf2a18 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:09.216088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70af4c-9d98-4a58-97bf-c87188bf2a18 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:09.235889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:09.264089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb773dc-dca5-43c6-abba-4b4e759bd9e9 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:09.264691 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb773dc-dca5-43c6-abba-4b4e759bd9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:09.265164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb773dc-dca5-43c6-abba-4b4e759bd9e9 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:09.266828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:09.267420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ee2f4-6151-431d-961a-fa25893bd85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:09.269468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee2f4-6151-431d-961a-fa25893bd85c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:09.269946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee2f4-6151-431d-961a-fa25893bd85c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:09.270434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee2f4-6151-431d-961a-fa25893bd85c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:09.275522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9b72-d6cd-4ad6-b6c3-74235b58e085 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:09.276061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9b72-d6cd-4ad6-b6c3-74235b58e085 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:09.276546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9b72-d6cd-4ad6-b6c3-74235b58e085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:09.295282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ee2f4-6151-431d-961a-fa25893bd85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-216ee2f4-6151-431d-961a-fa25893bd85c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:09.304978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:09.305898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:09.306675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:09.309636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c5fa9b72-d6cd-4ad6-b6c3-74235b58e085 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:09.311112 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c5fa9b72-d6cd-4ad6-b6c3-74235b58e085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:09.318269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 12/25] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:09.320853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ee2f4-6151-431d-961a-fa25893bd85c None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:09.464752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 14/26] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:09.475368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc67e7-2b8f-4fff-9928-6a2630fb569c None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:09.475913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc67e7-2b8f-4fff-9928-6a2630fb569c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:09.476388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc67e7-2b8f-4fff-9928-6a2630fb569c None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:09.478057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 15/27] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:09.489073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfbe61-5a40-4710-96ac-86612355c8bd None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:09.489629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfbe61-5a40-4710-96ac-86612355c8bd None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:09.492104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfbe61-5a40-4710-96ac-86612355c8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:09.499310 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:09.520448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-8abfbe61-5a40-4710-96ac-86612355c8bd None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:09.521653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8abfbe61-5a40-4710-96ac-86612355c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:09.544370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ee2f4-6151-431d-961a-fa25893bd85c None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:09.581802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f84858-e4bd-4919-a127-caae205c6a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:09.582850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84858-e4bd-4919-a127-caae205c6a22 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:09.583341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84858-e4bd-4919-a127-caae205c6a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:09.583865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84858-e4bd-4919-a127-caae205c6a22 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:09.589505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f84858-e4bd-4919-a127-caae205c6a22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:09.589505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f84858-e4bd-4919-a127-caae205c6a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:09.589505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f84858-e4bd-4919-a127-caae205c6a22 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:09.604424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 13/28] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:09.605266 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f84858-e4bd-4919-a127-caae205c6a22 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:09.627224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 16/29] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 08 06:27:09.629144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001200-4724-471b-b309-2348a17be54f None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:09.629656 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001200-4724-471b-b309-2348a17be54f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:09.630127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001200-4724-471b-b309-2348a17be54f None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:09.631923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 17/30] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:09.636852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56001200-4724-471b-b309-2348a17be54f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:09.654084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:09.728829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f84858-e4bd-4919-a127-caae205c6a22 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:09.750544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56001200-4724-471b-b309-2348a17be54f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:09.774907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc078a-b096-472c-93ff-f410dcfe99e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:09.775960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc078a-b096-472c-93ff-f410dcfe99e1 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:09.776247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc078a-b096-472c-93ff-f410dcfe99e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:09.776524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc078a-b096-472c-93ff-f410dcfe99e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:09.786173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4200d79-b12b-47cd-853c-9f7260c50a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:09.787326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200d79-b12b-47cd-853c-9f7260c50a50 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:09.787824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200d79-b12b-47cd-853c-9f7260c50a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:09.788293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200d79-b12b-47cd-853c-9f7260c50a50 None admin] PATH_INFO: `/v3/users/d3b20259d4d74838a9e50d6db7cf7a75` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:09.789673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4200d79-b12b-47cd-853c-9f7260c50a50 None admin] RBAC: Authorizing `identity:get_user(user_id=d3b20259d4d74838a9e50d6db7cf7a75)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:09.790069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc078a-b096-472c-93ff-f410dcfe99e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:09.791574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4200d79-b12b-47cd-853c-9f7260c50a50 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:09.791694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc078a-b096-472c-93ff-f410dcfe99e1 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:09.793507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 18/31] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:09 2022] GET /identity/v3/users/d3b20259d4d74838a9e50d6db7cf7a75 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:09.794980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bf07-cbb0-4471-87a8-ef26edaf699a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:09.795485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bf07-cbb0-4471-87a8-ef26edaf699a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:09.795953 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bf07-cbb0-4471-87a8-ef26edaf699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:09.812774 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:09.815741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-2cc5bf07-cbb0-4471-87a8-ef26edaf699a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-73dc078a-b096-472c-93ff-f410dcfe99e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:27:09.817088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:09.817889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:09.819157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:27:09.819157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:27:09.819157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:27:09.819157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:09.819157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 14/32] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:09.819157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc078a-b096-472c-93ff-f410dcfe99e1 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:09.819826 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2cc5bf07-cbb0-4471-87a8-ef26edaf699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:09.902383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 19/33] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:09.904213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5bf07-cbb0-4471-87a8-ef26edaf699a None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:09.933054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:09.945412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc078a-b096-472c-93ff-f410dcfe99e1 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:09.991390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0069d9-9ae2-48f0-958d-88e08e453050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:09.992296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0069d9-9ae2-48f0-958d-88e08e453050 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:09.992875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0069d9-9ae2-48f0-958d-88e08e453050 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:09.993291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0069d9-9ae2-48f0-958d-88e08e453050 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:09.995001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0069d9-9ae2-48f0-958d-88e08e453050 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:09.996532 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0069d9-9ae2-48f0-958d-88e08e453050 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:10.025328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5bf07-cbb0-4471-87a8-ef26edaf699a None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:10.058846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:10.063874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117759c-a9d2-453c-9922-cdc7eb819cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:10.064697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117759c-a9d2-453c-9922-cdc7eb819cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:10.064982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117759c-a9d2-453c-9922-cdc7eb819cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:10.065289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117759c-a9d2-453c-9922-cdc7eb819cf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:10.066560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117759c-a9d2-453c-9922-cdc7eb819cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:10.067997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117759c-a9d2-453c-9922-cdc7eb819cf9 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:10.069780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 20/34] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:10.074778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117759c-a9d2-453c-9922-cdc7eb819cf9 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:10.191154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117759c-a9d2-453c-9922-cdc7eb819cf9 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:10.233731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24377f98-c4db-4a23-8062-f751059253b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:10.234767 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24377f98-c4db-4a23-8062-f751059253b4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:10.235218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24377f98-c4db-4a23-8062-f751059253b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:10.235596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24377f98-c4db-4a23-8062-f751059253b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:10.236428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24377f98-c4db-4a23-8062-f751059253b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:10.236835 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24377f98-c4db-4a23-8062-f751059253b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:10.238363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24377f98-c4db-4a23-8062-f751059253b4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:10.256995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 21/35] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:10.257556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 15/36] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Jun 8 06:27:09 2022] POST /identity/v3/roles => generated 219 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:10.258435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24377f98-c4db-4a23-8062-f751059253b4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:10.259040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0069d9-9ae2-48f0-958d-88e08e453050 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:10.362939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:10.420769 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24377f98-c4db-4a23-8062-f751059253b4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:10.455366 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0069d9-9ae2-48f0-958d-88e08e453050 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:10.497979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54163fdd-cdbc-4885-852c-447d741f3998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:10.498914 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54163fdd-cdbc-4885-852c-447d741f3998 None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:10.499403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54163fdd-cdbc-4885-852c-447d741f3998 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:10.499689 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54163fdd-cdbc-4885-852c-447d741f3998 None admin] PATH_INFO: `/v3/domains/default/users/d3b20259d4d74838a9e50d6db7cf7a75/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:10.502508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54163fdd-cdbc-4885-852c-447d741f3998 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d3b20259d4d74838a9e50d6db7cf7a75, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:10.504758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54163fdd-cdbc-4885-852c-447d741f3998 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:10.507089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82977b-0e27-47a3-a57c-346fab3d0d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:10.507731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82977b-0e27-47a3-a57c-346fab3d0d5f None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:10.508020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82977b-0e27-47a3-a57c-346fab3d0d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:10.508305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82977b-0e27-47a3-a57c-346fab3d0d5f None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:10.509080 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82977b-0e27-47a3-a57c-346fab3d0d5f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:10.510526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82977b-0e27-47a3-a57c-346fab3d0d5f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:10.602026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 16/37] 10.222.0.40 () {58 vars in 1361 bytes} [Wed Jun 8 06:27:10 2022] PUT /identity/v3/domains/default/users/d3b20259d4d74838a9e50d6db7cf7a75/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:10.602973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54163fdd-cdbc-4885-852c-447d741f3998 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:10.615884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:10.717450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54163fdd-cdbc-4885-852c-447d741f3998 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:10.744678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 22/38] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Jun 8 06:27:10 2022] POST /identity/v3/roles => generated 225 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:10.746365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4361-36bb-4295-beed-88fc265fdb81 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:10.746660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4361-36bb-4295-beed-88fc265fdb81 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:10.746940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4361-36bb-4295-beed-88fc265fdb81 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:10.748305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 23/39] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:10.749343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2041f37-f512-4d47-b692-6d8a249ecc05 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:10.749627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2041f37-f512-4d47-b692-6d8a249ecc05 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:10.749905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2041f37-f512-4d47-b692-6d8a249ecc05 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:10.754517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 24/40] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:10.754936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd62f3-43c3-4e8b-86bd-565af15e35df None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:10.755114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd62f3-43c3-4e8b-86bd-565af15e35df None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:10.755411 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd62f3-43c3-4e8b-86bd-565af15e35df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:10.765624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdad518-2726-486c-bfd4-f98d80ad12fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:10.766659 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdad518-2726-486c-bfd4-f98d80ad12fd None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:10.767121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdad518-2726-486c-bfd4-f98d80ad12fd None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:10.767450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdad518-2726-486c-bfd4-f98d80ad12fd None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:10.768258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdad518-2726-486c-bfd4-f98d80ad12fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:10.769823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdad518-2726-486c-bfd4-f98d80ad12fd None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:10.785061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-68bd62f3-43c3-4e8b-86bd-565af15e35df None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:10.787418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-68bd62f3-43c3-4e8b-86bd-565af15e35df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:10.870854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 17/41] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:27:10 2022] POST /identity/v3/projects => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:10.872372 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23aa3-a7e6-48bf-abf7-6d420efafc12 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:10.872721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23aa3-a7e6-48bf-abf7-6d420efafc12 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:10.873077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23aa3-a7e6-48bf-abf7-6d420efafc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:10.882425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 25/42] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:10.901839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-53f23aa3-a7e6-48bf-abf7-6d420efafc12 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:10.903476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-53f23aa3-a7e6-48bf-abf7-6d420efafc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:10.908694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd62f3-43c3-4e8b-86bd-565af15e35df None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:11.006208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:11.017391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:11.028997 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 18/43] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:11.056721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f23aa3-a7e6-48bf-abf7-6d420efafc12 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:11.074207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd62f3-43c3-4e8b-86bd-565af15e35df None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:11.127182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df2625-c1d9-4013-ae2c-2b035a49a2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:11.127911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df2625-c1d9-4013-ae2c-2b035a49a2eb None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:11.128201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df2625-c1d9-4013-ae2c-2b035a49a2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:11.128480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df2625-c1d9-4013-ae2c-2b035a49a2eb None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:11.129259 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df2625-c1d9-4013-ae2c-2b035a49a2eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:11.130858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df2625-c1d9-4013-ae2c-2b035a49a2eb None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:11.202585 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f23aa3-a7e6-48bf-abf7-6d420efafc12 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:11.204517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 26/44] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Jun 8 06:27:10 2022] POST /identity/v3/roles => generated 223 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:11.244855 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c31aa7-fd38-4a44-8f40-cafbc8bf52ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:11.245693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c31aa7-fd38-4a44-8f40-cafbc8bf52ff None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:11.245984 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c31aa7-fd38-4a44-8f40-cafbc8bf52ff None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:11.246297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c31aa7-fd38-4a44-8f40-cafbc8bf52ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:11.247731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c31aa7-fd38-4a44-8f40-cafbc8bf52ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:11.252427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c31aa7-fd38-4a44-8f40-cafbc8bf52ff None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:11.252427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 19/45] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:11.256704 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df2625-c1d9-4013-ae2c-2b035a49a2eb None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:11.371279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df2625-c1d9-4013-ae2c-2b035a49a2eb None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:11.385129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:11.410675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1e9b9-466d-4a61-aa4d-ec53f1989f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:11.411359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e9b9-466d-4a61-aa4d-ec53f1989f17 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:11.412437 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e9b9-466d-4a61-aa4d-ec53f1989f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:11.412437 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e9b9-466d-4a61-aa4d-ec53f1989f17 None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:11.412847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1e9b9-466d-4a61-aa4d-ec53f1989f17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:11.414477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1e9b9-466d-4a61-aa4d-ec53f1989f17 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:11.508318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 27/46] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:27:11 2022] POST /identity/v3/projects => generated 312 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:12.899591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a5f0-041a-4dda-989f-fed6ec367747 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:12.900100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a5f0-041a-4dda-989f-fed6ec367747 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:12.900180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a5f0-041a-4dda-989f-fed6ec367747 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:12.901530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 20/47] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:12.906827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39a4e-0a49-4394-96ab-de8065356958 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:12.907205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39a4e-0a49-4394-96ab-de8065356958 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:12.907531 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39a4e-0a49-4394-96ab-de8065356958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:12.925139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-83a39a4e-0a49-4394-96ab-de8065356958 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:12.926339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-83a39a4e-0a49-4394-96ab-de8065356958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:12.991829 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 28/48] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:13.014199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3a5f0-041a-4dda-989f-fed6ec367747 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:13.073105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:13.113328 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3a5f0-041a-4dda-989f-fed6ec367747 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:13.149918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb74e-85a4-47f8-8058-d33bb3197aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:13.150694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb74e-85a4-47f8-8058-d33bb3197aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:13.150979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb74e-85a4-47f8-8058-d33bb3197aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:13.151250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb74e-85a4-47f8-8058-d33bb3197aa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:13.161805 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eb74e-85a4-47f8-8058-d33bb3197aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-d96eb74e-85a4-47f8-8058-d33bb3197aa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:13.169277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:13.170203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:13.170968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 21/49] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:13.176171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39a4e-0a49-4394-96ab-de8065356958 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:13.262195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:13.271133 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39a4e-0a49-4394-96ab-de8065356958 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:13.304775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099411c-6fdd-4ce4-b49b-131421257d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:13.305446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099411c-6fdd-4ce4-b49b-131421257d88 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:13.305734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099411c-6fdd-4ce4-b49b-131421257d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:13.306013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099411c-6fdd-4ce4-b49b-131421257d88 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:13.306796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099411c-6fdd-4ce4-b49b-131421257d88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:13.307105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099411c-6fdd-4ce4-b49b-131421257d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:13.308480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099411c-6fdd-4ce4-b49b-131421257d88 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:13.317040 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 29/50] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:13.322606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb74e-85a4-47f8-8058-d33bb3197aa6 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:13.422217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb74e-85a4-47f8-8058-d33bb3197aa6 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:13.443995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:13.458452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d7cf5-ec43-4e38-9bd1-a134a963c225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:13.459396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d7cf5-ec43-4e38-9bd1-a134a963c225 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:13.459678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d7cf5-ec43-4e38-9bd1-a134a963c225 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:13.459956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d7cf5-ec43-4e38-9bd1-a134a963c225 None admin] PATH_INFO: `/v3/users/d3b20259d4d74838a9e50d6db7cf7a75` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:13.461137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d7cf5-ec43-4e38-9bd1-a134a963c225 None admin] RBAC: Authorizing `identity:get_user(user_id=d3b20259d4d74838a9e50d6db7cf7a75)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:13.462604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d7cf5-ec43-4e38-9bd1-a134a963c225 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:13.464292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 22/51] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:13 2022] GET /identity/v3/users/d3b20259d4d74838a9e50d6db7cf7a75 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:13.469699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099411c-6fdd-4ce4-b49b-131421257d88 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:13.565973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099411c-6fdd-4ce4-b49b-131421257d88 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:13.598625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bb389-0627-4524-8645-2217aa4b2f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:13.599412 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bb389-0627-4524-8645-2217aa4b2f45 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:13.599698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bb389-0627-4524-8645-2217aa4b2f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:13.599977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bb389-0627-4524-8645-2217aa4b2f45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:13.601138 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bb389-0627-4524-8645-2217aa4b2f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:13.602597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bb389-0627-4524-8645-2217aa4b2f45 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:13.604205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 30/52] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:13.609858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d7cf5-ec43-4e38-9bd1-a134a963c225 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:13.711769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d7cf5-ec43-4e38-9bd1-a134a963c225 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:13.744087 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f73d86-9cad-47d2-9149-c84ec08d5b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:13.744743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f73d86-9cad-47d2-9149-c84ec08d5b0a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:13.745028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f73d86-9cad-47d2-9149-c84ec08d5b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:13.745115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec089d-e202-47a0-a88e-7b25ddf0e589 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:13.745308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f73d86-9cad-47d2-9149-c84ec08d5b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:13.745394 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec089d-e202-47a0-a88e-7b25ddf0e589 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:13.745649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec089d-e202-47a0-a88e-7b25ddf0e589 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:13.746149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f73d86-9cad-47d2-9149-c84ec08d5b0a None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.domain.id=default, user.id=d3b20259d4d74838a9e50d6db7cf7a75) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:13.746496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f73d86-9cad-47d2-9149-c84ec08d5b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:13.747049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 31/53] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:13.747994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f73d86-9cad-47d2-9149-c84ec08d5b0a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:13.751836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee2bb-c45e-4691-ab40-f3667138b2a4 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:13.752129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee2bb-c45e-4691-ab40-f3667138b2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:13.752435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee2bb-c45e-4691-ab40-f3667138b2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:13.756843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 23/54] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Jun 8 06:27:13 2022] GET /identity/v3/role_assignments?user.id=d3b20259d4d74838a9e50d6db7cf7a75&scope.domain.id=default&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:13.770340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-76fee2bb-c45e-4691-ab40-f3667138b2a4 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:13.771582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-76fee2bb-c45e-4691-ab40-f3667138b2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:13.789882 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:13.843978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 32/55] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:27:13.867898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f73d86-9cad-47d2-9149-c84ec08d5b0a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:13.922919 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:13.971022 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f73d86-9cad-47d2-9149-c84ec08d5b0a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:14.007947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741122e9-6276-4fe2-a75a-2bc82feffb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:14.008742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741122e9-6276-4fe2-a75a-2bc82feffb26 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:14.009023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741122e9-6276-4fe2-a75a-2bc82feffb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:14.009295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741122e9-6276-4fe2-a75a-2bc82feffb26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:14.010499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741122e9-6276-4fe2-a75a-2bc82feffb26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:14.011941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741122e9-6276-4fe2-a75a-2bc82feffb26 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:14.013670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 24/56] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:14.019471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fee2bb-c45e-4691-ab40-f3667138b2a4 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:14.113932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fee2bb-c45e-4691-ab40-f3667138b2a4 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:14.145724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775b704-48ba-4837-814e-0703d5508001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:14.146412 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775b704-48ba-4837-814e-0703d5508001 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:14.146696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775b704-48ba-4837-814e-0703d5508001 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:14.146972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775b704-48ba-4837-814e-0703d5508001 None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:14.147676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775b704-48ba-4837-814e-0703d5508001 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:14.149120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775b704-48ba-4837-814e-0703d5508001 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:14.232966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 33/57] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Jun 8 06:27:14 2022] POST /identity/v3/projects => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:27:16.454150 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f573-2388-4a54-a3ef-ca32c7d79d17 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:16.454685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f573-2388-4a54-a3ef-ca32c7d79d17 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:16.454685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f573-2388-4a54-a3ef-ca32c7d79d17 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:16.456625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 25/58] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:16.461676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53514c17-027d-40bb-9413-1498f40f9944 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:16.462065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53514c17-027d-40bb-9413-1498f40f9944 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:16.462230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53514c17-027d-40bb-9413-1498f40f9944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:16.468065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:16.478452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-53514c17-027d-40bb-9413-1498f40f9944 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:16.479620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-53514c17-027d-40bb-9413-1498f40f9944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:16.547843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 34/59] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:16.572369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308f573-2388-4a54-a3ef-ca32c7d79d17 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:16.671662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308f573-2388-4a54-a3ef-ca32c7d79d17 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:16.691611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:16.704938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634526e-0411-41ae-93de-da9277d96379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:16.705751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634526e-0411-41ae-93de-da9277d96379 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:16.706039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634526e-0411-41ae-93de-da9277d96379 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:16.706354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634526e-0411-41ae-93de-da9277d96379 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:16.707521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634526e-0411-41ae-93de-da9277d96379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:16.708966 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634526e-0411-41ae-93de-da9277d96379 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:16.710592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 26/60] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:16.715967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53514c17-027d-40bb-9413-1498f40f9944 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:16.810832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53514c17-027d-40bb-9413-1498f40f9944 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:16.845896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15000be7-673d-45e5-b734-16834beda64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:16.846634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15000be7-673d-45e5-b734-16834beda64c None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:16.846947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15000be7-673d-45e5-b734-16834beda64c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:16.847256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15000be7-673d-45e5-b734-16834beda64c None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:16.848117 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15000be7-673d-45e5-b734-16834beda64c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:16.849599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15000be7-673d-45e5-b734-16834beda64c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:16.858062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:16.986086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 35/61] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:27:16 2022] POST /identity/v3/users => generated 275 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:20.522726 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29452c8a-d70d-46f8-9b61-36452768c3e5 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:20.523758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29452c8a-d70d-46f8-9b61-36452768c3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:20.524252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29452c8a-d70d-46f8-9b61-36452768c3e5 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:20.525943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 27/62] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:20.531966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09665-3946-4e3c-966d-7e2be3868077 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:20.532893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09665-3946-4e3c-966d-7e2be3868077 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:20.533374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09665-3946-4e3c-966d-7e2be3868077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:20.551761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c5f09665-3946-4e3c-966d-7e2be3868077 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:20.553323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c5f09665-3946-4e3c-966d-7e2be3868077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:20.616940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9e21-c4d2-4a87-9cf3-e669b878b63b None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:20.617571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9e21-c4d2-4a87-9cf3-e669b878b63b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:20.618082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9e21-c4d2-4a87-9cf3-e669b878b63b None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:20.619926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 28/63] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:20.625244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e299401-1024-4029-a5c8-dff1b65f782c None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:20.625780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e299401-1024-4029-a5c8-dff1b65f782c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:20.626267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e299401-1024-4029-a5c8-dff1b65f782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:20.636182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 36/64] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:20.655522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-6e299401-1024-4029-a5c8-dff1b65f782c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:20.656990 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-6e299401-1024-4029-a5c8-dff1b65f782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:20.672063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81f066-27e2-4357-a431-6b187a2c918c None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:20.672656 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81f066-27e2-4357-a431-6b187a2c918c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:20.673149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81f066-27e2-4357-a431-6b187a2c918c None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:20.674977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 37/65] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:20.680216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b95b76-67df-4f18-8465-9e09c7111f8e None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:20.680687 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b95b76-67df-4f18-8465-9e09c7111f8e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:20.682453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b95b76-67df-4f18-8465-9e09c7111f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:20.701884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c6b95b76-67df-4f18-8465-9e09c7111f8e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:20.703518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c6b95b76-67df-4f18-8465-9e09c7111f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:20.745401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 29/66] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:27:20.754732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e299401-1024-4029-a5c8-dff1b65f782c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:20.774080 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 38/67] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:20.775635 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027a704-fc5d-4f78-9bee-b8474ab73550 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:20.776070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027a704-fc5d-4f78-9bee-b8474ab73550 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:20.776489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027a704-fc5d-4f78-9bee-b8474ab73550 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:20.778166 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 39/68] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:20.787583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673d8b8-05c7-4248-814d-60f688d955d5 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:20.788054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673d8b8-05c7-4248-814d-60f688d955d5 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:20.788477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673d8b8-05c7-4248-814d-60f688d955d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:20.805605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-b673d8b8-05c7-4248-814d-60f688d955d5 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:20.807022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b673d8b8-05c7-4248-814d-60f688d955d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:20.857230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:20.857915 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e299401-1024-4029-a5c8-dff1b65f782c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:20.876302 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:20.882775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 40/69] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:20.882775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673d8b8-05c7-4248-814d-60f688d955d5 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:20.902183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0be197-7a3c-4edc-ab96-78520ab9cfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:20.903263 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0be197-7a3c-4edc-ab96-78520ab9cfdb None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:20.903682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0be197-7a3c-4edc-ab96-78520ab9cfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:20.904098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0be197-7a3c-4edc-ab96-78520ab9cfdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:20.917517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0be197-7a3c-4edc-ab96-78520ab9cfdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-2b0be197-7a3c-4edc-ab96-78520ab9cfdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:20.926394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:20.933147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 30/70] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:27:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:20.934098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0be197-7a3c-4edc-ab96-78520ab9cfdb None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:20.992690 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673d8b8-05c7-4248-814d-60f688d955d5 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.026365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114086b8-40c3-44e0-9017-ddc4f0c0bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.027090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114086b8-40c3-44e0-9017-ddc4f0c0bd51 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.027377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114086b8-40c3-44e0-9017-ddc4f0c0bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.027651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114086b8-40c3-44e0-9017-ddc4f0c0bd51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.028168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0be197-7a3c-4edc-ab96-78520ab9cfdb None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.037708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114086b8-40c3-44e0-9017-ddc4f0c0bd51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-114086b8-40c3-44e0-9017-ddc4f0c0bd51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:21.045307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:21.046320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:21.047086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 41/71] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:21.047697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114086b8-40c3-44e0-9017-ddc4f0c0bd51 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.067163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614b6ce-4814-4add-8956-f4e6d844d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.067958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614b6ce-4814-4add-8956-f4e6d844d6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.068245 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614b6ce-4814-4add-8956-f4e6d844d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.068522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614b6ce-4814-4add-8956-f4e6d844d6b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.078848 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614b6ce-4814-4add-8956-f4e6d844d6b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-2614b6ce-4814-4add-8956-f4e6d844d6b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:21.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:21.087898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:21.088640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 31/72] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:21.089714 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e6d14-028d-4889-a50d-8c2e4c2e9392 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.089714 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e6d14-028d-4889-a50d-8c2e4c2e9392 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.089977 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e6d14-028d-4889-a50d-8c2e4c2e9392 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.091420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 32/73] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:21.091958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e6d14-028d-4889-a50d-8c2e4c2e9392 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.092827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:21.133141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:21.151115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114086b8-40c3-44e0-9017-ddc4f0c0bd51 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.184000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb96894-62cb-42f4-aa77-c8c1138ca175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.184802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb96894-62cb-42f4-aa77-c8c1138ca175 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.185091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb96894-62cb-42f4-aa77-c8c1138ca175 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.185371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb96894-62cb-42f4-aa77-c8c1138ca175 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.193920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e6d14-028d-4889-a50d-8c2e4c2e9392 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.196015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb96894-62cb-42f4-aa77-c8c1138ca175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-3cb96894-62cb-42f4-aa77-c8c1138ca175 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:21.203866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:21.204683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:21.205426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 42/74] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:21.206035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb96894-62cb-42f4-aa77-c8c1138ca175 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.229824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2039ac9-a882-488e-a57b-6a21229b3a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.230520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039ac9-a882-488e-a57b-6a21229b3a69 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.230801 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039ac9-a882-488e-a57b-6a21229b3a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.231083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039ac9-a882-488e-a57b-6a21229b3a69 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.231819 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2039ac9-a882-488e-a57b-6a21229b3a69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:21.232127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2039ac9-a882-488e-a57b-6a21229b3a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:21.233496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2039ac9-a882-488e-a57b-6a21229b3a69 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:21.241798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 33/75] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:21.242597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2039ac9-a882-488e-a57b-6a21229b3a69 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.306128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:21.308925 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb96894-62cb-42f4-aa77-c8c1138ca175 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.338293 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:21.341268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2039ac9-a882-488e-a57b-6a21229b3a69 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.342655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f6674-c76a-4f79-8201-a4a9f45b720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.343328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f6674-c76a-4f79-8201-a4a9f45b720b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.343617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f6674-c76a-4f79-8201-a4a9f45b720b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.343899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f6674-c76a-4f79-8201-a4a9f45b720b None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.344672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f6674-c76a-4f79-8201-a4a9f45b720b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:21.344967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f6674-c76a-4f79-8201-a4a9f45b720b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:21.346386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f6674-c76a-4f79-8201-a4a9f45b720b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:21.354527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 43/76] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:21.355712 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594260c2-d45d-4a2a-9e10-f32ba8a6742b None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.356005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594260c2-d45d-4a2a-9e10-f32ba8a6742b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.356286 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594260c2-d45d-4a2a-9e10-f32ba8a6742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.372731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-594260c2-d45d-4a2a-9e10-f32ba8a6742b None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:21.373896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-594260c2-d45d-4a2a-9e10-f32ba8a6742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:21.381457 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15791c7-75ce-42ab-83c7-f46ddd0701c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.382133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15791c7-75ce-42ab-83c7-f46ddd0701c1 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.382468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15791c7-75ce-42ab-83c7-f46ddd0701c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.382751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15791c7-75ce-42ab-83c7-f46ddd0701c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.383503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15791c7-75ce-42ab-83c7-f46ddd0701c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:21.383817 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15791c7-75ce-42ab-83c7-f46ddd0701c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:21.385607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15791c7-75ce-42ab-83c7-f46ddd0701c1 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:21.394062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 34/77] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:21.394683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15791c7-75ce-42ab-83c7-f46ddd0701c1 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.443594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 44/78] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:21.444454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594260c2-d45d-4a2a-9e10-f32ba8a6742b None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.505794 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15791c7-75ce-42ab-83c7-f46ddd0701c1 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.533061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:21.539015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305c45-362d-481e-850a-7c239bed7438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.539742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305c45-362d-481e-850a-7c239bed7438 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.540028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305c45-362d-481e-850a-7c239bed7438 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.540310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305c45-362d-481e-850a-7c239bed7438 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.541115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f305c45-362d-481e-850a-7c239bed7438 None admin] RBAC: Adding query filter params (name=member) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:21.541423 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f305c45-362d-481e-850a-7c239bed7438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:21.542018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594260c2-d45d-4a2a-9e10-f32ba8a6742b None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.542836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f305c45-362d-481e-850a-7c239bed7438 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:21.551597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 35/79] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:21.552215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305c45-362d-481e-850a-7c239bed7438 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.577459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56609ddd-c487-41fa-84f2-4b817e7f999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.578278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609ddd-c487-41fa-84f2-4b817e7f999a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.578566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609ddd-c487-41fa-84f2-4b817e7f999a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.578684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:21.578840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609ddd-c487-41fa-84f2-4b817e7f999a None admin] PATH_INFO: `/v3/users/a347ea4ea5a0424b8b080b3702d8ee75` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.591581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56609ddd-c487-41fa-84f2-4b817e7f999a None admin] RBAC: Authorizing `identity:get_user(user_id=a347ea4ea5a0424b8b080b3702d8ee75)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:21.593043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56609ddd-c487-41fa-84f2-4b817e7f999a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:21.594781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 45/80] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/users/a347ea4ea5a0424b8b080b3702d8ee75 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:21.595550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56609ddd-c487-41fa-84f2-4b817e7f999a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.651184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305c45-362d-481e-850a-7c239bed7438 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.685839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcf18c-c128-4853-bbd9-d663a9e9795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.686765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcf18c-c128-4853-bbd9-d663a9e9795e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.687057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcf18c-c128-4853-bbd9-d663a9e9795e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.687333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcf18c-c128-4853-bbd9-d663a9e9795e None admin] PATH_INFO: `/v3/users/d3b20259d4d74838a9e50d6db7cf7a75` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.688539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcf18c-c128-4853-bbd9-d663a9e9795e None admin] RBAC: Authorizing `identity:get_user(user_id=d3b20259d4d74838a9e50d6db7cf7a75)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:21.689994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcf18c-c128-4853-bbd9-d663a9e9795e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:21.691700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 36/81] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/users/d3b20259d4d74838a9e50d6db7cf7a75 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:21.692461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcf18c-c128-4853-bbd9-d663a9e9795e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.694674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56609ddd-c487-41fa-84f2-4b817e7f999a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.728546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a65a38-00d7-43de-90e9-c74c0ef86e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.729454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65a38-00d7-43de-90e9-c74c0ef86e05 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.729726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65a38-00d7-43de-90e9-c74c0ef86e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.730004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65a38-00d7-43de-90e9-c74c0ef86e05 None admin] PATH_INFO: `/v3/users/a347ea4ea5a0424b8b080b3702d8ee75` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.731210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a65a38-00d7-43de-90e9-c74c0ef86e05 None admin] RBAC: Authorizing `identity:get_user(user_id=a347ea4ea5a0424b8b080b3702d8ee75)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:21.732643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a65a38-00d7-43de-90e9-c74c0ef86e05 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:21.734282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 46/82] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/users/a347ea4ea5a0424b8b080b3702d8ee75 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:21.735038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a65a38-00d7-43de-90e9-c74c0ef86e05 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.753662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:21.785586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:21.794223 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcf18c-c128-4853-bbd9-d663a9e9795e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.827781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e4ef7-e687-42bf-81dc-644dba75153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.828509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e4ef7-e687-42bf-81dc-644dba75153e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.828798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e4ef7-e687-42bf-81dc-644dba75153e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.829078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e4ef7-e687-42bf-81dc-644dba75153e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.830310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e4ef7-e687-42bf-81dc-644dba75153e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:21.831763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e4ef7-e687-42bf-81dc-644dba75153e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:21.832091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a65a38-00d7-43de-90e9-c74c0ef86e05 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.833385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 37/83] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:21.834156 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e4ef7-e687-42bf-81dc-644dba75153e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.866657 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84027ab0-dbaf-4977-8cef-06a9b8adb5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.867533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027ab0-dbaf-4977-8cef-06a9b8adb5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.867824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027ab0-dbaf-4977-8cef-06a9b8adb5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.868129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027ab0-dbaf-4977-8cef-06a9b8adb5b3 None admin] PATH_INFO: `/v3/users/a347ea4ea5a0424b8b080b3702d8ee75` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.869311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84027ab0-dbaf-4977-8cef-06a9b8adb5b3 None admin] RBAC: Authorizing `identity:get_user(user_id=a347ea4ea5a0424b8b080b3702d8ee75)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:21.870781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84027ab0-dbaf-4977-8cef-06a9b8adb5b3 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:21.872392 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 47/84] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/users/a347ea4ea5a0424b8b080b3702d8ee75 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:21.873152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84027ab0-dbaf-4977-8cef-06a9b8adb5b3 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:21.933882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e4ef7-e687-42bf-81dc-644dba75153e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.962252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:21.967263 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304ee2a-4f7b-49f3-b134-d6989aa93775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:21.967912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304ee2a-4f7b-49f3-b134-d6989aa93775 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:21.968196 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304ee2a-4f7b-49f3-b134-d6989aa93775 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:21.968477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304ee2a-4f7b-49f3-b134-d6989aa93775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:21.977216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84027ab0-dbaf-4977-8cef-06a9b8adb5b3 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:21.995681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:22.013304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359c0a3-35a5-4c8b-b57e-bc4972fd32f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:22.013304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359c0a3-35a5-4c8b-b57e-bc4972fd32f5 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:22.013574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359c0a3-35a5-4c8b-b57e-bc4972fd32f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:22.013818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359c0a3-35a5-4c8b-b57e-bc4972fd32f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:22.035730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304ee2a-4f7b-49f3-b134-d6989aa93775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:22.037555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304ee2a-4f7b-49f3-b134-d6989aa93775 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:22.081529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359c0a3-35a5-4c8b-b57e-bc4972fd32f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:22.083488 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359c0a3-35a5-4c8b-b57e-bc4972fd32f5 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:22.145705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 38/85] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:22.146745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304ee2a-4f7b-49f3-b134-d6989aa93775 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:22.170946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:22.186683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 48/86] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:22.187482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359c0a3-35a5-4c8b-b57e-bc4972fd32f5 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:22.203105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:22.242805 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304ee2a-4f7b-49f3-b134-d6989aa93775 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:22.276070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e198c-88f1-429a-90ee-ccbedbf2cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:22.276713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e198c-88f1-429a-90ee-ccbedbf2cca1 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:22.276994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e198c-88f1-429a-90ee-ccbedbf2cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:22.277266 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e198c-88f1-429a-90ee-ccbedbf2cca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:22.286742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359c0a3-35a5-4c8b-b57e-bc4972fd32f5 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:22.319623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f99cb-31f8-45b6-bb59-17305a8215ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:22.320280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f99cb-31f8-45b6-bb59-17305a8215ea None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:22.320566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f99cb-31f8-45b6-bb59-17305a8215ea None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:22.320840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f99cb-31f8-45b6-bb59-17305a8215ea None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:22.321548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f99cb-31f8-45b6-bb59-17305a8215ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:22.323017 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f99cb-31f8-45b6-bb59-17305a8215ea None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:22.342425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e198c-88f1-429a-90ee-ccbedbf2cca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:22.343887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e198c-88f1-429a-90ee-ccbedbf2cca1 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:22.399924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:22.429651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 49/87] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:27:22 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:22.430512 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f99cb-31f8-45b6-bb59-17305a8215ea None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:22.439753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 39/88] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:22.440647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e198c-88f1-429a-90ee-ccbedbf2cca1 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:22.496675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:22.558195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e198c-88f1-429a-90ee-ccbedbf2cca1 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:22.564867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f99cb-31f8-45b6-bb59-17305a8215ea None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:22.597046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75880e-743f-4f17-874c-3261cacddc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:22.598564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75880e-743f-4f17-874c-3261cacddc26 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:22.599056 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75880e-743f-4f17-874c-3261cacddc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:22.599502 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75880e-743f-4f17-874c-3261cacddc26 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:22.600957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75880e-743f-4f17-874c-3261cacddc26 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:22.602624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75880e-743f-4f17-874c-3261cacddc26 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:22.604554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 40/89] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:22 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:22.605344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75880e-743f-4f17-874c-3261cacddc26 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:22.611342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8366f-814b-4cfe-b12a-ac9dc4c4530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:22.612024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8366f-814b-4cfe-b12a-ac9dc4c4530d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:22.612314 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8366f-814b-4cfe-b12a-ac9dc4c4530d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:22.612599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8366f-814b-4cfe-b12a-ac9dc4c4530d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:22.642011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:22.687703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8366f-814b-4cfe-b12a-ac9dc4c4530d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:22.689178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8366f-814b-4cfe-b12a-ac9dc4c4530d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:22.730747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75880e-743f-4f17-874c-3261cacddc26 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:22.743347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:22.777685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ecfb-9dab-4232-85ba-9572cd84ac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:22.778696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ecfb-9dab-4232-85ba-9572cd84ac25 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:22.778987 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ecfb-9dab-4232-85ba-9572cd84ac25 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:22.779262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ecfb-9dab-4232-85ba-9572cd84ac25 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:22.781271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4ecfb-9dab-4232-85ba-9572cd84ac25 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:22.782787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4ecfb-9dab-4232-85ba-9572cd84ac25 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:22.784699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 41/90] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:22 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:22.785348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ecfb-9dab-4232-85ba-9572cd84ac25 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:22.814913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 50/91] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:22.815787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8366f-814b-4cfe-b12a-ac9dc4c4530d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:22.898311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:22.905066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ecfb-9dab-4232-85ba-9572cd84ac25 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:22.924490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8366f-814b-4cfe-b12a-ac9dc4c4530d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:22.944556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c3086-7bb7-4fe5-aca1-ffe5f385df31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:22.945658 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c3086-7bb7-4fe5-aca1-ffe5f385df31 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:22.946088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c3086-7bb7-4fe5-aca1-ffe5f385df31 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:22.946567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c3086-7bb7-4fe5-aca1-ffe5f385df31 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:22.948477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c3086-7bb7-4fe5-aca1-ffe5f385df31 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:22.950634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c3086-7bb7-4fe5-aca1-ffe5f385df31 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:22.953504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 42/92] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:22 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:22.954715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c3086-7bb7-4fe5-aca1-ffe5f385df31 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:22.969156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01566b-7156-4539-98da-1b6b84ed6e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:22.970469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01566b-7156-4539-98da-1b6b84ed6e6d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:22.970900 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01566b-7156-4539-98da-1b6b84ed6e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:22.971317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01566b-7156-4539-98da-1b6b84ed6e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:22.972952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01566b-7156-4539-98da-1b6b84ed6e6d None admin] RBAC: Adding query filter params (role.id=d27765da961f442fa1ab376c59342273, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386, user.id=a347ea4ea5a0424b8b080b3702d8ee75) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:22.973442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01566b-7156-4539-98da-1b6b84ed6e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:22.975182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01566b-7156-4539-98da-1b6b84ed6e6d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:22.984270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 51/93] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:22 2022] GET /identity/v3/role_assignments?user.id=a347ea4ea5a0424b8b080b3702d8ee75&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=d27765da961f442fa1ab376c59342273 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:22.985343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01566b-7156-4539-98da-1b6b84ed6e6d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:23.010931 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:23.146828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01566b-7156-4539-98da-1b6b84ed6e6d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:23.187415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012fee2-d548-4ba5-b81f-8f45dfcf64e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:23.188329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c3086-7bb7-4fe5-aca1-ffe5f385df31 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:23.188665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fee2-d548-4ba5-b81f-8f45dfcf64e1 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:23.189175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fee2-d548-4ba5-b81f-8f45dfcf64e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:23.189587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fee2-d548-4ba5-b81f-8f45dfcf64e1 None admin] PATH_INFO: `/v3/projects/0eee53ec0d75424d949f315d4138a4da` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:23.191201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012fee2-d548-4ba5-b81f-8f45dfcf64e1 None admin] RBAC: Authorizing `identity:get_project(project_id=0eee53ec0d75424d949f315d4138a4da)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:23.192810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012fee2-d548-4ba5-b81f-8f45dfcf64e1 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:23.199735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 52/94] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:22 2022] GET /identity/v3/projects/0eee53ec0d75424d949f315d4138a4da => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:23.200789 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012fee2-d548-4ba5-b81f-8f45dfcf64e1 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:23.261688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049df020-4001-4270-9e1d-4a7412158b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:23.262447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049df020-4001-4270-9e1d-4a7412158b6e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:23.262735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049df020-4001-4270-9e1d-4a7412158b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:23.263012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049df020-4001-4270-9e1d-4a7412158b6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:23.264113 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049df020-4001-4270-9e1d-4a7412158b6e None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386, user.id=d3b20259d4d74838a9e50d6db7cf7a75) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:23.264432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049df020-4001-4270-9e1d-4a7412158b6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:23.265935 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049df020-4001-4270-9e1d-4a7412158b6e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:23.279398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 43/95] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:22 2022] GET /identity/v3/role_assignments?user.id=d3b20259d4d74838a9e50d6db7cf7a75&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:23.280238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049df020-4001-4270-9e1d-4a7412158b6e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:23.283290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:23.315270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012fee2-d548-4ba5-b81f-8f45dfcf64e1 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:23.351957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:23.380984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd76145-55bd-4465-befd-6761309eee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:23.381668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd76145-55bd-4465-befd-6761309eee54 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:23.381956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd76145-55bd-4465-befd-6761309eee54 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:23.382251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd76145-55bd-4465-befd-6761309eee54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:23.383697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd76145-55bd-4465-befd-6761309eee54 None admin] RBAC: Adding query filter params (role.id=5c89d9dc8b0949b98573064d572f981a, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386, user.id=a347ea4ea5a0424b8b080b3702d8ee75) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:23.385101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd76145-55bd-4465-befd-6761309eee54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:23.386633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd76145-55bd-4465-befd-6761309eee54 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:23.407522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 53/96] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:23 2022] GET /identity/v3/role_assignments?user.id=a347ea4ea5a0424b8b080b3702d8ee75&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=5c89d9dc8b0949b98573064d572f981a => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:23.491081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049df020-4001-4270-9e1d-4a7412158b6e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:23.544446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e09d52-78f9-44ca-978c-6d9d93eb719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:23.545212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e09d52-78f9-44ca-978c-6d9d93eb719f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:23.545499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e09d52-78f9-44ca-978c-6d9d93eb719f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:23.545780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e09d52-78f9-44ca-978c-6d9d93eb719f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:23.546686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e09d52-78f9-44ca-978c-6d9d93eb719f None admin] RBAC: Adding query filter params (role.id=5c89d9dc8b0949b98573064d572f981a, scope.project.id=0eee53ec0d75424d949f315d4138a4da, user.id=a347ea4ea5a0424b8b080b3702d8ee75) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:23.547001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e09d52-78f9-44ca-978c-6d9d93eb719f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:23.548545 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e09d52-78f9-44ca-978c-6d9d93eb719f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:23.555660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 44/97] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:23 2022] GET /identity/v3/role_assignments?user.id=a347ea4ea5a0424b8b080b3702d8ee75&scope.project.id=0eee53ec0d75424d949f315d4138a4da&role.id=5c89d9dc8b0949b98573064d572f981a => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:25.583456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cee1-5ab9-45c4-be21-6044ee764f99 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:25.583931 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cee1-5ab9-45c4-be21-6044ee764f99 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:25.583931 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cee1-5ab9-45c4-be21-6044ee764f99 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:25.585534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 54/98] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:25.590874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea70e44-fc2d-4e26-b9eb-fd07db675710 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:25.591267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea70e44-fc2d-4e26-b9eb-fd07db675710 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:25.591441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea70e44-fc2d-4e26-b9eb-fd07db675710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:25.611722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-dea70e44-fc2d-4e26-b9eb-fd07db675710 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:25.613757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-dea70e44-fc2d-4e26-b9eb-fd07db675710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:25.701532 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 45/99] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:25.739469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866cee1-5ab9-45c4-be21-6044ee764f99 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:25.888899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866cee1-5ab9-45c4-be21-6044ee764f99 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:25.936430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc26d6-1654-4190-a746-9b82d091d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:25.937462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc26d6-1654-4190-a746-9b82d091d5ad None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:25.937883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc26d6-1654-4190-a746-9b82d091d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:25.942367 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc26d6-1654-4190-a746-9b82d091d5ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:25.951067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:25.955027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc26d6-1654-4190-a746-9b82d091d5ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-d5dc26d6-1654-4190-a746-9b82d091d5ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:25.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:25.970722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:25.971651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 55/100] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:25.975441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32971df-cf70-4664-b173-5c393be39ea7 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:25.975802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32971df-cf70-4664-b173-5c393be39ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:25.976084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32971df-cf70-4664-b173-5c393be39ea7 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:25.977526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 46/101] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:25.979762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc26d6-1654-4190-a746-9b82d091d5ad None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:25.982849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a7edd-e477-451e-afda-ad028c9d9084 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:25.983383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a7edd-e477-451e-afda-ad028c9d9084 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:25.983877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a7edd-e477-451e-afda-ad028c9d9084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:26.014702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ca3a7edd-e477-451e-afda-ad028c9d9084 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:26.016262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ca3a7edd-e477-451e-afda-ad028c9d9084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:26.060559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:26.139161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc26d6-1654-4190-a746-9b82d091d5ad None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:26.203034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db705310-7345-4fb8-9d53-d7f7b1675ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:26.203741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db705310-7345-4fb8-9d53-d7f7b1675ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:26.204033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db705310-7345-4fb8-9d53-d7f7b1675ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:26.204321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db705310-7345-4fb8-9d53-d7f7b1675ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:26.205106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db705310-7345-4fb8-9d53-d7f7b1675ed0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:26.205425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db705310-7345-4fb8-9d53-d7f7b1675ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:26.207464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db705310-7345-4fb8-9d53-d7f7b1675ed0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:26.211464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 47/102] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:27:26.221525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 56/103] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:26.227301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a7edd-e477-451e-afda-ad028c9d9084 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:26.254262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db705310-7345-4fb8-9d53-d7f7b1675ed0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:26.368400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a7edd-e477-451e-afda-ad028c9d9084 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:26.368764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:26.432613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db705310-7345-4fb8-9d53-d7f7b1675ed0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:26.436210 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791c3a2-bfa6-4b07-9caa-111ea7ac0f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:26.437332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c3a2-bfa6-4b07-9caa-111ea7ac0f63 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:26.437822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c3a2-bfa6-4b07-9caa-111ea7ac0f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:26.438343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c3a2-bfa6-4b07-9caa-111ea7ac0f63 None admin] PATH_INFO: `/v3/users/adcfc56e46c646c1a32b34e29ac90cfa` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:26.466409 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791c3a2-bfa6-4b07-9caa-111ea7ac0f63 None admin] RBAC: Authorizing `identity:get_user(user_id=adcfc56e46c646c1a32b34e29ac90cfa)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:26.468960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791c3a2-bfa6-4b07-9caa-111ea7ac0f63 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:26.473732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 48/104] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:26 2022] GET /identity/v3/users/adcfc56e46c646c1a32b34e29ac90cfa => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:26.476257 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9090cf2-de48-4b73-a768-a994ce54c7f1 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:26.476936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9090cf2-de48-4b73-a768-a994ce54c7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:26.478810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9090cf2-de48-4b73-a768-a994ce54c7f1 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:26.481044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 49/105] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:26.482686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9090cf2-de48-4b73-a768-a994ce54c7f1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:26.504181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1e2bc-2472-49ef-a2e4-511c9f929e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:26.505378 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1e2bc-2472-49ef-a2e4-511c9f929e54 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:26.505666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1e2bc-2472-49ef-a2e4-511c9f929e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:26.505940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1e2bc-2472-49ef-a2e4-511c9f929e54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:26.507364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1e2bc-2472-49ef-a2e4-511c9f929e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:26.514614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:26.514851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1e2bc-2472-49ef-a2e4-511c9f929e54 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:26.516851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 57/106] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:26.520384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300e862-4cfe-4cf6-9a69-337f8043db6c None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:26.520904 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300e862-4cfe-4cf6-9a69-337f8043db6c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:26.521413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300e862-4cfe-4cf6-9a69-337f8043db6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:26.544567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-6300e862-4cfe-4cf6-9a69-337f8043db6c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:26.546132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6300e862-4cfe-4cf6-9a69-337f8043db6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:26.612424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9090cf2-de48-4b73-a768-a994ce54c7f1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:26.644339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 58/107] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:26.645827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300e862-4cfe-4cf6-9a69-337f8043db6c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:26.655112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a1856-c276-4d66-bec6-a2ad9a8b2cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:26.655825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a1856-c276-4d66-bec6-a2ad9a8b2cee None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:26.656164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a1856-c276-4d66-bec6-a2ad9a8b2cee None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:26.656445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a1856-c276-4d66-bec6-a2ad9a8b2cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:26.714476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:26.731632 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a1856-c276-4d66-bec6-a2ad9a8b2cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:26.733099 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a1856-c276-4d66-bec6-a2ad9a8b2cee None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:26.746672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:26.762323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300e862-4cfe-4cf6-9a69-337f8043db6c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:26.798939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8a69d-607d-47bc-9240-4711f56b3f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:26.799611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8a69d-607d-47bc-9240-4711f56b3f9d None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:26.799897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8a69d-607d-47bc-9240-4711f56b3f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:26.800177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8a69d-607d-47bc-9240-4711f56b3f9d None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:26.801437 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8a69d-607d-47bc-9240-4711f56b3f9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:26.802913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8a69d-607d-47bc-9240-4711f56b3f9d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:26.839314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 50/108] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:26.840644 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7c017-60f2-4233-817d-57f7cd6bd320 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:26.840939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7c017-60f2-4233-817d-57f7cd6bd320 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:26.841221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7c017-60f2-4233-817d-57f7cd6bd320 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:26.844405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 51/109] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:26.844405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc123-bbd3-435d-acd1-58e9a3b129d5 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:26.844405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc123-bbd3-435d-acd1-58e9a3b129d5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:26.844405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc123-bbd3-435d-acd1-58e9a3b129d5 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:26.845333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 52/110] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:26.846571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cc123-bbd3-435d-acd1-58e9a3b129d5 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:26.892841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 59/111] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:27:26 2022] POST /identity/v3/projects => generated 302 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:26.893500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8a69d-607d-47bc-9240-4711f56b3f9d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:26.976662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cc123-bbd3-435d-acd1-58e9a3b129d5 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:26.990956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:27.019290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054d576-bb17-4abb-9582-a0b1ea3d787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:27.020222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054d576-bb17-4abb-9582-a0b1ea3d787c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.020510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054d576-bb17-4abb-9582-a0b1ea3d787c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.020824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054d576-bb17-4abb-9582-a0b1ea3d787c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.037643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054d576-bb17-4abb-9582-a0b1ea3d787c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:27.042310 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8a69d-607d-47bc-9240-4711f56b3f9d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-f054d576-bb17-4abb-9582-a0b1ea3d787c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:27.046761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:27.047667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:27.048432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 53/112] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:27:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:27.055430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52ce3f-3377-4832-b077-4f4fe9b4e1b7 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.055815 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52ce3f-3377-4832-b077-4f4fe9b4e1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.056102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52ce3f-3377-4832-b077-4f4fe9b4e1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.060165 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:27.079729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5a52ce3f-3377-4832-b077-4f4fe9b4e1b7 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:27.081434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5a52ce3f-3377-4832-b077-4f4fe9b4e1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:27.089904 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901100f-227b-4eb0-9a4e-8a5317efdb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:27.092125 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901100f-227b-4eb0-9a4e-8a5317efdb94 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.092415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901100f-227b-4eb0-9a4e-8a5317efdb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.092697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901100f-227b-4eb0-9a4e-8a5317efdb94 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.094483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901100f-227b-4eb0-9a4e-8a5317efdb94 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:27.096371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901100f-227b-4eb0-9a4e-8a5317efdb94 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:27.099556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 60/113] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:26 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:27.101173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eebd26-e067-47bc-a825-6f9d92893256 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.101492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eebd26-e067-47bc-a825-6f9d92893256 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.101761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eebd26-e067-47bc-a825-6f9d92893256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.121216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-75eebd26-e067-47bc-a825-6f9d92893256 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:27.122496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-75eebd26-e067-47bc-a825-6f9d92893256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:27.167248 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 54/114] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:27.168429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52ce3f-3377-4832-b077-4f4fe9b4e1b7 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:27.211249 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 61/115] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:27.212724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d541a79-a14a-4d14-983b-460e782df375 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.213017 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d541a79-a14a-4d14-983b-460e782df375 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.213292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d541a79-a14a-4d14-983b-460e782df375 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.214582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 62/116] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:27.215277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d541a79-a14a-4d14-983b-460e782df375 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:27.288270 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:27.291166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52ce3f-3377-4832-b077-4f4fe9b4e1b7 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:27.326411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d03de-29ce-41f5-b847-dd99a96b6cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:27.327092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d03de-29ce-41f5-b847-dd99a96b6cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.327382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d03de-29ce-41f5-b847-dd99a96b6cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.327813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d03de-29ce-41f5-b847-dd99a96b6cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.328421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d03de-29ce-41f5-b847-dd99a96b6cd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:27.328731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d03de-29ce-41f5-b847-dd99a96b6cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:27.330116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d03de-29ce-41f5-b847-dd99a96b6cd3 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:27.335204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d541a79-a14a-4d14-983b-460e782df375 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:27.339228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 55/117] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:27:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:27.340073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d03de-29ce-41f5-b847-dd99a96b6cd3 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:27.351035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:27.376095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398277f3-b69e-4264-9096-df028c2b6314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:27.376755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398277f3-b69e-4264-9096-df028c2b6314 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.377042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398277f3-b69e-4264-9096-df028c2b6314 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.377323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398277f3-b69e-4264-9096-df028c2b6314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.378163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398277f3-b69e-4264-9096-df028c2b6314 None admin] RBAC: Adding query filter params (role.id=24b48a19f5e94098b75009d75bdc90d9, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386, user.id=adcfc56e46c646c1a32b34e29ac90cfa) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:27.378529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398277f3-b69e-4264-9096-df028c2b6314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:27.380085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398277f3-b69e-4264-9096-df028c2b6314 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:27.386309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 63/118] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:27 2022] GET /identity/v3/role_assignments?user.id=adcfc56e46c646c1a32b34e29ac90cfa&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=24b48a19f5e94098b75009d75bdc90d9 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:27.387661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c121cf-605b-46d3-b5dc-27d3ac032961 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.387956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c121cf-605b-46d3-b5dc-27d3ac032961 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.388236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c121cf-605b-46d3-b5dc-27d3ac032961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.406568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-11c121cf-605b-46d3-b5dc-27d3ac032961 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:27.409306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-11c121cf-605b-46d3-b5dc-27d3ac032961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:27.475327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d03de-29ce-41f5-b847-dd99a96b6cd3 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:27.510708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 64/119] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:27.512037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c121cf-605b-46d3-b5dc-27d3ac032961 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:27.529173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf117-b061-4c1c-a80d-f4d83625e55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:27.530007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf117-b061-4c1c-a80d-f4d83625e55a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.530335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf117-b061-4c1c-a80d-f4d83625e55a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.530621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf117-b061-4c1c-a80d-f4d83625e55a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.550383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaf117-b061-4c1c-a80d-f4d83625e55a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-d3aaf117-b061-4c1c-a80d-f4d83625e55a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:27.555331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:27.556272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:27.557576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:27.559825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 56/120] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:27.560904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf117-b061-4c1c-a80d-f4d83625e55a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:27.598149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:27.637766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c121cf-605b-46d3-b5dc-27d3ac032961 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:27.650625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:27.677716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c393f07-8b9b-4142-9520-7269adc11385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:27.678563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c393f07-8b9b-4142-9520-7269adc11385 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.678846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c393f07-8b9b-4142-9520-7269adc11385 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.679177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c393f07-8b9b-4142-9520-7269adc11385 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.693851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c393f07-8b9b-4142-9520-7269adc11385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:27.698011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf117-b061-4c1c-a80d-f4d83625e55a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-4c393f07-8b9b-4142-9520-7269adc11385 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:27.701668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:27.702616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:27.703365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 65/121] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:27.703993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c393f07-8b9b-4142-9520-7269adc11385 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:27.747191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca395-253d-4f2d-a416-184f73a73b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:27.749092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca395-253d-4f2d-a416-184f73a73b5f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.749611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca395-253d-4f2d-a416-184f73a73b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.750309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca395-253d-4f2d-a416-184f73a73b5f None admin] PATH_INFO: `/v3/users/a347ea4ea5a0424b8b080b3702d8ee75` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.752467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ca395-253d-4f2d-a416-184f73a73b5f None admin] RBAC: Authorizing `identity:get_user(user_id=a347ea4ea5a0424b8b080b3702d8ee75)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:27.755902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ca395-253d-4f2d-a416-184f73a73b5f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:27.757805 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 57/122] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:27 2022] GET /identity/v3/users/a347ea4ea5a0424b8b080b3702d8ee75 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:27.758927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca395-253d-4f2d-a416-184f73a73b5f None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:27.840372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c393f07-8b9b-4142-9520-7269adc11385 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:27.880189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:27.884699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81dbe6-a96c-412f-af6a-b8a0177ff510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:27.885662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81dbe6-a96c-412f-af6a-b8a0177ff510 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.886045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81dbe6-a96c-412f-af6a-b8a0177ff510 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.886354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81dbe6-a96c-412f-af6a-b8a0177ff510 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.891473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca395-253d-4f2d-a416-184f73a73b5f None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:27.899352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81dbe6-a96c-412f-af6a-b8a0177ff510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-be81dbe6-a96c-412f-af6a-b8a0177ff510 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:27.909494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:27.910490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:27.911268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:27.916032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 66/123] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:27.917210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81dbe6-a96c-412f-af6a-b8a0177ff510 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:27.938842 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aef90-b3ae-4664-b0d5-2b46a3ea4a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:27.939844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aef90-b3ae-4664-b0d5-2b46a3ea4a82 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:27.941481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aef90-b3ae-4664-b0d5-2b46a3ea4a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:27.941968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aef90-b3ae-4664-b0d5-2b46a3ea4a82 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:27.943252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aef90-b3ae-4664-b0d5-2b46a3ea4a82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:27.944106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:27.944431 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aef90-b3ae-4664-b0d5-2b46a3ea4a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:27.947466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aef90-b3ae-4664-b0d5-2b46a3ea4a82 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:27.958759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 58/124] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:27.964844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aef90-b3ae-4664-b0d5-2b46a3ea4a82 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:28.029798 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81dbe6-a96c-412f-af6a-b8a0177ff510 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:28.065223 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5078342-a04d-4d19-aa7c-8a8aca3d93b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:28.066599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5078342-a04d-4d19-aa7c-8a8aca3d93b6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:28.066885 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5078342-a04d-4d19-aa7c-8a8aca3d93b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:28.067160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5078342-a04d-4d19-aa7c-8a8aca3d93b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:28.067934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5078342-a04d-4d19-aa7c-8a8aca3d93b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:28.068245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5078342-a04d-4d19-aa7c-8a8aca3d93b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:28.069852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5078342-a04d-4d19-aa7c-8a8aca3d93b6 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:28.084721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 67/125] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:28.084721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5078342-a04d-4d19-aa7c-8a8aca3d93b6 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:28.105327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aef90-b3ae-4664-b0d5-2b46a3ea4a82 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:28.152347 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f296da-cfc0-4428-8424-f456c0fb970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:28.153672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f296da-cfc0-4428-8424-f456c0fb970d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:28.154080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f296da-cfc0-4428-8424-f456c0fb970d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:28.154493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f296da-cfc0-4428-8424-f456c0fb970d None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:28.155987 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f296da-cfc0-4428-8424-f456c0fb970d None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:28.157631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f296da-cfc0-4428-8424-f456c0fb970d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:28.159995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 59/126] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:27 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:28.160747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f296da-cfc0-4428-8424-f456c0fb970d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:28.176976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:28.187022 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:28.199819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5078342-a04d-4d19-aa7c-8a8aca3d93b6 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:28.235298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a9f99-60b2-474b-ad0d-45ccf8110db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:28.236301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a9f99-60b2-474b-ad0d-45ccf8110db6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:28.236767 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a9f99-60b2-474b-ad0d-45ccf8110db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:28.237237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a9f99-60b2-474b-ad0d-45ccf8110db6 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:28.238736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a9f99-60b2-474b-ad0d-45ccf8110db6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:28.239238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a9f99-60b2-474b-ad0d-45ccf8110db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:28.240793 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a9f99-60b2-474b-ad0d-45ccf8110db6 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:28.251119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 68/127] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:28.252349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a9f99-60b2-474b-ad0d-45ccf8110db6 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:28.275102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f296da-cfc0-4428-8424-f456c0fb970d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:28.312295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ab3eb-a7a1-487b-b5a4-8de3cd3ce4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:28.313606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ab3eb-a7a1-487b-b5a4-8de3cd3ce4ff None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:28.313948 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ab3eb-a7a1-487b-b5a4-8de3cd3ce4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:28.314499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ab3eb-a7a1-487b-b5a4-8de3cd3ce4ff None admin] PATH_INFO: `/v3/users/d3b20259d4d74838a9e50d6db7cf7a75` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:28.315594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ab3eb-a7a1-487b-b5a4-8de3cd3ce4ff None admin] RBAC: Authorizing `identity:get_user(user_id=d3b20259d4d74838a9e50d6db7cf7a75)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:28.317119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ab3eb-a7a1-487b-b5a4-8de3cd3ce4ff None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:28.319014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 60/128] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:28 2022] GET /identity/v3/users/d3b20259d4d74838a9e50d6db7cf7a75 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:28.319706 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ab3eb-a7a1-487b-b5a4-8de3cd3ce4ff None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:28.361736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a9f99-60b2-474b-ad0d-45ccf8110db6 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:28.397580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a6ea-97dd-40bc-8c04-d3b2d5d58ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:28.398806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a6ea-97dd-40bc-8c04-d3b2d5d58ebe None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:28.399404 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a6ea-97dd-40bc-8c04-d3b2d5d58ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:28.399910 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a6ea-97dd-40bc-8c04-d3b2d5d58ebe None admin] PATH_INFO: `/v3/users/a347ea4ea5a0424b8b080b3702d8ee75` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:28.401367 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9a6ea-97dd-40bc-8c04-d3b2d5d58ebe None admin] RBAC: Authorizing `identity:get_user(user_id=a347ea4ea5a0424b8b080b3702d8ee75)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:28.403038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9a6ea-97dd-40bc-8c04-d3b2d5d58ebe None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:28.404872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 69/129] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:28 2022] GET /identity/v3/users/a347ea4ea5a0424b8b080b3702d8ee75 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:28.405919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a6ea-97dd-40bc-8c04-d3b2d5d58ebe None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:28.422841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:28.424816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:28.437622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ab3eb-a7a1-487b-b5a4-8de3cd3ce4ff None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:28.473985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6d345-68dc-4dbb-a3f2-f6be408e3123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:28.475176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6d345-68dc-4dbb-a3f2-f6be408e3123 None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:28.475466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6d345-68dc-4dbb-a3f2-f6be408e3123 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:28.475748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6d345-68dc-4dbb-a3f2-f6be408e3123 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/users/a347ea4ea5a0424b8b080b3702d8ee75/roles/d27765da961f442fa1ab376c59342273` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:28.478954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6d345-68dc-4dbb-a3f2-f6be408e3123 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f0c0c19dbc94fbbb1e7b582193cb386, user_id=a347ea4ea5a0424b8b080b3702d8ee75, role_id=d27765da961f442fa1ab376c59342273)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:28.481537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6d345-68dc-4dbb-a3f2-f6be408e3123 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:28.511986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a6ea-97dd-40bc-8c04-d3b2d5d58ebe None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:28.549400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 61/130] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:27:28 2022] PUT /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/users/a347ea4ea5a0424b8b080b3702d8ee75/roles/d27765da961f442fa1ab376c59342273 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:28.551257 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6d345-68dc-4dbb-a3f2-f6be408e3123 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:28.551699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d44b76-7db2-4187-b87f-96e0958c6d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:28.552599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d44b76-7db2-4187-b87f-96e0958c6d2e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:28.552890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d44b76-7db2-4187-b87f-96e0958c6d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:28.553222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d44b76-7db2-4187-b87f-96e0958c6d2e None admin] PATH_INFO: `/v3/users/a347ea4ea5a0424b8b080b3702d8ee75` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:28.554622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d44b76-7db2-4187-b87f-96e0958c6d2e None admin] RBAC: Authorizing `identity:get_user(user_id=a347ea4ea5a0424b8b080b3702d8ee75)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:28.556235 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d44b76-7db2-4187-b87f-96e0958c6d2e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:28.558311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 70/131] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:28 2022] GET /identity/v3/users/a347ea4ea5a0424b8b080b3702d8ee75 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:28.559193 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d44b76-7db2-4187-b87f-96e0958c6d2e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:28.691227 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6d345-68dc-4dbb-a3f2-f6be408e3123 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:28.737400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8781641-dd11-4a49-af2a-c9c406d21489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:28.739932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781641-dd11-4a49-af2a-c9c406d21489 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:28.740443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781641-dd11-4a49-af2a-c9c406d21489 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:28.740934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781641-dd11-4a49-af2a-c9c406d21489 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:28.742552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8781641-dd11-4a49-af2a-c9c406d21489 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:28.743584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:28.746390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8781641-dd11-4a49-af2a-c9c406d21489 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:28.748585 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 62/132] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:28 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:28.749569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8781641-dd11-4a49-af2a-c9c406d21489 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:28.776921 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:28.780256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d44b76-7db2-4187-b87f-96e0958c6d2e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:28.820638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449945dd-2e08-47bb-908e-58d17fea8bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:28.821646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449945dd-2e08-47bb-908e-58d17fea8bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:28.821776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449945dd-2e08-47bb-908e-58d17fea8bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:28.822055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449945dd-2e08-47bb-908e-58d17fea8bc7 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:28.823334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449945dd-2e08-47bb-908e-58d17fea8bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:28.825057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449945dd-2e08-47bb-908e-58d17fea8bc7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:28.826943 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 71/133] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:28 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:28.827761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449945dd-2e08-47bb-908e-58d17fea8bc7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:28.896472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8781641-dd11-4a49-af2a-c9c406d21489 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:28.953885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8500ca-12c3-484c-8213-e11ece84bce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:28.955747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8500ca-12c3-484c-8213-e11ece84bce3 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:28.957772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8500ca-12c3-484c-8213-e11ece84bce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:28.958301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8500ca-12c3-484c-8213-e11ece84bce3 None admin] PATH_INFO: `/v3/projects/0eee53ec0d75424d949f315d4138a4da` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:28.961076 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8500ca-12c3-484c-8213-e11ece84bce3 None admin] RBAC: Authorizing `identity:get_project(project_id=0eee53ec0d75424d949f315d4138a4da)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:28.966485 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8500ca-12c3-484c-8213-e11ece84bce3 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:28.968715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 63/134] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:28 2022] GET /identity/v3/projects/0eee53ec0d75424d949f315d4138a4da => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:28.972732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8500ca-12c3-484c-8213-e11ece84bce3 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:28.999841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449945dd-2e08-47bb-908e-58d17fea8bc7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:29.072533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a307ec-436c-4787-bb44-c1a1e86ec950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:29.073770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a307ec-436c-4787-bb44-c1a1e86ec950 None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:29.074231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a307ec-436c-4787-bb44-c1a1e86ec950 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:29.074953 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a307ec-436c-4787-bb44-c1a1e86ec950 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/users/d3b20259d4d74838a9e50d6db7cf7a75/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:29.078414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a307ec-436c-4787-bb44-c1a1e86ec950 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f0c0c19dbc94fbbb1e7b582193cb386, user_id=d3b20259d4d74838a9e50d6db7cf7a75, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:29.080059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a307ec-436c-4787-bb44-c1a1e86ec950 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:29.125995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:29.147550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8500ca-12c3-484c-8213-e11ece84bce3 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:29.167153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 72/135] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:27:28 2022] PUT /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/users/d3b20259d4d74838a9e50d6db7cf7a75/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:29.168239 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a307ec-436c-4787-bb44-c1a1e86ec950 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:29.192117 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:29.229773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc781b-101f-4845-b521-55de18f9260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:29.230978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc781b-101f-4845-b521-55de18f9260b None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:29.231402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc781b-101f-4845-b521-55de18f9260b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:29.231823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc781b-101f-4845-b521-55de18f9260b None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/users/a347ea4ea5a0424b8b080b3702d8ee75/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:29.234175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc781b-101f-4845-b521-55de18f9260b None admin] RBAC: Authorizing `identity:create_grant(project_id=9f0c0c19dbc94fbbb1e7b582193cb386, user_id=a347ea4ea5a0424b8b080b3702d8ee75, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:29.235914 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc781b-101f-4845-b521-55de18f9260b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:29.318659 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 64/136] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:27:28 2022] PUT /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/users/a347ea4ea5a0424b8b080b3702d8ee75/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:29.332502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a307ec-436c-4787-bb44-c1a1e86ec950 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:29.371818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70878939-1e31-4b90-9dac-728d7daf6767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:29.372732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70878939-1e31-4b90-9dac-728d7daf6767 None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:29.373027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70878939-1e31-4b90-9dac-728d7daf6767 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:29.373302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70878939-1e31-4b90-9dac-728d7daf6767 None admin] PATH_INFO: `/v3/projects/0eee53ec0d75424d949f315d4138a4da/users/a347ea4ea5a0424b8b080b3702d8ee75/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:29.375584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70878939-1e31-4b90-9dac-728d7daf6767 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eee53ec0d75424d949f315d4138a4da, user_id=a347ea4ea5a0424b8b080b3702d8ee75, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:29.377098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70878939-1e31-4b90-9dac-728d7daf6767 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:29.398763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300acde-7d66-4347-9c76-1c6df1593bbb None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:29.399421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300acde-7d66-4347-9c76-1c6df1593bbb None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:29.399915 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300acde-7d66-4347-9c76-1c6df1593bbb None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:29.401615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 65/137] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:29.407744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ea35-6879-4f8b-8ef8-22d70e5f78cf None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:29.408387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ea35-6879-4f8b-8ef8-22d70e5f78cf None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:29.408925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ea35-6879-4f8b-8ef8-22d70e5f78cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:29.435545 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ab40ea35-6879-4f8b-8ef8-22d70e5f78cf None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:29.436799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ab40ea35-6879-4f8b-8ef8-22d70e5f78cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:29.454552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 73/138] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:27:29 2022] PUT /identity/v3/projects/0eee53ec0d75424d949f315d4138a4da/users/a347ea4ea5a0424b8b080b3702d8ee75/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:29.532614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 66/139] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:29.579218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70878939-1e31-4b90-9dac-728d7daf6767 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:29.681538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:29.718782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70878939-1e31-4b90-9dac-728d7daf6767 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:29.757607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1d738-e0a8-4c41-a40d-6f3f86de742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:29.759352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1d738-e0a8-4c41-a40d-6f3f86de742a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:29.759806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1d738-e0a8-4c41-a40d-6f3f86de742a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:29.760240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1d738-e0a8-4c41-a40d-6f3f86de742a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:29.761795 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1d738-e0a8-4c41-a40d-6f3f86de742a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:29.763481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1d738-e0a8-4c41-a40d-6f3f86de742a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:29.765402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 74/140] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:29.773885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40ea35-6879-4f8b-8ef8-22d70e5f78cf None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:29.859458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:29.889393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40ea35-6879-4f8b-8ef8-22d70e5f78cf None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:29.931225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269a853-ed0d-483f-91b5-00a37d6aaf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:29.932140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a853-ed0d-483f-91b5-00a37d6aaf5d None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:29.932598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a853-ed0d-483f-91b5-00a37d6aaf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:29.933019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a853-ed0d-483f-91b5-00a37d6aaf5d None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:29.933881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269a853-ed0d-483f-91b5-00a37d6aaf5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:29.935508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269a853-ed0d-483f-91b5-00a37d6aaf5d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:30.070413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 67/141] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:27:29 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:30.228024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf21a71-37fd-47f7-bdbf-e651113e235e None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:30.228543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf21a71-37fd-47f7-bdbf-e651113e235e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:30.228989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf21a71-37fd-47f7-bdbf-e651113e235e None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:30.230545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 75/142] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:30.236100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee5701-7fcd-453c-a60b-d9d3c676a91e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:30.236588 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee5701-7fcd-453c-a60b-d9d3c676a91e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:30.237011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee5701-7fcd-453c-a60b-d9d3c676a91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:30.260500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-7dee5701-7fcd-453c-a60b-d9d3c676a91e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:30.261928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7dee5701-7fcd-453c-a60b-d9d3c676a91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:30.358696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 68/143] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:30.381358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf21a71-37fd-47f7-bdbf-e651113e235e None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:30.500383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf21a71-37fd-47f7-bdbf-e651113e235e None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:30.541506 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f18204-2175-43ed-bcab-f40348602a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:30.542324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f18204-2175-43ed-bcab-f40348602a15 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:30.542670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f18204-2175-43ed-bcab-f40348602a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:30.542946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f18204-2175-43ed-bcab-f40348602a15 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:30.551001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:30.555786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f18204-2175-43ed-bcab-f40348602a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-72f18204-2175-43ed-bcab-f40348602a15 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:30.563552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:30.564398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:30.565140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 76/144] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:30.570797 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee5701-7fcd-453c-a60b-d9d3c676a91e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:30.642988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:30.687559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee5701-7fcd-453c-a60b-d9d3c676a91e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:30.725920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563d384-cd88-4ae1-8c7a-72e7223b24b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:30.726624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563d384-cd88-4ae1-8c7a-72e7223b24b9 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:30.726905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563d384-cd88-4ae1-8c7a-72e7223b24b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:30.727180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563d384-cd88-4ae1-8c7a-72e7223b24b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:30.727936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563d384-cd88-4ae1-8c7a-72e7223b24b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:30.728248 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563d384-cd88-4ae1-8c7a-72e7223b24b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:30.729614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563d384-cd88-4ae1-8c7a-72e7223b24b9 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:30.738936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 69/145] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:30.744570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f18204-2175-43ed-bcab-f40348602a15 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:30.848191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f18204-2175-43ed-bcab-f40348602a15 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:30.883908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43552f-411e-48f0-9b11-aafd7525cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:30.884777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43552f-411e-48f0-9b11-aafd7525cec2 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:30.885056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43552f-411e-48f0-9b11-aafd7525cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:30.885325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43552f-411e-48f0-9b11-aafd7525cec2 None admin] PATH_INFO: `/v3/users/adcfc56e46c646c1a32b34e29ac90cfa` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:30.886549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43552f-411e-48f0-9b11-aafd7525cec2 None admin] RBAC: Authorizing `identity:get_user(user_id=adcfc56e46c646c1a32b34e29ac90cfa)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:30.887999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43552f-411e-48f0-9b11-aafd7525cec2 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:30.889621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 77/146] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:30 2022] GET /identity/v3/users/adcfc56e46c646c1a32b34e29ac90cfa => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:30.895571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563d384-cd88-4ae1-8c7a-72e7223b24b9 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:31.010889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563d384-cd88-4ae1-8c7a-72e7223b24b9 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:31.037255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:31.050017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a16f63-7b7c-437b-91ab-f95ace7ac6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:31.059412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a16f63-7b7c-437b-91ab-f95ace7ac6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:31.059412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a16f63-7b7c-437b-91ab-f95ace7ac6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:31.059412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a16f63-7b7c-437b-91ab-f95ace7ac6c5 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:31.059412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a16f63-7b7c-437b-91ab-f95ace7ac6c5 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:31.059412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a16f63-7b7c-437b-91ab-f95ace7ac6c5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:31.059412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 70/147] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:30 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:31.062033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43552f-411e-48f0-9b11-aafd7525cec2 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:31.136421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:31.175371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43552f-411e-48f0-9b11-aafd7525cec2 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:31.216266 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebc5eb-435a-4a2d-81ef-259a4d421ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:31.217215 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebc5eb-435a-4a2d-81ef-259a4d421ea4 None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:31.217493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebc5eb-435a-4a2d-81ef-259a4d421ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:31.217760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebc5eb-435a-4a2d-81ef-259a4d421ea4 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/users/adcfc56e46c646c1a32b34e29ac90cfa/roles/24b48a19f5e94098b75009d75bdc90d9` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:31.219865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebc5eb-435a-4a2d-81ef-259a4d421ea4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f0c0c19dbc94fbbb1e7b582193cb386, user_id=adcfc56e46c646c1a32b34e29ac90cfa, role_id=24b48a19f5e94098b75009d75bdc90d9)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:31.221320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebc5eb-435a-4a2d-81ef-259a4d421ea4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:31.291596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 78/148] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:27:31 2022] PUT /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/users/adcfc56e46c646c1a32b34e29ac90cfa/roles/24b48a19f5e94098b75009d75bdc90d9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:31.727152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae976fc-ddd3-46cd-b5b0-5a774b090248 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:31.727541 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae976fc-ddd3-46cd-b5b0-5a774b090248 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:31.727701 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae976fc-ddd3-46cd-b5b0-5a774b090248 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:31.729368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 71/149] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:31.735785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423afb-5568-47bf-8556-bebabd8b96df None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:31.736081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423afb-5568-47bf-8556-bebabd8b96df None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:31.736364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423afb-5568-47bf-8556-bebabd8b96df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:31.759269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0f423afb-5568-47bf-8556-bebabd8b96df None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:31.760622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0f423afb-5568-47bf-8556-bebabd8b96df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:31.844989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 79/150] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:31.885292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae976fc-ddd3-46cd-b5b0-5a774b090248 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:32.015598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae976fc-ddd3-46cd-b5b0-5a774b090248 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:32.061978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeaddd-b27f-4a68-8e1a-0f7b2b5c70d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:32.062833 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeaddd-b27f-4a68-8e1a-0f7b2b5c70d5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:32.063132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeaddd-b27f-4a68-8e1a-0f7b2b5c70d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:32.063417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeaddd-b27f-4a68-8e1a-0f7b2b5c70d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:32.079773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeaddd-b27f-4a68-8e1a-0f7b2b5c70d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-bcbeaddd-b27f-4a68-8e1a-0f7b2b5c70d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:32.088028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:32.089979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:32.091865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 72/151] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:27:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:32.095526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f423afb-5568-47bf-8556-bebabd8b96df None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:32.168982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:32.227108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f423afb-5568-47bf-8556-bebabd8b96df None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:32.266932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a92c1-9a28-4ccd-bd75-1f45dae67bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:32.267535 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a92c1-9a28-4ccd-bd75-1f45dae67bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:32.267819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a92c1-9a28-4ccd-bd75-1f45dae67bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:32.268098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a92c1-9a28-4ccd-bd75-1f45dae67bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:32.268902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a92c1-9a28-4ccd-bd75-1f45dae67bb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:32.269216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a92c1-9a28-4ccd-bd75-1f45dae67bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:32.270622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a92c1-9a28-4ccd-bd75-1f45dae67bb6 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:32.279924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 80/152] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:27:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:32.285932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeaddd-b27f-4a68-8e1a-0f7b2b5c70d5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:32.344519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:32.400092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeaddd-b27f-4a68-8e1a-0f7b2b5c70d5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:32.442071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74291e-fe2f-48b7-805f-5a2f4cf20e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:32.442998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74291e-fe2f-48b7-805f-5a2f4cf20e00 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:32.443285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74291e-fe2f-48b7-805f-5a2f4cf20e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:32.443563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74291e-fe2f-48b7-805f-5a2f4cf20e00 None admin] PATH_INFO: `/v3/users/a347ea4ea5a0424b8b080b3702d8ee75` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:32.444860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74291e-fe2f-48b7-805f-5a2f4cf20e00 None admin] RBAC: Authorizing `identity:get_user(user_id=a347ea4ea5a0424b8b080b3702d8ee75)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:32.446378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74291e-fe2f-48b7-805f-5a2f4cf20e00 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:32.448070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 73/153] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:32 2022] GET /identity/v3/users/a347ea4ea5a0424b8b080b3702d8ee75 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:32.453993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a92c1-9a28-4ccd-bd75-1f45dae67bb6 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:32.606983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a92c1-9a28-4ccd-bd75-1f45dae67bb6 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:32.630843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:32.650090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b376392-dc68-4a4c-8264-99b2e9546d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:32.650786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b376392-dc68-4a4c-8264-99b2e9546d49 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:32.651072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b376392-dc68-4a4c-8264-99b2e9546d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:32.651351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b376392-dc68-4a4c-8264-99b2e9546d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:32.734159 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b376392-dc68-4a4c-8264-99b2e9546d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:32.735657 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b376392-dc68-4a4c-8264-99b2e9546d49 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:32.856426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 81/154] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:32.862022 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74291e-fe2f-48b7-805f-5a2f4cf20e00 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:32.919044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152b8e8-4988-4e7f-967e-c739c12938d6 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:32.919341 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152b8e8-4988-4e7f-967e-c739c12938d6 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:32.919604 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152b8e8-4988-4e7f-967e-c739c12938d6 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:32.921001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 82/155] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:32.925895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5199261-dcc8-494e-b43f-4b1711c58d0f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:32.926177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5199261-dcc8-494e-b43f-4b1711c58d0f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:32.926506 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5199261-dcc8-494e-b43f-4b1711c58d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:32.963251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-d5199261-dcc8-494e-b43f-4b1711c58d0f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:32.964452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d5199261-dcc8-494e-b43f-4b1711c58d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:32.996235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74291e-fe2f-48b7-805f-5a2f4cf20e00 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:32.997089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:33.018028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:33.044466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d4880-f28d-488e-8bad-d777c3e417b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:33.047497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d4880-f28d-488e-8bad-d777c3e417b7 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:33.047497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d4880-f28d-488e-8bad-d777c3e417b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:33.047497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d4880-f28d-488e-8bad-d777c3e417b7 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:33.047710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d4880-f28d-488e-8bad-d777c3e417b7 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:33.049034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d4880-f28d-488e-8bad-d777c3e417b7 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:33.051013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 74/156] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:32 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:33.058132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d4880-f28d-488e-8bad-d777c3e417b7 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:33.125956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 83/157] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:27:33.166144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5199261-dcc8-494e-b43f-4b1711c58d0f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:33.263175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d4880-f28d-488e-8bad-d777c3e417b7 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:33.341770 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbf7bf-1af4-4ea1-9d9b-0aad1833810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:33.342468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbf7bf-1af4-4ea1-9d9b-0aad1833810b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:33.342760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbf7bf-1af4-4ea1-9d9b-0aad1833810b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:33.343039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbf7bf-1af4-4ea1-9d9b-0aad1833810b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:33.343889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbf7bf-1af4-4ea1-9d9b-0aad1833810b None admin] RBAC: Adding query filter params (role.id=d27765da961f442fa1ab376c59342273, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386, user.id=a347ea4ea5a0424b8b080b3702d8ee75) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:33.344201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbf7bf-1af4-4ea1-9d9b-0aad1833810b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:33.345887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbf7bf-1af4-4ea1-9d9b-0aad1833810b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:33.353876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 75/158] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:33 2022] GET /identity/v3/role_assignments?user.id=a347ea4ea5a0424b8b080b3702d8ee75&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=d27765da961f442fa1ab376c59342273 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:33.376608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be5013-3afa-4dec-805b-00ec8136a4c4 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:33.376896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be5013-3afa-4dec-805b-00ec8136a4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:33.377100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be5013-3afa-4dec-805b-00ec8136a4c4 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:33.378561 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 76/159] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:33.384683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082cb46-721d-4381-bc80-07302f25822f None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:33.384984 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082cb46-721d-4381-bc80-07302f25822f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:33.385260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082cb46-721d-4381-bc80-07302f25822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:33.416560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9082cb46-721d-4381-bc80-07302f25822f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:33.417778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9082cb46-721d-4381-bc80-07302f25822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:33.436490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5199261-dcc8-494e-b43f-4b1711c58d0f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:33.495115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20136c9-91c8-45f8-8442-e2676068e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:33.496042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20136c9-91c8-45f8-8442-e2676068e774 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:33.504032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20136c9-91c8-45f8-8442-e2676068e774 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:33.504032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20136c9-91c8-45f8-8442-e2676068e774 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:33.504201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:33.509230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20136c9-91c8-45f8-8442-e2676068e774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-d20136c9-91c8-45f8-8442-e2676068e774 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:33.517408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:33.518349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:33.519838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 84/160] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:27:33.526823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20136c9-91c8-45f8-8442-e2676068e774 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:33.536754 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 77/161] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:27:33.538771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:33.607862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082cb46-721d-4381-bc80-07302f25822f None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:33.638138 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20136c9-91c8-45f8-8442-e2676068e774 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:33.674575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e6f8b-7909-4a39-861c-d4faa27e1686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:33.675337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e6f8b-7909-4a39-861c-d4faa27e1686 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:33.675623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e6f8b-7909-4a39-861c-d4faa27e1686 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:33.675895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e6f8b-7909-4a39-861c-d4faa27e1686 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:33.676652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e6f8b-7909-4a39-861c-d4faa27e1686 None admin] RBAC: Adding query filter params (name=member) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:33.676955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e6f8b-7909-4a39-861c-d4faa27e1686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:33.678364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e6f8b-7909-4a39-861c-d4faa27e1686 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:33.687653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 85/162] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:33.688989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ed2a0-3bac-4126-922c-b8b7f9256ae1 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:33.689274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ed2a0-3bac-4126-922c-b8b7f9256ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:33.689596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ed2a0-3bac-4126-922c-b8b7f9256ae1 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:33.695320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 86/163] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:33.697176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ed2a0-3bac-4126-922c-b8b7f9256ae1 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:33.757604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082cb46-721d-4381-bc80-07302f25822f None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:33.780445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:33.797351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747047f-5e9f-4c89-8d76-b8ccd47bfe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:33.798656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747047f-5e9f-4c89-8d76-b8ccd47bfe60 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:33.799146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747047f-5e9f-4c89-8d76-b8ccd47bfe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:33.799621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747047f-5e9f-4c89-8d76-b8ccd47bfe60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:33.811896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747047f-5e9f-4c89-8d76-b8ccd47bfe60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:33.819741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ed2a0-3bac-4126-922c-b8b7f9256ae1 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-a747047f-5e9f-4c89-8d76-b8ccd47bfe60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:33.822475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:33.823322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:33.824083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:33.827254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 78/164] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:33.829055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075eae-ea6c-4cbd-8304-ddda7086e5fa None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:33.829576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075eae-ea6c-4cbd-8304-ddda7086e5fa None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:33.830153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075eae-ea6c-4cbd-8304-ddda7086e5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:33.859311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-49075eae-ea6c-4cbd-8304-ddda7086e5fa None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:33.859498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486da5f-7bc7-4faa-916b-9e9973179608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:33.860311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486da5f-7bc7-4faa-916b-9e9973179608 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:33.860954 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486da5f-7bc7-4faa-916b-9e9973179608 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:33.861257 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-49075eae-ea6c-4cbd-8304-ddda7086e5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:33.861539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486da5f-7bc7-4faa-916b-9e9973179608 None admin] PATH_INFO: `/v3/users/a347ea4ea5a0424b8b080b3702d8ee75` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:33.863123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486da5f-7bc7-4faa-916b-9e9973179608 None admin] RBAC: Authorizing `identity:get_user(user_id=a347ea4ea5a0424b8b080b3702d8ee75)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:33.865932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486da5f-7bc7-4faa-916b-9e9973179608 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:33.867920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 87/165] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:33 2022] GET /identity/v3/users/a347ea4ea5a0424b8b080b3702d8ee75 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:33.868895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486da5f-7bc7-4faa-916b-9e9973179608 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:33.920662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:33.978291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 79/166] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:33.979597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49075eae-ea6c-4cbd-8304-ddda7086e5fa None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:33.985931 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486da5f-7bc7-4faa-916b-9e9973179608 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:34.026440 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b6103-0a53-48f1-a69f-386330062778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:34.027923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b6103-0a53-48f1-a69f-386330062778 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:34.028396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b6103-0a53-48f1-a69f-386330062778 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:34.028948 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b6103-0a53-48f1-a69f-386330062778 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:34.030109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b6103-0a53-48f1-a69f-386330062778 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:34.030587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b6103-0a53-48f1-a69f-386330062778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:34.032354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b6103-0a53-48f1-a69f-386330062778 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:34.039894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:34.044925 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 88/167] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:34.046743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b6103-0a53-48f1-a69f-386330062778 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:34.159796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b6103-0a53-48f1-a69f-386330062778 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:34.181682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49075eae-ea6c-4cbd-8304-ddda7086e5fa None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:34.198891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a78f-9b9c-4595-8537-d1545e359be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:34.200201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a78f-9b9c-4595-8537-d1545e359be9 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:34.201033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a78f-9b9c-4595-8537-d1545e359be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:34.201450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a78f-9b9c-4595-8537-d1545e359be9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:34.213727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a78f-9b9c-4595-8537-d1545e359be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-52b0a78f-9b9c-4595-8537-d1545e359be9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:34.222628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:34.223675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:34.224610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:34.226607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 89/168] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:34.227855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a78f-9b9c-4595-8537-d1545e359be9 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:34.260792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b92e9-b71a-482c-b192-cd930dd66470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:34.261475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b92e9-b71a-482c-b192-cd930dd66470 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:34.261752 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b92e9-b71a-482c-b192-cd930dd66470 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:34.262049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b92e9-b71a-482c-b192-cd930dd66470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:34.295617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:34.338792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:34.344570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a78f-9b9c-4595-8537-d1545e359be9 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:34.383177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9c742-d972-4f0d-ae28-fbd728ce6463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:34.384490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c742-d972-4f0d-ae28-fbd728ce6463 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:34.384950 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c742-d972-4f0d-ae28-fbd728ce6463 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:34.385391 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c742-d972-4f0d-ae28-fbd728ce6463 None admin] PATH_INFO: `/v3/users/d3b20259d4d74838a9e50d6db7cf7a75` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:34.387230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9c742-d972-4f0d-ae28-fbd728ce6463 None admin] RBAC: Authorizing `identity:get_user(user_id=d3b20259d4d74838a9e50d6db7cf7a75)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:34.389000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9c742-d972-4f0d-ae28-fbd728ce6463 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:34.390941 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 90/169] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:34 2022] GET /identity/v3/users/d3b20259d4d74838a9e50d6db7cf7a75 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:34.392058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9c742-d972-4f0d-ae28-fbd728ce6463 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:34.411300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b92e9-b71a-482c-b192-cd930dd66470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:34.412781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b92e9-b71a-482c-b192-cd930dd66470 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:34.501327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9c742-d972-4f0d-ae28-fbd728ce6463 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:34.537550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:34.542184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd56a94-da7f-489b-8cba-9df74c469f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:34.543232 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd56a94-da7f-489b-8cba-9df74c469f04 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:34.544066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd56a94-da7f-489b-8cba-9df74c469f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:34.544066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd56a94-da7f-489b-8cba-9df74c469f04 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:34.545051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd56a94-da7f-489b-8cba-9df74c469f04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:34.545622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd56a94-da7f-489b-8cba-9df74c469f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:34.547311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd56a94-da7f-489b-8cba-9df74c469f04 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:34.564433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 91/170] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:34.565598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd56a94-da7f-489b-8cba-9df74c469f04 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:34.680671 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd56a94-da7f-489b-8cba-9df74c469f04 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:34.718681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 80/171] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:34.719207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7328a-96fe-4ed4-a91c-d11eccd2be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:34.719530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b92e9-b71a-482c-b192-cd930dd66470 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:34.720271 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7328a-96fe-4ed4-a91c-d11eccd2be3f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:34.720718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7328a-96fe-4ed4-a91c-d11eccd2be3f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:34.721163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7328a-96fe-4ed4-a91c-d11eccd2be3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:34.790836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:34.798166 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7328a-96fe-4ed4-a91c-d11eccd2be3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:34.800193 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7328a-96fe-4ed4-a91c-d11eccd2be3f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:34.913777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 92/172] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:34.914993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7328a-96fe-4ed4-a91c-d11eccd2be3f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:34.929763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:35.026904 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:35.035201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7328a-96fe-4ed4-a91c-d11eccd2be3f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:35.049738 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b92e9-b71a-482c-b192-cd930dd66470 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:35.108379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8581a-c2f1-4679-a70e-0b6c1880c01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:35.110479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8581a-c2f1-4679-a70e-0b6c1880c01e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.112602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8581a-c2f1-4679-a70e-0b6c1880c01e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.113292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8581a-c2f1-4679-a70e-0b6c1880c01e None admin] PATH_INFO: `/v3/projects/0eee53ec0d75424d949f315d4138a4da` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.117156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8581a-c2f1-4679-a70e-0b6c1880c01e None admin] RBAC: Authorizing `identity:get_project(project_id=0eee53ec0d75424d949f315d4138a4da)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:35.119806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8581a-c2f1-4679-a70e-0b6c1880c01e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:35.124182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 93/173] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:34 2022] GET /identity/v3/projects/0eee53ec0d75424d949f315d4138a4da => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:35.125513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bf24e-ae2e-4686-8fc2-0afebb478b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:35.126570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8581a-c2f1-4679-a70e-0b6c1880c01e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:35.127613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bf24e-ae2e-4686-8fc2-0afebb478b60 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.128961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bf24e-ae2e-4686-8fc2-0afebb478b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.129392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bf24e-ae2e-4686-8fc2-0afebb478b60 None admin] PATH_INFO: `/v3/users/a347ea4ea5a0424b8b080b3702d8ee75` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.133532 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bf24e-ae2e-4686-8fc2-0afebb478b60 None admin] RBAC: Authorizing `identity:get_user(user_id=a347ea4ea5a0424b8b080b3702d8ee75)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:35.136376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bf24e-ae2e-4686-8fc2-0afebb478b60 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:35.138595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 81/174] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:34 2022] GET /identity/v3/users/a347ea4ea5a0424b8b080b3702d8ee75 => generated 275 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:35.139631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bf24e-ae2e-4686-8fc2-0afebb478b60 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:35.310772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bf24e-ae2e-4686-8fc2-0afebb478b60 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:35.318126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8581a-c2f1-4679-a70e-0b6c1880c01e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:35.348704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976b4bb-6123-4ea6-8754-bf7e6e969da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:35.349369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976b4bb-6123-4ea6-8754-bf7e6e969da5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.349668 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976b4bb-6123-4ea6-8754-bf7e6e969da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.349929 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976b4bb-6123-4ea6-8754-bf7e6e969da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.350927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976b4bb-6123-4ea6-8754-bf7e6e969da5 None admin] RBAC: Adding query filter params (role.id=5c89d9dc8b0949b98573064d572f981a, scope.project.id=0eee53ec0d75424d949f315d4138a4da, user.id=a347ea4ea5a0424b8b080b3702d8ee75) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:35.351246 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976b4bb-6123-4ea6-8754-bf7e6e969da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:35.352837 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976b4bb-6123-4ea6-8754-bf7e6e969da5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:35.359629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 82/175] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:35 2022] GET /identity/v3/role_assignments?user.id=a347ea4ea5a0424b8b080b3702d8ee75&scope.project.id=0eee53ec0d75424d949f315d4138a4da&role.id=5c89d9dc8b0949b98573064d572f981a => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:35.360428 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976b4bb-6123-4ea6-8754-bf7e6e969da5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:35.363316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:35.366549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7ff33-9f4f-4993-b07b-83b7db6ae70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:35.367802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7ff33-9f4f-4993-b07b-83b7db6ae70b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.368281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7ff33-9f4f-4993-b07b-83b7db6ae70b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.368798 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7ff33-9f4f-4993-b07b-83b7db6ae70b None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.371000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7ff33-9f4f-4993-b07b-83b7db6ae70b None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:35.379119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7ff33-9f4f-4993-b07b-83b7db6ae70b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:35.379119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 94/176] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:35 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:35.379119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b8286-adef-43da-80c1-c27054b99656 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.379119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b8286-adef-43da-80c1-c27054b99656 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.379119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b8286-adef-43da-80c1-c27054b99656 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.380176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 95/177] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:35.383216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b8286-adef-43da-80c1-c27054b99656 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:35.416759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:35.498285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976b4bb-6123-4ea6-8754-bf7e6e969da5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:35.535621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf0f66-6cd4-4268-a77b-29a58b9f8bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:35.536442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf0f66-6cd4-4268-a77b-29a58b9f8bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.536729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf0f66-6cd4-4268-a77b-29a58b9f8bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.537001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf0f66-6cd4-4268-a77b-29a58b9f8bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.579154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b8286-adef-43da-80c1-c27054b99656 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:35.630783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf0f66-6cd4-4268-a77b-29a58b9f8bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:35.632807 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf0f66-6cd4-4268-a77b-29a58b9f8bb3 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:35.634963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:35.674161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c5a3c-7d7f-4c43-a135-891e5c1db78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:35.675564 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5a3c-7d7f-4c43-a135-891e5c1db78d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.676640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5a3c-7d7f-4c43-a135-891e5c1db78d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.676927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5a3c-7d7f-4c43-a135-891e5c1db78d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.677779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c5a3c-7d7f-4c43-a135-891e5c1db78d None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386, user.id=d3b20259d4d74838a9e50d6db7cf7a75) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:35.678090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c5a3c-7d7f-4c43-a135-891e5c1db78d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:35.679624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c5a3c-7d7f-4c43-a135-891e5c1db78d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:35.687484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 96/178] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:35 2022] GET /identity/v3/role_assignments?user.id=d3b20259d4d74838a9e50d6db7cf7a75&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:35.690111 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c933-e98f-4371-b2f6-dabe4e6d580a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.690419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c933-e98f-4371-b2f6-dabe4e6d580a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.691373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c933-e98f-4371-b2f6-dabe4e6d580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.714177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-8246c933-e98f-4371-b2f6-dabe4e6d580a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:35.715669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8246c933-e98f-4371-b2f6-dabe4e6d580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:35.752907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 83/179] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:35.754860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c355a-bdf5-4bd4-b277-bdbaaa6f5d95 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.755145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c355a-bdf5-4bd4-b277-bdbaaa6f5d95 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.755420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c355a-bdf5-4bd4-b277-bdbaaa6f5d95 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.756705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 84/180] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:35.761630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c355a-bdf5-4bd4-b277-bdbaaa6f5d95 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:35.804494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 97/181] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:35.805649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e67e62-2b2c-4b19-9177-7e7beed6f970 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.805934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e67e62-2b2c-4b19-9177-7e7beed6f970 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.806206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e67e62-2b2c-4b19-9177-7e7beed6f970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.824181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-24e67e62-2b2c-4b19-9177-7e7beed6f970 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:35.826024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-24e67e62-2b2c-4b19-9177-7e7beed6f970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:35.842592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:35.904374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 98/182] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:35.906129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716acdb-899b-4377-80ce-8bb922d4e82f None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.906629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716acdb-899b-4377-80ce-8bb922d4e82f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.907064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716acdb-899b-4377-80ce-8bb922d4e82f None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.908616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 99/183] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:35.910062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716acdb-899b-4377-80ce-8bb922d4e82f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:35.913287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c355a-bdf5-4bd4-b277-bdbaaa6f5d95 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:35.915933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:35.965224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b7863-b6ee-4462-8ca1-9ee2fa96f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:35.966621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b7863-b6ee-4462-8ca1-9ee2fa96f81a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.967048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b7863-b6ee-4462-8ca1-9ee2fa96f81a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.967514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b7863-b6ee-4462-8ca1-9ee2fa96f81a None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:35.969976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b7863-b6ee-4462-8ca1-9ee2fa96f81a None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:35.971682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b7863-b6ee-4462-8ca1-9ee2fa96f81a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:35.974124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 85/184] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:35 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:35.980540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152911d-b897-4b3c-ad03-3074a6a55f96 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:35.980951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152911d-b897-4b3c-ad03-3074a6a55f96 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:35.981237 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152911d-b897-4b3c-ad03-3074a6a55f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.003032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-f152911d-b897-4b3c-ad03-3074a6a55f96 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:36.004269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f152911d-b897-4b3c-ad03-3074a6a55f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:36.032810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716acdb-899b-4377-80ce-8bb922d4e82f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:36.078054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e6799-e88f-4444-8dda-19e3145e2ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:36.078893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e6799-e88f-4444-8dda-19e3145e2ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.079170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e6799-e88f-4444-8dda-19e3145e2ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.079607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e6799-e88f-4444-8dda-19e3145e2ae4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.085582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 86/185] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:36.091045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152911d-b897-4b3c-ad03-3074a6a55f96 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:36.091567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e6799-e88f-4444-8dda-19e3145e2ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-280e6799-e88f-4444-8dda-19e3145e2ae4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:36.100346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:36.101205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:36.101983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 100/186] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:27:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:36.104155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e6799-e88f-4444-8dda-19e3145e2ae4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:36.125313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:36.213066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:36.215909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152911d-b897-4b3c-ad03-3074a6a55f96 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:36.219828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e6799-e88f-4444-8dda-19e3145e2ae4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:36.249447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293a9f9-73f7-45ef-a5d7-9bf88e3d725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:36.250260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293a9f9-73f7-45ef-a5d7-9bf88e3d725b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.250550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293a9f9-73f7-45ef-a5d7-9bf88e3d725b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.250822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293a9f9-73f7-45ef-a5d7-9bf88e3d725b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.256683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2d2e-fe5e-4704-93af-35f4a2e86b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:36.257333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2d2e-fe5e-4704-93af-35f4a2e86b80 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.257612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2d2e-fe5e-4704-93af-35f4a2e86b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.257886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2d2e-fe5e-4704-93af-35f4a2e86b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.259202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2d2e-fe5e-4704-93af-35f4a2e86b80 None admin] RBAC: Adding query filter params (role.id=5c89d9dc8b0949b98573064d572f981a, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386, user.id=a347ea4ea5a0424b8b080b3702d8ee75) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:36.259520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2d2e-fe5e-4704-93af-35f4a2e86b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:36.260947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2d2e-fe5e-4704-93af-35f4a2e86b80 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:36.261660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293a9f9-73f7-45ef-a5d7-9bf88e3d725b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:36.267052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 101/187] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:36 2022] GET /identity/v3/role_assignments?user.id=a347ea4ea5a0424b8b080b3702d8ee75&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=5c89d9dc8b0949b98573064d572f981a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-c293a9f9-73f7-45ef-a5d7-9bf88e3d725b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:36.270028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:36.271058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:36.271827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 87/188] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:36.279372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2d2e-fe5e-4704-93af-35f4a2e86b80 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:36.279550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293a9f9-73f7-45ef-a5d7-9bf88e3d725b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:36.382136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:36.395029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293a9f9-73f7-45ef-a5d7-9bf88e3d725b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:36.408869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2d2e-fe5e-4704-93af-35f4a2e86b80 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:36.435961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb46745-98ee-4b6f-b311-b5f0944465bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:36.436887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb46745-98ee-4b6f-b311-b5f0944465bd None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.437090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb46745-98ee-4b6f-b311-b5f0944465bd None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.437363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb46745-98ee-4b6f-b311-b5f0944465bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.449902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37565e7-fa93-49b5-ad84-f41be61eb72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:36.450158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb46745-98ee-4b6f-b311-b5f0944465bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:36.450611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37565e7-fa93-49b5-ad84-f41be61eb72b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.450896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37565e7-fa93-49b5-ad84-f41be61eb72b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.451170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37565e7-fa93-49b5-ad84-f41be61eb72b None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.451929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37565e7-fa93-49b5-ad84-f41be61eb72b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:36.452234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37565e7-fa93-49b5-ad84-f41be61eb72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:36.453620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37565e7-fa93-49b5-ad84-f41be61eb72b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-ddb46745-98ee-4b6f-b311-b5f0944465bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:36.458497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:36.459382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:36.460183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 88/189] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:27:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:36.460838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb46745-98ee-4b6f-b311-b5f0944465bd None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:36.467841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 102/190] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:27:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:36.469151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd611f1f-3067-4b63-a090-0fd3cc975118 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.469446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd611f1f-3067-4b63-a090-0fd3cc975118 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.469728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd611f1f-3067-4b63-a090-0fd3cc975118 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.476366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 103/191] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:36.476366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd611f1f-3067-4b63-a090-0fd3cc975118 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:36.492193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:36.578405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb46745-98ee-4b6f-b311-b5f0944465bd None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:36.588891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd611f1f-3067-4b63-a090-0fd3cc975118 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:36.610598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559669c-73a3-4960-a782-019877cdf8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:36.611258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559669c-73a3-4960-a782-019877cdf8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.611538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559669c-73a3-4960-a782-019877cdf8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.611818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559669c-73a3-4960-a782-019877cdf8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.612608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559669c-73a3-4960-a782-019877cdf8a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:36.612910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559669c-73a3-4960-a782-019877cdf8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:36.614290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559669c-73a3-4960-a782-019877cdf8a8 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:36.621030 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061e5b9-0b18-4e22-8fd7-e41d847b8562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:36.621686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e5b9-0b18-4e22-8fd7-e41d847b8562 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.621965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e5b9-0b18-4e22-8fd7-e41d847b8562 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.622057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 89/192] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:36.627030 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e5b9-0b18-4e22-8fd7-e41d847b8562 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.627168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559669c-73a3-4960-a782-019877cdf8a8 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:36.627256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061e5b9-0b18-4e22-8fd7-e41d847b8562 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:36.627256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061e5b9-0b18-4e22-8fd7-e41d847b8562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:36.627256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061e5b9-0b18-4e22-8fd7-e41d847b8562 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:36.627256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:36.636830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 104/193] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:36.636830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b9f4-6c0f-48f2-8967-655150a45195 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.636830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b9f4-6c0f-48f2-8967-655150a45195 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.637077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b9f4-6c0f-48f2-8967-655150a45195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.652868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-7216b9f4-6c0f-48f2-8967-655150a45195 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:36.654319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-7216b9f4-6c0f-48f2-8967-655150a45195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:36.707871 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:36.720425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 105/194] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:36.721395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216b9f4-6c0f-48f2-8967-655150a45195 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:36.732035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559669c-73a3-4960-a782-019877cdf8a8 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:36.766873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec95536-3a20-4a7a-baa1-24faa8df7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:36.767748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95536-3a20-4a7a-baa1-24faa8df7e82 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.768025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95536-3a20-4a7a-baa1-24faa8df7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.768295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95536-3a20-4a7a-baa1-24faa8df7e82 None admin] PATH_INFO: `/v3/users/2d7072fd7329430a80bc79398d9f0bae` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.782394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec95536-3a20-4a7a-baa1-24faa8df7e82 None admin] RBAC: Authorizing `identity:get_user(user_id=2d7072fd7329430a80bc79398d9f0bae)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:36.783851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec95536-3a20-4a7a-baa1-24faa8df7e82 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:36.785525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 90/195] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:36 2022] GET /identity/v3/users/2d7072fd7329430a80bc79398d9f0bae => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:36.786313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec95536-3a20-4a7a-baa1-24faa8df7e82 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:36.823313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216b9f4-6c0f-48f2-8967-655150a45195 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:36.849427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:36.856964 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34bf9-65cd-4b3a-a613-dfb94d30a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:36.859919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34bf9-65cd-4b3a-a613-dfb94d30a3ff None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.859919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34bf9-65cd-4b3a-a613-dfb94d30a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.859919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34bf9-65cd-4b3a-a613-dfb94d30a3ff None admin] PATH_INFO: `/v3/users/adcfc56e46c646c1a32b34e29ac90cfa` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.859919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b34bf9-65cd-4b3a-a613-dfb94d30a3ff None admin] RBAC: Authorizing `identity:get_user(user_id=adcfc56e46c646c1a32b34e29ac90cfa)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:36.861188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b34bf9-65cd-4b3a-a613-dfb94d30a3ff None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:36.863030 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 106/196] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:36 2022] GET /identity/v3/users/adcfc56e46c646c1a32b34e29ac90cfa => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:36.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34bf9-65cd-4b3a-a613-dfb94d30a3ff None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:36.887998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec95536-3a20-4a7a-baa1-24faa8df7e82 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:36.920998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042d1d0-1ea2-4767-aab6-03f2fa12fd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:36.921861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042d1d0-1ea2-4767-aab6-03f2fa12fd77 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.922140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042d1d0-1ea2-4767-aab6-03f2fa12fd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.922446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042d1d0-1ea2-4767-aab6-03f2fa12fd77 None admin] PATH_INFO: `/v3/users/2d7072fd7329430a80bc79398d9f0bae` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.923630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042d1d0-1ea2-4767-aab6-03f2fa12fd77 None admin] RBAC: Authorizing `identity:get_user(user_id=2d7072fd7329430a80bc79398d9f0bae)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:36.925550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042d1d0-1ea2-4767-aab6-03f2fa12fd77 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:36.927210 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 91/197] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:36 2022] GET /identity/v3/users/2d7072fd7329430a80bc79398d9f0bae => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:36.928045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042d1d0-1ea2-4767-aab6-03f2fa12fd77 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:36.938034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:36.964260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34bf9-65cd-4b3a-a613-dfb94d30a3ff None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:36.996710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c85fa-702a-4a0d-9776-8a0eb1bb8ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:36.997499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c85fa-702a-4a0d-9776-8a0eb1bb8ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:36.997781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c85fa-702a-4a0d-9776-8a0eb1bb8ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:36.998053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c85fa-702a-4a0d-9776-8a0eb1bb8ee6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:36.999247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c85fa-702a-4a0d-9776-8a0eb1bb8ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:37.000677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c85fa-702a-4a0d-9776-8a0eb1bb8ee6 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:37.002303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 107/198] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:37.003597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c85fa-702a-4a0d-9776-8a0eb1bb8ee6 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:37.026368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042d1d0-1ea2-4767-aab6-03f2fa12fd77 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:37.060255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056f27a-b6a1-4ce7-93d0-6be9ea116671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:37.060898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f27a-b6a1-4ce7-93d0-6be9ea116671 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:37.061183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f27a-b6a1-4ce7-93d0-6be9ea116671 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:37.061454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f27a-b6a1-4ce7-93d0-6be9ea116671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:37.066362 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:37.103149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c85fa-702a-4a0d-9776-8a0eb1bb8ee6 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:37.127119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056f27a-b6a1-4ce7-93d0-6be9ea116671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:37.129349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056f27a-b6a1-4ce7-93d0-6be9ea116671 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:37.137145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0816b1-0bc8-464b-af46-3c30a1af767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:37.137802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0816b1-0bc8-464b-af46-3c30a1af767f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:37.138136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0816b1-0bc8-464b-af46-3c30a1af767f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:37.138472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0816b1-0bc8-464b-af46-3c30a1af767f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:37.141389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:37.205485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0816b1-0bc8-464b-af46-3c30a1af767f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:37.207013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0816b1-0bc8-464b-af46-3c30a1af767f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:37.228462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 92/199] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:37.228462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056f27a-b6a1-4ce7-93d0-6be9ea116671 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:37.269540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:37.308469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 108/200] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:37.309509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0816b1-0bc8-464b-af46-3c30a1af767f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:37.331737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056f27a-b6a1-4ce7-93d0-6be9ea116671 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:37.340961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:37.365925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72c431-c9bc-4e38-b5a2-f07fa55ad75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:37.366831 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72c431-c9bc-4e38-b5a2-f07fa55ad75d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:37.367112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72c431-c9bc-4e38-b5a2-f07fa55ad75d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:37.367385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72c431-c9bc-4e38-b5a2-f07fa55ad75d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:37.406925 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0816b1-0bc8-464b-af46-3c30a1af767f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:37.434687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72c431-c9bc-4e38-b5a2-f07fa55ad75d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:37.436151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72c431-c9bc-4e38-b5a2-f07fa55ad75d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:37.440328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7d9a8-e759-4fba-af52-5f650bb60331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:37.441016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7d9a8-e759-4fba-af52-5f650bb60331 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:37.441297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7d9a8-e759-4fba-af52-5f650bb60331 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:37.441571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7d9a8-e759-4fba-af52-5f650bb60331 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:37.442295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7d9a8-e759-4fba-af52-5f650bb60331 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:37.443705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7d9a8-e759-4fba-af52-5f650bb60331 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:37.532514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 93/201] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:37.533341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72c431-c9bc-4e38-b5a2-f07fa55ad75d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:37.535377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 109/202] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:27:37 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:37.548098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:37.551494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7d9a8-e759-4fba-af52-5f650bb60331 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:37.576933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:37.650466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72c431-c9bc-4e38-b5a2-f07fa55ad75d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:37.665924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7d9a8-e759-4fba-af52-5f650bb60331 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:37.692442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efead452-04d6-4d98-8d91-f0dd8ceae735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:37.693415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead452-04d6-4d98-8d91-f0dd8ceae735 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:37.693692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead452-04d6-4d98-8d91-f0dd8ceae735 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:37.693973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead452-04d6-4d98-8d91-f0dd8ceae735 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:37.695234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efead452-04d6-4d98-8d91-f0dd8ceae735 None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:37.696771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efead452-04d6-4d98-8d91-f0dd8ceae735 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:37.698748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 94/203] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:37 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:37.699381 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efead452-04d6-4d98-8d91-f0dd8ceae735 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:37.707036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc7de2-cd3f-4ce9-a0d9-a83d082d8c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:37.707919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7de2-cd3f-4ce9-a0d9-a83d082d8c37 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:37.708202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7de2-cd3f-4ce9-a0d9-a83d082d8c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:37.708478 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7de2-cd3f-4ce9-a0d9-a83d082d8c37 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:37.709716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc7de2-cd3f-4ce9-a0d9-a83d082d8c37 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:37.711217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc7de2-cd3f-4ce9-a0d9-a83d082d8c37 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:37.712979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 110/204] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:37 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:37.713771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc7de2-cd3f-4ce9-a0d9-a83d082d8c37 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:37.804391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:37.818206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:37.832927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc7de2-cd3f-4ce9-a0d9-a83d082d8c37 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:37.834881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efead452-04d6-4d98-8d91-f0dd8ceae735 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:37.878696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926737c-f0c8-46e9-a5d0-6af7c30cde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:37.880273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926737c-f0c8-46e9-a5d0-6af7c30cde54 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:37.880273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926737c-f0c8-46e9-a5d0-6af7c30cde54 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:37.880273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926737c-f0c8-46e9-a5d0-6af7c30cde54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:37.880870 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926737c-f0c8-46e9-a5d0-6af7c30cde54 None admin] RBAC: Adding query filter params (role.id=d27765da961f442fa1ab376c59342273, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe, user.id=2d7072fd7329430a80bc79398d9f0bae) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:37.881194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926737c-f0c8-46e9-a5d0-6af7c30cde54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:37.882712 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926737c-f0c8-46e9-a5d0-6af7c30cde54 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:37.885039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a06f8-361d-49de-a975-d630c28c07fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:37.885907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a06f8-361d-49de-a975-d630c28c07fe None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:37.886185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a06f8-361d-49de-a975-d630c28c07fe None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:37.886493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a06f8-361d-49de-a975-d630c28c07fe None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:37.887671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a06f8-361d-49de-a975-d630c28c07fe None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:37.888945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 111/205] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:37 2022] GET /identity/v3/role_assignments?user.id=2d7072fd7329430a80bc79398d9f0bae&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=d27765da961f442fa1ab376c59342273 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:37.889117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a06f8-361d-49de-a975-d630c28c07fe None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:37.889908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926737c-f0c8-46e9-a5d0-6af7c30cde54 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:37.891056 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 95/206] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:37 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:37.897337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a06f8-361d-49de-a975-d630c28c07fe None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:38.015834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926737c-f0c8-46e9-a5d0-6af7c30cde54 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:38.031579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a06f8-361d-49de-a975-d630c28c07fe None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:38.054371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d72f7a-5808-4e8f-92b0-7ad3e55ab2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:38.055081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d72f7a-5808-4e8f-92b0-7ad3e55ab2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:38.055387 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d72f7a-5808-4e8f-92b0-7ad3e55ab2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:38.055633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d72f7a-5808-4e8f-92b0-7ad3e55ab2c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:38.056481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d72f7a-5808-4e8f-92b0-7ad3e55ab2c2 None admin] RBAC: Adding query filter params (role.id=24b48a19f5e94098b75009d75bdc90d9, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386, user.id=adcfc56e46c646c1a32b34e29ac90cfa) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:38.056800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d72f7a-5808-4e8f-92b0-7ad3e55ab2c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:38.064932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d72f7a-5808-4e8f-92b0-7ad3e55ab2c2 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:38.065150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 112/207] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:37 2022] GET /identity/v3/role_assignments?user.id=adcfc56e46c646c1a32b34e29ac90cfa&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=24b48a19f5e94098b75009d75bdc90d9 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:38.089898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2af94-81b6-47e6-a87a-887383a631e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:38.090967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2af94-81b6-47e6-a87a-887383a631e5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:38.091500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2af94-81b6-47e6-a87a-887383a631e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:38.091977 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2af94-81b6-47e6-a87a-887383a631e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:38.093067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2af94-81b6-47e6-a87a-887383a631e5 None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe, user.id=2d7072fd7329430a80bc79398d9f0bae) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:38.093583 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2af94-81b6-47e6-a87a-887383a631e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:38.095308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2af94-81b6-47e6-a87a-887383a631e5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:38.102844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 96/208] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:37 2022] GET /identity/v3/role_assignments?user.id=2d7072fd7329430a80bc79398d9f0bae&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:39.953365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3644d7-73d0-4c9c-ac57-5c406f883b6c None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:39.953879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3644d7-73d0-4c9c-ac57-5c406f883b6c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:39.953951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3644d7-73d0-4c9c-ac57-5c406f883b6c None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:39.955604 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 113/209] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:39.961005 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7215d-6c9c-4c46-9aae-c93e41e72563 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:39.961420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7215d-6c9c-4c46-9aae-c93e41e72563 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:39.961590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7215d-6c9c-4c46-9aae-c93e41e72563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:39.978980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-bbc7215d-6c9c-4c46-9aae-c93e41e72563 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:39.980185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-bbc7215d-6c9c-4c46-9aae-c93e41e72563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:39.982285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:40.056617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 97/210] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:40.080557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3644d7-73d0-4c9c-ac57-5c406f883b6c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:40.100276 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:40.128560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ddbae-e6bd-4695-a3ff-b708072c5a8a None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.128860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ddbae-e6bd-4695-a3ff-b708072c5a8a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.129145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ddbae-e6bd-4695-a3ff-b708072c5a8a None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.131542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 98/211] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:40.139131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda160a-1648-44e5-9f24-a34e74b3306f None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.139296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda160a-1648-44e5-9f24-a34e74b3306f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.139690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda160a-1648-44e5-9f24-a34e74b3306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.157710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-dfda160a-1648-44e5-9f24-a34e74b3306f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:40.159430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-dfda160a-1648-44e5-9f24-a34e74b3306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:40.198981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3644d7-73d0-4c9c-ac57-5c406f883b6c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:40.243291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0ff87-2886-4930-8496-00db33858747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:40.244428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0ff87-2886-4930-8496-00db33858747 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.244972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0ff87-2886-4930-8496-00db33858747 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.245486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0ff87-2886-4930-8496-00db33858747 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.250307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 99/212] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:40.263526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0ff87-2886-4930-8496-00db33858747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:40.271691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda160a-1648-44e5-9f24-a34e74b3306f None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-c5e0ff87-2886-4930-8496-00db33858747 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:40.275748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:40.276603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:40.277380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:40.280580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 114/213] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:40.286831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0ff87-2886-4930-8496-00db33858747 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:40.356395 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:40.380706 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:40.397760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda160a-1648-44e5-9f24-a34e74b3306f None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:40.402618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0ff87-2886-4930-8496-00db33858747 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:40.425607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f8d9f-fb6d-47e0-9aae-eb95fbf9b43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:40.426663 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8d9f-fb6d-47e0-9aae-eb95fbf9b43c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.427100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8d9f-fb6d-47e0-9aae-eb95fbf9b43c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.430067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8d9f-fb6d-47e0-9aae-eb95fbf9b43c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.430067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f8d9f-fb6d-47e0-9aae-eb95fbf9b43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:40.430067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f8d9f-fb6d-47e0-9aae-eb95fbf9b43c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:40.431613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 100/214] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:40.433010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2b9ff-46b7-4e5a-ae3d-d16b78c63948 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.433296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2b9ff-46b7-4e5a-ae3d-d16b78c63948 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.433572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2b9ff-46b7-4e5a-ae3d-d16b78c63948 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.434821 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 101/215] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:40.436835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2b9ff-46b7-4e5a-ae3d-d16b78c63948 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:40.445105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2da70-69a9-47c6-ab26-94eb2a511c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:40.446206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2da70-69a9-47c6-ab26-94eb2a511c89 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.446530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2da70-69a9-47c6-ab26-94eb2a511c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.446812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2da70-69a9-47c6-ab26-94eb2a511c89 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.447577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2da70-69a9-47c6-ab26-94eb2a511c89 None admin] RBAC: Adding query filter params (name=member) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:40.448262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2da70-69a9-47c6-ab26-94eb2a511c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:40.450335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2da70-69a9-47c6-ab26-94eb2a511c89 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:40.462833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 115/216] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:40.464350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8233ff-5ddd-4d20-9545-ecdf7a0891f0 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.464640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8233ff-5ddd-4d20-9545-ecdf7a0891f0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.464918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8233ff-5ddd-4d20-9545-ecdf7a0891f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.481627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0b8233ff-5ddd-4d20-9545-ecdf7a0891f0 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:40.482821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0b8233ff-5ddd-4d20-9545-ecdf7a0891f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:40.546465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2b9ff-46b7-4e5a-ae3d-d16b78c63948 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:40.551818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 116/217] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:40.552571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8233ff-5ddd-4d20-9545-ecdf7a0891f0 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:40.585068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641fa7-d13b-4ac4-90de-52641a00925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:40.585746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641fa7-d13b-4ac4-90de-52641a00925b None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.586033 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641fa7-d13b-4ac4-90de-52641a00925b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.586336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641fa7-d13b-4ac4-90de-52641a00925b None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.587051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb641fa7-d13b-4ac4-90de-52641a00925b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:40.588514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb641fa7-d13b-4ac4-90de-52641a00925b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:40.596146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:40.622801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:40.654080 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8233ff-5ddd-4d20-9545-ecdf7a0891f0 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:40.686180 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eac52-dae3-47bf-860a-f5d67c021a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:40.687068 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eac52-dae3-47bf-860a-f5d67c021a5d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.687344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eac52-dae3-47bf-860a-f5d67c021a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.687612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eac52-dae3-47bf-860a-f5d67c021a5d None admin] PATH_INFO: `/v3/users/aa59845ff5d94b178dee9bac1320e03e` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.700278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eac52-dae3-47bf-860a-f5d67c021a5d None admin] RBAC: Authorizing `identity:get_user(user_id=aa59845ff5d94b178dee9bac1320e03e)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:40.701702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eac52-dae3-47bf-860a-f5d67c021a5d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:40.703368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 117/218] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:40 2022] GET /identity/v3/users/aa59845ff5d94b178dee9bac1320e03e => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:40.704517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69271ed-d1d2-467e-932e-cac53c6725dd None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.704797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69271ed-d1d2-467e-932e-cac53c6725dd None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.705106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69271ed-d1d2-467e-932e-cac53c6725dd None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.706940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 118/219] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:40.708106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69271ed-d1d2-467e-932e-cac53c6725dd None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:40.746279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 102/220] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:27:40 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:40.746781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641fa7-d13b-4ac4-90de-52641a00925b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:40.821082 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69271ed-d1d2-467e-932e-cac53c6725dd None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:40.850695 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:40.857295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641fa7-d13b-4ac4-90de-52641a00925b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:40.860718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88216909-87a7-46bd-9ecc-65f0c0804bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:40.862446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216909-87a7-46bd-9ecc-65f0c0804bea None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.862446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216909-87a7-46bd-9ecc-65f0c0804bea None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.862446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216909-87a7-46bd-9ecc-65f0c0804bea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.874158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88216909-87a7-46bd-9ecc-65f0c0804bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-88216909-87a7-46bd-9ecc-65f0c0804bea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:40.882908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:40.883869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 119/221] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:27:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:40.890027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc6d95-f551-460f-ac1a-9d9bdcc49c3e None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.890768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc6d95-f551-460f-ac1a-9d9bdcc49c3e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.890768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc6d95-f551-460f-ac1a-9d9bdcc49c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.906608 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-95fc6d95-f551-460f-ac1a-9d9bdcc49c3e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:40.907142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab1513-718e-45e8-957a-a54b50350af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:40.907811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1513-718e-45e8-957a-a54b50350af4 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:40.907910 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-95fc6d95-f551-460f-ac1a-9d9bdcc49c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:40.908089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1513-718e-45e8-957a-a54b50350af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:40.908368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1513-718e-45e8-957a-a54b50350af4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:40.976081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:40.984758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab1513-718e-45e8-957a-a54b50350af4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:40.986267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab1513-718e-45e8-957a-a54b50350af4 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:40.994209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 120/222] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:40.994209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc6d95-f551-460f-ac1a-9d9bdcc49c3e None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:41.118650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc6d95-f551-460f-ac1a-9d9bdcc49c3e None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:41.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 103/223] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:41.126839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab1513-718e-45e8-957a-a54b50350af4 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:41.141869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:41.165599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15082138-6000-46cc-add5-605d2929dc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:41.166315 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082138-6000-46cc-add5-605d2929dc42 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:41.166602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082138-6000-46cc-add5-605d2929dc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:41.166963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082138-6000-46cc-add5-605d2929dc42 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:41.167723 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15082138-6000-46cc-add5-605d2929dc42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:41.168028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15082138-6000-46cc-add5-605d2929dc42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:41.169409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15082138-6000-46cc-add5-605d2929dc42 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:41.181945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 121/224] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:27:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:41.183022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15082138-6000-46cc-add5-605d2929dc42 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:41.234840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:41.249915 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab1513-718e-45e8-957a-a54b50350af4 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:41.299177 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee52fb-0413-48c9-81d9-8c2f99a37476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:41.300029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee52fb-0413-48c9-81d9-8c2f99a37476 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:41.300332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee52fb-0413-48c9-81d9-8c2f99a37476 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:41.300640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee52fb-0413-48c9-81d9-8c2f99a37476 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:41.308086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15082138-6000-46cc-add5-605d2929dc42 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:41.314326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee52fb-0413-48c9-81d9-8c2f99a37476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-0cee52fb-0413-48c9-81d9-8c2f99a37476 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:41.323363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:41.324225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:41.325260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:41.327609 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 104/225] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:27:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:41.328676 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee52fb-0413-48c9-81d9-8c2f99a37476 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:41.360119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46a3c0-1ec2-46ce-bb55-fa8a8f66a795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:41.361238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a3c0-1ec2-46ce-bb55-fa8a8f66a795 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:41.361522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a3c0-1ec2-46ce-bb55-fa8a8f66a795 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:41.361797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a3c0-1ec2-46ce-bb55-fa8a8f66a795 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:41.363709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46a3c0-1ec2-46ce-bb55-fa8a8f66a795 None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:41.365428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46a3c0-1ec2-46ce-bb55-fa8a8f66a795 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:41.367865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 122/226] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:41 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:41.368636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46a3c0-1ec2-46ce-bb55-fa8a8f66a795 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:41.435502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:41.445897 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee52fb-0413-48c9-81d9-8c2f99a37476 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:41.489775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0714-85f3-452d-b628-669d4baae4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:41.491126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0714-85f3-452d-b628-669d4baae4ad None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:41.491434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0714-85f3-452d-b628-669d4baae4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:41.491717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0714-85f3-452d-b628-669d4baae4ad None admin] PATH_INFO: `/v3/users/2d7072fd7329430a80bc79398d9f0bae` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:41.493141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa0714-85f3-452d-b628-669d4baae4ad None admin] RBAC: Authorizing `identity:get_user(user_id=2d7072fd7329430a80bc79398d9f0bae)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:41.495118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa0714-85f3-452d-b628-669d4baae4ad None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:41.497214 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 105/227] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:41 2022] GET /identity/v3/users/2d7072fd7329430a80bc79398d9f0bae => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:41.497982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0714-85f3-452d-b628-669d4baae4ad None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:41.510111 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46a3c0-1ec2-46ce-bb55-fa8a8f66a795 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:41.527993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:41.556258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36024a1f-12d1-4c11-bd4c-c171b9e986b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:41.557461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024a1f-12d1-4c11-bd4c-c171b9e986b0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:41.557746 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024a1f-12d1-4c11-bd4c-c171b9e986b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:41.558021 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024a1f-12d1-4c11-bd4c-c171b9e986b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:41.559109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36024a1f-12d1-4c11-bd4c-c171b9e986b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:41.559420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36024a1f-12d1-4c11-bd4c-c171b9e986b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:41.560956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36024a1f-12d1-4c11-bd4c-c171b9e986b0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:41.572149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 123/228] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:41.575369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36024a1f-12d1-4c11-bd4c-c171b9e986b0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:41.634557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0714-85f3-452d-b628-669d4baae4ad None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:41.676470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42c43-f53c-4a27-95c4-17e77f94bf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:41.677136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42c43-f53c-4a27-95c4-17e77f94bf1d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:41.677671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42c43-f53c-4a27-95c4-17e77f94bf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:41.677950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42c43-f53c-4a27-95c4-17e77f94bf1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:41.679426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c42c43-f53c-4a27-95c4-17e77f94bf1d None admin] RBAC: Adding query filter params (role.id=5c89d9dc8b0949b98573064d572f981a, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe, user.id=aa59845ff5d94b178dee9bac1320e03e) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:41.679877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c42c43-f53c-4a27-95c4-17e77f94bf1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:41.681614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c42c43-f53c-4a27-95c4-17e77f94bf1d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:41.689767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 106/229] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:41 2022] GET /identity/v3/role_assignments?user.id=aa59845ff5d94b178dee9bac1320e03e&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=5c89d9dc8b0949b98573064d572f981a => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:41.691073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42c43-f53c-4a27-95c4-17e77f94bf1d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:41.712053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36024a1f-12d1-4c11-bd4c-c171b9e986b0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:41.729363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:41.790480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c8852-584f-4372-861d-4e53ab217f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:41.791365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c8852-584f-4372-861d-4e53ab217f3a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:41.791650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c8852-584f-4372-861d-4e53ab217f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:41.791928 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c8852-584f-4372-861d-4e53ab217f3a None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:41.801796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c8852-584f-4372-861d-4e53ab217f3a None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:41.802610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:41.803303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c8852-584f-4372-861d-4e53ab217f3a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:41.807010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 124/230] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:41 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:41.815173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c8852-584f-4372-861d-4e53ab217f3a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:41.828794 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42c43-f53c-4a27-95c4-17e77f94bf1d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:41.904005 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a6dfc-13c2-4830-81f0-87efc793b341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:41.904908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a6dfc-13c2-4830-81f0-87efc793b341 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:41.905192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a6dfc-13c2-4830-81f0-87efc793b341 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:41.905468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a6dfc-13c2-4830-81f0-87efc793b341 None admin] PATH_INFO: `/v3/users/2d7072fd7329430a80bc79398d9f0bae` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:41.911056 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a6dfc-13c2-4830-81f0-87efc793b341 None admin] RBAC: Authorizing `identity:get_user(user_id=2d7072fd7329430a80bc79398d9f0bae)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:41.912792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a6dfc-13c2-4830-81f0-87efc793b341 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:41.914652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 107/231] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:41 2022] GET /identity/v3/users/2d7072fd7329430a80bc79398d9f0bae => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:41.921834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a6dfc-13c2-4830-81f0-87efc793b341 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:41.940067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c8852-584f-4372-861d-4e53ab217f3a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:41.980944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c3dfe-4f22-455f-9d7a-4cb57ad7efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:41.981989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c3dfe-4f22-455f-9d7a-4cb57ad7efa7 None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:41.982304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c3dfe-4f22-455f-9d7a-4cb57ad7efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:41.982588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c3dfe-4f22-455f-9d7a-4cb57ad7efa7 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/users/2d7072fd7329430a80bc79398d9f0bae/roles/d27765da961f442fa1ab376c59342273` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:41.985060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c3dfe-4f22-455f-9d7a-4cb57ad7efa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2d5fabbb53a41c7963507c6ce4bdabe, user_id=2d7072fd7329430a80bc79398d9f0bae, role_id=d27765da961f442fa1ab376c59342273)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:41.986568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c3dfe-4f22-455f-9d7a-4cb57ad7efa7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:42.061300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 125/232] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:27:41 2022] PUT /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/users/2d7072fd7329430a80bc79398d9f0bae/roles/d27765da961f442fa1ab376c59342273 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:42.109596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a6dfc-13c2-4830-81f0-87efc793b341 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:42.165133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201efbb0-6160-4a4e-a21d-e94750b72a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:42.166014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201efbb0-6160-4a4e-a21d-e94750b72a5c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:42.166315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201efbb0-6160-4a4e-a21d-e94750b72a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:42.166592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201efbb0-6160-4a4e-a21d-e94750b72a5c None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:42.171079 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201efbb0-6160-4a4e-a21d-e94750b72a5c None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:42.172568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201efbb0-6160-4a4e-a21d-e94750b72a5c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:42.174820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 108/233] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:41 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:42.180449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c3dfe-4f22-455f-9d7a-4cb57ad7efa7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:42.229559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:42.301457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c3dfe-4f22-455f-9d7a-4cb57ad7efa7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:42.341381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00712d-88e7-413b-803b-24fb2b570ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:42.342616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00712d-88e7-413b-803b-24fb2b570ae3 None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:42.343049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00712d-88e7-413b-803b-24fb2b570ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:42.343465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00712d-88e7-413b-803b-24fb2b570ae3 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/users/2d7072fd7329430a80bc79398d9f0bae/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:42.345744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00712d-88e7-413b-803b-24fb2b570ae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2d5fabbb53a41c7963507c6ce4bdabe, user_id=2d7072fd7329430a80bc79398d9f0bae, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:42.348149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00712d-88e7-413b-803b-24fb2b570ae3 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:42.472856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 126/234] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:27:42 2022] PUT /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/users/2d7072fd7329430a80bc79398d9f0bae/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:43.316924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bac1a6-3c88-452f-8123-9c1b70b291ef None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:43.317427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bac1a6-3c88-452f-8123-9c1b70b291ef None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:43.317500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bac1a6-3c88-452f-8123-9c1b70b291ef None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:43.318912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 109/235] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:43.324282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc1a85-d273-41c7-b00d-f78779654440 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:43.325374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc1a85-d273-41c7-b00d-f78779654440 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:43.325847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc1a85-d273-41c7-b00d-f78779654440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:43.351226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-90bc1a85-d273-41c7-b00d-f78779654440 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:43.352756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-90bc1a85-d273-41c7-b00d-f78779654440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:43.421954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6b2a6-4de0-4c07-a251-31de4451231e None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:43.422572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6b2a6-4de0-4c07-a251-31de4451231e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:43.423043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6b2a6-4de0-4c07-a251-31de4451231e None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:43.424615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 110/236] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:43.431994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1855a-e17b-409a-a46d-b392703db891 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:43.432486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1855a-e17b-409a-a46d-b392703db891 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:43.432979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1855a-e17b-409a-a46d-b392703db891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:43.439197 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 127/237] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:43.457516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-afe1855a-e17b-409a-a46d-b392703db891 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:43.458715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-afe1855a-e17b-409a-a46d-b392703db891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:43.477015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:43.480454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc1a85-d273-41c7-b00d-f78779654440 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:43.530650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:43.635488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 111/238] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:43.669897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc1a85-d273-41c7-b00d-f78779654440 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:43.683460 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1855a-e17b-409a-a46d-b392703db891 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:43.717636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa58137-acb1-4365-a606-0c79b61ea169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:43.718472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58137-acb1-4365-a606-0c79b61ea169 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:43.718753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58137-acb1-4365-a606-0c79b61ea169 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:43.719025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58137-acb1-4365-a606-0c79b61ea169 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:43.743382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa58137-acb1-4365-a606-0c79b61ea169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-5aa58137-acb1-4365-a606-0c79b61ea169 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:43.756971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:43.757840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:43.758646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 128/239] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:27:43.765865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa58137-acb1-4365-a606-0c79b61ea169 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:43.851134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1855a-e17b-409a-a46d-b392703db891 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:43.903851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0999c4-e011-4fd1-9ab8-9fefc3dd3088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:43.906368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0999c4-e011-4fd1-9ab8-9fefc3dd3088 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:43.906981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0999c4-e011-4fd1-9ab8-9fefc3dd3088 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:43.907670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0999c4-e011-4fd1-9ab8-9fefc3dd3088 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:43.911266 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0999c4-e011-4fd1-9ab8-9fefc3dd3088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:43.913202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0999c4-e011-4fd1-9ab8-9fefc3dd3088 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:43.916962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 112/240] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:43.942058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0999c4-e011-4fd1-9ab8-9fefc3dd3088 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:43.963027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:43.975450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:43.989733 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa58137-acb1-4365-a606-0c79b61ea169 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:44.060251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3076873-92be-4f19-abdc-b5510c51501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:44.060934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3076873-92be-4f19-abdc-b5510c51501b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:44.061213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3076873-92be-4f19-abdc-b5510c51501b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:44.061486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3076873-92be-4f19-abdc-b5510c51501b None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:44.063266 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3076873-92be-4f19-abdc-b5510c51501b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:44.063575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3076873-92be-4f19-abdc-b5510c51501b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:44.064989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3076873-92be-4f19-abdc-b5510c51501b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:44.081920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 129/241] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:44.091548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3076873-92be-4f19-abdc-b5510c51501b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:44.146282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0999c4-e011-4fd1-9ab8-9fefc3dd3088 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:44.203878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d93f9-fc49-49b8-a9b8-96390e1fbc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:44.204479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d93f9-fc49-49b8-a9b8-96390e1fbc7b None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:44.204915 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d93f9-fc49-49b8-a9b8-96390e1fbc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:44.205202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d93f9-fc49-49b8-a9b8-96390e1fbc7b None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:44.205977 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d93f9-fc49-49b8-a9b8-96390e1fbc7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:44.207462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d93f9-fc49-49b8-a9b8-96390e1fbc7b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:44.273677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3076873-92be-4f19-abdc-b5510c51501b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:44.309245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab30843-facf-4495-be75-0610e1cbe323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:44.310122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab30843-facf-4495-be75-0610e1cbe323 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:44.310429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab30843-facf-4495-be75-0610e1cbe323 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:44.310703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab30843-facf-4495-be75-0610e1cbe323 None admin] PATH_INFO: `/v3/users/355b67d9f2474217839fbae7f31039a4` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:44.325488 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab30843-facf-4495-be75-0610e1cbe323 None admin] RBAC: Authorizing `identity:get_user(user_id=355b67d9f2474217839fbae7f31039a4)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:44.327070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab30843-facf-4495-be75-0610e1cbe323 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:44.329077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 130/242] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:44 2022] GET /identity/v3/users/355b67d9f2474217839fbae7f31039a4 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:44.334223 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab30843-facf-4495-be75-0610e1cbe323 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:44.336253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 113/243] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:27:43 2022] POST /identity/v3/users => generated 293 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:27:44.347108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:44.407336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a5749-3961-4a36-9ad3-3685a09d4694 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:44.408003 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a5749-3961-4a36-9ad3-3685a09d4694 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:44.408517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a5749-3961-4a36-9ad3-3685a09d4694 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:44.411100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 114/244] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:44.416925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c62265-844e-4818-b5bc-c8937e820623 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:44.417467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c62265-844e-4818-b5bc-c8937e820623 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:44.417936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c62265-844e-4818-b5bc-c8937e820623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:44.436010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-87c62265-844e-4818-b5bc-c8937e820623 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:44.437589 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-87c62265-844e-4818-b5bc-c8937e820623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:44.443304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab30843-facf-4495-be75-0610e1cbe323 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:44.481041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab0f28-f5ff-4734-9e53-df1432ae06b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:44.481629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0f28-f5ff-4734-9e53-df1432ae06b8 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:44.481911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0f28-f5ff-4734-9e53-df1432ae06b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:44.482184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0f28-f5ff-4734-9e53-df1432ae06b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:44.526164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 115/245] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:27:44.549944 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c62265-844e-4818-b5bc-c8937e820623 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:44.559974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab0f28-f5ff-4734-9e53-df1432ae06b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:44.561501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab0f28-f5ff-4734-9e53-df1432ae06b8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:44.567311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:44.575029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:44.676576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 131/246] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 06:27:44.682160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab0f28-f5ff-4734-9e53-df1432ae06b8 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:44.732625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c62265-844e-4818-b5bc-c8937e820623 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:44.774218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67057c7-d9dd-427d-b9af-af3bf84c3d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:44.775066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67057c7-d9dd-427d-b9af-af3bf84c3d45 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:44.775347 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67057c7-d9dd-427d-b9af-af3bf84c3d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:44.775679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67057c7-d9dd-427d-b9af-af3bf84c3d45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:44.786660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab0f28-f5ff-4734-9e53-df1432ae06b8 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:44.788246 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67057c7-d9dd-427d-b9af-af3bf84c3d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:44.794556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-f67057c7-d9dd-427d-b9af-af3bf84c3d45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:44.797020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:44.797927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:44.798727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:44.802307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 116/247] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:44.805807 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67057c7-d9dd-427d-b9af-af3bf84c3d45 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:44.823963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23546f72-b59d-4f44-a49a-6c6f255bb143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:44.825087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23546f72-b59d-4f44-a49a-6c6f255bb143 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:44.825365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23546f72-b59d-4f44-a49a-6c6f255bb143 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:44.825636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23546f72-b59d-4f44-a49a-6c6f255bb143 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:44.827130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23546f72-b59d-4f44-a49a-6c6f255bb143 None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:44.828627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23546f72-b59d-4f44-a49a-6c6f255bb143 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:44.830545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 132/248] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:44 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:44.836694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23546f72-b59d-4f44-a49a-6c6f255bb143 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:44.873875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:44.917272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67057c7-d9dd-427d-b9af-af3bf84c3d45 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:44.962507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23546f72-b59d-4f44-a49a-6c6f255bb143 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:44.972788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230279e3-7f85-4c7c-9f23-171b1d282616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:44.973475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230279e3-7f85-4c7c-9f23-171b1d282616 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:44.973816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230279e3-7f85-4c7c-9f23-171b1d282616 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:44.974465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230279e3-7f85-4c7c-9f23-171b1d282616 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:44.975233 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230279e3-7f85-4c7c-9f23-171b1d282616 None admin] RBAC: Adding query filter params (name=member) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:44.975543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230279e3-7f85-4c7c-9f23-171b1d282616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:44.976939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230279e3-7f85-4c7c-9f23-171b1d282616 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:44.986585 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 117/249] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:44.988311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb513f2-d317-4439-b6e0-f74aeb74f7c9 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:44.988604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb513f2-d317-4439-b6e0-f74aeb74f7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:44.988884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb513f2-d317-4439-b6e0-f74aeb74f7c9 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:44.991257 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 118/250] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:44.996836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84186221-c155-4c0e-973d-0c7509a06301 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:44.997129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84186221-c155-4c0e-973d-0c7509a06301 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:44.997405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84186221-c155-4c0e-973d-0c7509a06301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:45.012396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8c703-f9db-4721-b0bc-cbdc6b430e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:45.013186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c703-f9db-4721-b0bc-cbdc6b430e00 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:45.013529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c703-f9db-4721-b0bc-cbdc6b430e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:45.013812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c703-f9db-4721-b0bc-cbdc6b430e00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:45.014959 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8c703-f9db-4721-b0bc-cbdc6b430e00 None admin] RBAC: Adding query filter params (role.id=24b48a19f5e94098b75009d75bdc90d9, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe, user.id=355b67d9f2474217839fbae7f31039a4) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:45.015279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8c703-f9db-4721-b0bc-cbdc6b430e00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:45.016995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8c703-f9db-4721-b0bc-cbdc6b430e00 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:45.020070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-84186221-c155-4c0e-973d-0c7509a06301 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:45.021758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-84186221-c155-4c0e-973d-0c7509a06301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:45.026548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 133/251] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:44 2022] GET /identity/v3/role_assignments?user.id=355b67d9f2474217839fbae7f31039a4&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=24b48a19f5e94098b75009d75bdc90d9 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:45.027538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8c703-f9db-4721-b0bc-cbdc6b430e00 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:45.079788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:45.108067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 119/252] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:45.136450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84186221-c155-4c0e-973d-0c7509a06301 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:45.194182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8c703-f9db-4721-b0bc-cbdc6b430e00 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:45.254712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:45.267866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83792e-bcd8-4a87-857e-dc15aa8bbbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:45.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83792e-bcd8-4a87-857e-dc15aa8bbbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:45.269577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83792e-bcd8-4a87-857e-dc15aa8bbbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:45.269846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83792e-bcd8-4a87-857e-dc15aa8bbbc0 None admin] PATH_INFO: `/v3/users/aa59845ff5d94b178dee9bac1320e03e` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:45.271152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83792e-bcd8-4a87-857e-dc15aa8bbbc0 None admin] RBAC: Authorizing `identity:get_user(user_id=aa59845ff5d94b178dee9bac1320e03e)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:45.272665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83792e-bcd8-4a87-857e-dc15aa8bbbc0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:45.274631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 134/253] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:45 2022] GET /identity/v3/users/aa59845ff5d94b178dee9bac1320e03e => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:45.279887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83792e-bcd8-4a87-857e-dc15aa8bbbc0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:45.326912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84186221-c155-4c0e-973d-0c7509a06301 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:45.365137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02fdcd-a176-444e-bbfb-bd15ce2043cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:45.365963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02fdcd-a176-444e-bbfb-bd15ce2043cf None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:45.366383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02fdcd-a176-444e-bbfb-bd15ce2043cf None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:45.366662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02fdcd-a176-444e-bbfb-bd15ce2043cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:45.383796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02fdcd-a176-444e-bbfb-bd15ce2043cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-ed02fdcd-a176-444e-bbfb-bd15ce2043cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:45.404799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:45.405712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:45.406496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 120/254] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:27:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:45.415420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02fdcd-a176-444e-bbfb-bd15ce2043cf None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:45.499028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83792e-bcd8-4a87-857e-dc15aa8bbbc0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:45.508155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:45.538956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6c736-e6fd-4fe7-ba86-30653d630f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:45.539984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6c736-e6fd-4fe7-ba86-30653d630f2d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:45.540359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6c736-e6fd-4fe7-ba86-30653d630f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:45.540732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6c736-e6fd-4fe7-ba86-30653d630f2d None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:45.542872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6c736-e6fd-4fe7-ba86-30653d630f2d None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:45.544446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6c736-e6fd-4fe7-ba86-30653d630f2d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:45.546759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 135/255] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:45 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:45.548707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2e3be-3bc9-4199-b34a-6c404afff8cf None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:45.549014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2e3be-3bc9-4199-b34a-6c404afff8cf None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:45.549386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2e3be-3bc9-4199-b34a-6c404afff8cf None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:45.550801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 136/256] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:45.561413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906c5ef-5278-4c68-8dc9-c266e07c5a32 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:45.561413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906c5ef-5278-4c68-8dc9-c266e07c5a32 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:45.561413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906c5ef-5278-4c68-8dc9-c266e07c5a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:45.578145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c906c5ef-5278-4c68-8dc9-c266e07c5a32 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:45.579594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c906c5ef-5278-4c68-8dc9-c266e07c5a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:45.621091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02fdcd-a176-444e-bbfb-bd15ce2043cf None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:45.651206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 137/257] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:45.652280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906c5ef-5278-4c68-8dc9-c266e07c5a32 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:45.671791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:45.767043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83788fd-c9c3-474e-ab9b-8e618249f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:45.767650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83788fd-c9c3-474e-ab9b-8e618249f54d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:45.768007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83788fd-c9c3-474e-ab9b-8e618249f54d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:45.768210 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83788fd-c9c3-474e-ab9b-8e618249f54d None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:45.769023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83788fd-c9c3-474e-ab9b-8e618249f54d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:45.769332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83788fd-c9c3-474e-ab9b-8e618249f54d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:45.770755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83788fd-c9c3-474e-ab9b-8e618249f54d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:45.787060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906c5ef-5278-4c68-8dc9-c266e07c5a32 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:45.798577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:45.800751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 121/258] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:27:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:45.801834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83788fd-c9c3-474e-ab9b-8e618249f54d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:45.831115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7275ce7-fadc-4229-aeee-c7599f3c1ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:45.832266 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7275ce7-fadc-4229-aeee-c7599f3c1ee7 None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:45.832696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7275ce7-fadc-4229-aeee-c7599f3c1ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:45.833139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7275ce7-fadc-4229-aeee-c7599f3c1ee7 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/users/aa59845ff5d94b178dee9bac1320e03e/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:45.836194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7275ce7-fadc-4229-aeee-c7599f3c1ee7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2d5fabbb53a41c7963507c6ce4bdabe, user_id=aa59845ff5d94b178dee9bac1320e03e, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:45.840795 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7275ce7-fadc-4229-aeee-c7599f3c1ee7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:45.929284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 138/259] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:27:45 2022] PUT /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/users/aa59845ff5d94b178dee9bac1320e03e/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:45.930528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7275ce7-fadc-4229-aeee-c7599f3c1ee7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:45.967318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83788fd-c9c3-474e-ab9b-8e618249f54d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:46.011225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c20b7-d6d8-4626-88af-81d343f61ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:46.012327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c20b7-d6d8-4626-88af-81d343f61ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:46.012768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c20b7-d6d8-4626-88af-81d343f61ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:46.013215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c20b7-d6d8-4626-88af-81d343f61ee9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:46.025913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c20b7-d6d8-4626-88af-81d343f61ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-4d4c20b7-d6d8-4626-88af-81d343f61ee9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:46.035050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:46.036448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:27:46.038019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:46.041401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 122/260] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:27:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:46.047700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c20b7-d6d8-4626-88af-81d343f61ee9 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:46.135315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:46.161010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7275ce7-fadc-4229-aeee-c7599f3c1ee7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:46.207136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfec5a-79ab-4fca-920b-f1a8ce005ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:46.208025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfec5a-79ab-4fca-920b-f1a8ce005ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:46.208305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfec5a-79ab-4fca-920b-f1a8ce005ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:46.208574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfec5a-79ab-4fca-920b-f1a8ce005ce3 None admin] PATH_INFO: `/v3/users/2d7072fd7329430a80bc79398d9f0bae` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:46.209833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfec5a-79ab-4fca-920b-f1a8ce005ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=2d7072fd7329430a80bc79398d9f0bae)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:46.211342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfec5a-79ab-4fca-920b-f1a8ce005ce3 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:46.213346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 139/261] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:45 2022] GET /identity/v3/users/2d7072fd7329430a80bc79398d9f0bae => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:46.218848 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfec5a-79ab-4fca-920b-f1a8ce005ce3 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:46.253814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:46.331459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfec5a-79ab-4fca-920b-f1a8ce005ce3 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:46.332549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c20b7-d6d8-4626-88af-81d343f61ee9 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:46.374413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b63da5-9875-4ca4-ae00-30bb7eb277af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:46.374413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b63da5-9875-4ca4-ae00-30bb7eb277af None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:46.374413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b63da5-9875-4ca4-ae00-30bb7eb277af None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:46.374413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b63da5-9875-4ca4-ae00-30bb7eb277af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:46.399258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea4bec-14da-470d-9114-71523684d29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:46.400791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4bec-14da-470d-9114-71523684d29e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:46.401082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4bec-14da-470d-9114-71523684d29e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:46.401361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4bec-14da-470d-9114-71523684d29e None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:46.402126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea4bec-14da-470d-9114-71523684d29e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:46.402468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea4bec-14da-470d-9114-71523684d29e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:46.407925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea4bec-14da-470d-9114-71523684d29e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:46.427129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 123/262] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:46.433297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea4bec-14da-470d-9114-71523684d29e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:46.486262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b63da5-9875-4ca4-ae00-30bb7eb277af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:46.486760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b63da5-9875-4ca4-ae00-30bb7eb277af None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:46.520726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:46.572253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:46.575576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea4bec-14da-470d-9114-71523684d29e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:46.596707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 140/263] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 06:27:46.602963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b63da5-9875-4ca4-ae00-30bb7eb277af None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:46.615643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8b383-6aee-4d2b-ae07-db4e659073b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:46.617075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8b383-6aee-4d2b-ae07-db4e659073b3 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:46.617583 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8b383-6aee-4d2b-ae07-db4e659073b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:46.618050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8b383-6aee-4d2b-ae07-db4e659073b3 None admin] PATH_INFO: `/v3/users/2d7072fd7329430a80bc79398d9f0bae` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:46.619651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8b383-6aee-4d2b-ae07-db4e659073b3 None admin] RBAC: Authorizing `identity:get_user(user_id=2d7072fd7329430a80bc79398d9f0bae)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:46.621340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8b383-6aee-4d2b-ae07-db4e659073b3 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:46.623244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 124/264] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:46 2022] GET /identity/v3/users/2d7072fd7329430a80bc79398d9f0bae => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:46.629316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8b383-6aee-4d2b-ae07-db4e659073b3 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:46.744864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8b383-6aee-4d2b-ae07-db4e659073b3 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:46.776153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b63da5-9875-4ca4-ae00-30bb7eb277af None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:46.784692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca442e-3170-4cc3-b4e3-8b53b09702ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:46.785350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca442e-3170-4cc3-b4e3-8b53b09702ee None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:46.785631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca442e-3170-4cc3-b4e3-8b53b09702ee None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:46.785903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca442e-3170-4cc3-b4e3-8b53b09702ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:46.828318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:46.859529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:46.865435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca442e-3170-4cc3-b4e3-8b53b09702ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:46.866929 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca442e-3170-4cc3-b4e3-8b53b09702ee None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:46.868004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636246bd-86c5-454c-b4a4-a57d6b8ee2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:46.869098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636246bd-86c5-454c-b4a4-a57d6b8ee2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:46.869571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636246bd-86c5-454c-b4a4-a57d6b8ee2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:46.870037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636246bd-86c5-454c-b4a4-a57d6b8ee2c6 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:46.871585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636246bd-86c5-454c-b4a4-a57d6b8ee2c6 None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:46.873237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636246bd-86c5-454c-b4a4-a57d6b8ee2c6 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:46.875167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 141/265] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:46 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:46.894254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636246bd-86c5-454c-b4a4-a57d6b8ee2c6 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:47.045402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 125/266] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:47.054601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca442e-3170-4cc3-b4e3-8b53b09702ee None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:47.127334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636246bd-86c5-454c-b4a4-a57d6b8ee2c6 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:47.166284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c1b0-8d7a-4bc2-84ea-b0f6147fa774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:47.166949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c1b0-8d7a-4bc2-84ea-b0f6147fa774 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:47.167228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c1b0-8d7a-4bc2-84ea-b0f6147fa774 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:47.167499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c1b0-8d7a-4bc2-84ea-b0f6147fa774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:47.168742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c1b0-8d7a-4bc2-84ea-b0f6147fa774 None admin] RBAC: Adding query filter params (role.id=d27765da961f442fa1ab376c59342273, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe, user.id=2d7072fd7329430a80bc79398d9f0bae) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:47.169058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c1b0-8d7a-4bc2-84ea-b0f6147fa774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:47.170848 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c1b0-8d7a-4bc2-84ea-b0f6147fa774 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:47.177946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 142/267] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:46 2022] GET /identity/v3/role_assignments?user.id=2d7072fd7329430a80bc79398d9f0bae&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=d27765da961f442fa1ab376c59342273 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:47.268147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca442e-3170-4cc3-b4e3-8b53b09702ee None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:47.278675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:47.317921 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbd776-02b7-4ffb-a07f-995aa102057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:47.318826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd776-02b7-4ffb-a07f-995aa102057a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:47.319105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd776-02b7-4ffb-a07f-995aa102057a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:47.319378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd776-02b7-4ffb-a07f-995aa102057a None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:47.320585 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbd776-02b7-4ffb-a07f-995aa102057a None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:47.322048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbd776-02b7-4ffb-a07f-995aa102057a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:47.324184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 126/268] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:47 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:47.330117 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c1b0-8d7a-4bc2-84ea-b0f6147fa774 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:47.434606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:47.483887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c1b0-8d7a-4bc2-84ea-b0f6147fa774 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:47.532081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291347a5-73d6-44ae-9604-75ff4a0ef3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:47.532807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291347a5-73d6-44ae-9604-75ff4a0ef3cb None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:47.533030 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291347a5-73d6-44ae-9604-75ff4a0ef3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:47.533305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291347a5-73d6-44ae-9604-75ff4a0ef3cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:47.534716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291347a5-73d6-44ae-9604-75ff4a0ef3cb None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe, user.id=2d7072fd7329430a80bc79398d9f0bae) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:47.535026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291347a5-73d6-44ae-9604-75ff4a0ef3cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:47.536450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291347a5-73d6-44ae-9604-75ff4a0ef3cb None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:47.547175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 143/269] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:47 2022] GET /identity/v3/role_assignments?user.id=2d7072fd7329430a80bc79398d9f0bae&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:47.779582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d432-b3e1-4fe3-9340-1076c4a5cc37 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:47.779582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d432-b3e1-4fe3-9340-1076c4a5cc37 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:47.779582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d432-b3e1-4fe3-9340-1076c4a5cc37 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:47.779582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 127/270] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:47.786538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2cc82-3df4-4976-97eb-ac3a8c49c2e1 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:47.786872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2cc82-3df4-4976-97eb-ac3a8c49c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:47.787107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2cc82-3df4-4976-97eb-ac3a8c49c2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:47.808285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-61c2cc82-3df4-4976-97eb-ac3a8c49c2e1 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:47.809479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-61c2cc82-3df4-4976-97eb-ac3a8c49c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:47.903042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 144/271] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:47.938846 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4d432-b3e1-4fe3-9340-1076c4a5cc37 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:48.057560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4d432-b3e1-4fe3-9340-1076c4a5cc37 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:48.096177 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945ebb5-144d-44a8-8586-b64563b18a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:48.097242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ebb5-144d-44a8-8586-b64563b18a43 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.097690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ebb5-144d-44a8-8586-b64563b18a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.098154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ebb5-144d-44a8-8586-b64563b18a43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.101158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:48.111555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945ebb5-144d-44a8-8586-b64563b18a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-9945ebb5-144d-44a8-8586-b64563b18a43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:48.119635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:48.120695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:48.121660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:48.123801 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 128/272] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:48.135439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2cc82-3df4-4976-97eb-ac3a8c49c2e1 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:48.194365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3230f3-0b9a-4788-8365-4e7a88546970 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.194654 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3230f3-0b9a-4788-8365-4e7a88546970 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.194938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3230f3-0b9a-4788-8365-4e7a88546970 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.196456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 129/273] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:48.202658 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6635dcb-1534-4489-8e23-d11847837a90 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.202658 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6635dcb-1534-4489-8e23-d11847837a90 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.202658 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6635dcb-1534-4489-8e23-d11847837a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.224826 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:48.227116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-f6635dcb-1534-4489-8e23-d11847837a90 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:48.230198 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f6635dcb-1534-4489-8e23-d11847837a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:48.279044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2cc82-3df4-4976-97eb-ac3a8c49c2e1 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:48.311514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 130/274] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:48.321550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c3dbf-2b27-47fe-9d82-8d7c107d4701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:48.322506 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c3dbf-2b27-47fe-9d82-8d7c107d4701 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.322993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c3dbf-2b27-47fe-9d82-8d7c107d4701 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.323458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c3dbf-2b27-47fe-9d82-8d7c107d4701 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.324406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c3dbf-2b27-47fe-9d82-8d7c107d4701 None admin] RBAC: Adding query filter params (name=member) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:48.325242 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c3dbf-2b27-47fe-9d82-8d7c107d4701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:48.326864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c3dbf-2b27-47fe-9d82-8d7c107d4701 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:48.336125 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 145/275] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:48.340715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6635dcb-1534-4489-8e23-d11847837a90 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:48.347140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c3dbf-2b27-47fe-9d82-8d7c107d4701 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:48.444965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6635dcb-1534-4489-8e23-d11847837a90 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:48.461517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c3dbf-2b27-47fe-9d82-8d7c107d4701 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:48.472463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:48.481307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5bbf1-0ba9-4a80-a65e-fe2ad2969d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:48.482100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5bbf1-0ba9-4a80-a65e-fe2ad2969d15 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.482414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5bbf1-0ba9-4a80-a65e-fe2ad2969d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.485208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:48.485309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5bbf1-0ba9-4a80-a65e-fe2ad2969d15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.485309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5bbf1-0ba9-4a80-a65e-fe2ad2969d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:48.485510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5bbf1-0ba9-4a80-a65e-fe2ad2969d15 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:48.492587 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 131/276] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:48.492587 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec34d49-53e7-442e-8641-e562bd3663a1 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.492587 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec34d49-53e7-442e-8641-e562bd3663a1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.492587 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec34d49-53e7-442e-8641-e562bd3663a1 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.492587 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 132/277] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:48.493323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec34d49-53e7-442e-8641-e562bd3663a1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:48.504361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88070f67-30f5-40fe-be6a-e6c45b9cf269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:48.505243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070f67-30f5-40fe-be6a-e6c45b9cf269 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.505529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070f67-30f5-40fe-be6a-e6c45b9cf269 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.505805 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070f67-30f5-40fe-be6a-e6c45b9cf269 None admin] PATH_INFO: `/v3/users/366621e532c34aa6a381c335809a861d` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.519610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88070f67-30f5-40fe-be6a-e6c45b9cf269 None admin] RBAC: Authorizing `identity:get_user(user_id=366621e532c34aa6a381c335809a861d)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:48.521128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88070f67-30f5-40fe-be6a-e6c45b9cf269 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:48.527464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 146/278] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:48 2022] GET /identity/v3/users/366621e532c34aa6a381c335809a861d => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:48.527464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d68e6-7ab4-4a4a-a8d7-a906aad4900c None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.527464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d68e6-7ab4-4a4a-a8d7-a906aad4900c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.527464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d68e6-7ab4-4a4a-a8d7-a906aad4900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.540930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-855d68e6-7ab4-4a4a-a8d7-a906aad4900c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:48.542098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-855d68e6-7ab4-4a4a-a8d7-a906aad4900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:48.618105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec34d49-53e7-442e-8641-e562bd3663a1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:48.621998 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 147/279] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:48.622921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d68e6-7ab4-4a4a-a8d7-a906aad4900c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:48.676889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92954b-d52a-425c-8eb3-b62b5899a3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:48.677557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92954b-d52a-425c-8eb3-b62b5899a3d0 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.677840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92954b-d52a-425c-8eb3-b62b5899a3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.678118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92954b-d52a-425c-8eb3-b62b5899a3d0 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.679058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92954b-d52a-425c-8eb3-b62b5899a3d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:48.680299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92954b-d52a-425c-8eb3-b62b5899a3d0 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:48.730442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d68e6-7ab4-4a4a-a8d7-a906aad4900c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:48.739888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:48.763651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce66a-aa00-4040-beb2-73a974998eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:48.764305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce66a-aa00-4040-beb2-73a974998eac None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.764589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce66a-aa00-4040-beb2-73a974998eac None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.764864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce66a-aa00-4040-beb2-73a974998eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.765743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ce66a-aa00-4040-beb2-73a974998eac None admin] RBAC: Adding query filter params (role.id=5c89d9dc8b0949b98573064d572f981a, user.id=366621e532c34aa6a381c335809a861d, scope.system=all) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:48.766100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ce66a-aa00-4040-beb2-73a974998eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:48.767562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ce66a-aa00-4040-beb2-73a974998eac None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:48.772795 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 148/280] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Jun 8 06:27:48 2022] GET /identity/v3/role_assignments?user.id=366621e532c34aa6a381c335809a861d&scope.system=all&role.id=5c89d9dc8b0949b98573064d572f981a => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:48.773754 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce66a-aa00-4040-beb2-73a974998eac None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:48.800069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 133/281] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:27:48 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:27:48.908478 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce66a-aa00-4040-beb2-73a974998eac None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:48.950152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b503c8-c1a4-4a1d-b887-9a362bf007f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:48.951394 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b503c8-c1a4-4a1d-b887-9a362bf007f0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.951921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b503c8-c1a4-4a1d-b887-9a362bf007f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.952407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b503c8-c1a4-4a1d-b887-9a362bf007f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.966293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b503c8-c1a4-4a1d-b887-9a362bf007f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-25b503c8-c1a4-4a1d-b887-9a362bf007f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:48.975397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:48.976369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:48.977172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:48.977774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42466c8-112b-4cc0-b054-168d7095d538 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.977774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42466c8-112b-4cc0-b054-168d7095d538 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.977774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42466c8-112b-4cc0-b054-168d7095d538 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.978683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 134/282] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:48.980397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 149/283] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:48.987886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55334d9f-9e3d-4370-a1e9-2afd3fd83008 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:48.987886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55334d9f-9e3d-4370-a1e9-2afd3fd83008 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:48.987886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55334d9f-9e3d-4370-a1e9-2afd3fd83008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:48.988234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b503c8-c1a4-4a1d-b887-9a362bf007f0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:49.004662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-55334d9f-9e3d-4370-a1e9-2afd3fd83008 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:49.005870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-55334d9f-9e3d-4370-a1e9-2afd3fd83008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:49.030270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:49.066219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:49.092286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 135/284] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:49.111881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b503c8-c1a4-4a1d-b887-9a362bf007f0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:49.116324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55334d9f-9e3d-4370-a1e9-2afd3fd83008 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:49.165543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53de8b-f107-4ced-ac5e-4e4cb7b9c0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:49.166471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53de8b-f107-4ced-ac5e-4e4cb7b9c0fd None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:49.166838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53de8b-f107-4ced-ac5e-4e4cb7b9c0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:49.167200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53de8b-f107-4ced-ac5e-4e4cb7b9c0fd None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:49.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53de8b-f107-4ced-ac5e-4e4cb7b9c0fd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:49.168339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53de8b-f107-4ced-ac5e-4e4cb7b9c0fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:49.170949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53de8b-f107-4ced-ac5e-4e4cb7b9c0fd None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:49.186399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 150/285] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:49.188278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53de8b-f107-4ced-ac5e-4e4cb7b9c0fd None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:49.253423 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55334d9f-9e3d-4370-a1e9-2afd3fd83008 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:49.289988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eb866-1a3b-4b17-a7c1-9b4ebf6fdc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:49.290835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eb866-1a3b-4b17-a7c1-9b4ebf6fdc50 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:49.291181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eb866-1a3b-4b17-a7c1-9b4ebf6fdc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:49.291511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eb866-1a3b-4b17-a7c1-9b4ebf6fdc50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:49.303744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2eb866-1a3b-4b17-a7c1-9b4ebf6fdc50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-bb2eb866-1a3b-4b17-a7c1-9b4ebf6fdc50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:49.311508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:49.312554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:49.313516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:49.314181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 136/286] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:27:49.321083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eb866-1a3b-4b17-a7c1-9b4ebf6fdc50 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:49.356217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:49.367481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53de8b-f107-4ced-ac5e-4e4cb7b9c0fd None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:49.382716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:49.447929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32bece-e577-47b1-9376-40c125d1bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:49.449155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32bece-e577-47b1-9376-40c125d1bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:49.449883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32bece-e577-47b1-9376-40c125d1bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:49.450402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32bece-e577-47b1-9376-40c125d1bbb0 None admin] PATH_INFO: `/v3/users/355b67d9f2474217839fbae7f31039a4` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:49.451833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32bece-e577-47b1-9376-40c125d1bbb0 None admin] RBAC: Authorizing `identity:get_user(user_id=355b67d9f2474217839fbae7f31039a4)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:49.453492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32bece-e577-47b1-9376-40c125d1bbb0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:49.462531 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 151/287] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:49 2022] GET /identity/v3/users/355b67d9f2474217839fbae7f31039a4 => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:49.463317 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eb866-1a3b-4b17-a7c1-9b4ebf6fdc50 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:49.467774 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32bece-e577-47b1-9376-40c125d1bbb0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:49.497503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c693f-a988-42ea-b8b1-366abe2e1ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:49.498167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c693f-a988-42ea-b8b1-366abe2e1ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:49.498477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c693f-a988-42ea-b8b1-366abe2e1ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:49.498753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c693f-a988-42ea-b8b1-366abe2e1ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:49.499543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c693f-a988-42ea-b8b1-366abe2e1ac7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:49.499849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c693f-a988-42ea-b8b1-366abe2e1ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:49.501312 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c693f-a988-42ea-b8b1-366abe2e1ac7 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:49.511037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 137/288] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:49.515688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c693f-a988-42ea-b8b1-366abe2e1ac7 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:49.635983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32bece-e577-47b1-9376-40c125d1bbb0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:49.700180 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f8901-f58a-4f7d-9c26-2d91ab7b20d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:49.700963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f8901-f58a-4f7d-9c26-2d91ab7b20d7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:49.701245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f8901-f58a-4f7d-9c26-2d91ab7b20d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:49.701516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f8901-f58a-4f7d-9c26-2d91ab7b20d7 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:49.702920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f8901-f58a-4f7d-9c26-2d91ab7b20d7 None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:49.704359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f8901-f58a-4f7d-9c26-2d91ab7b20d7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:49.706101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 152/289] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:49 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:49.712749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f8901-f58a-4f7d-9c26-2d91ab7b20d7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:49.732032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c693f-a988-42ea-b8b1-366abe2e1ac7 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:49.734537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:49.778511 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:49.800186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b8f90-e086-414a-9cbf-cd2249ca1024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:49.801093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8f90-e086-414a-9cbf-cd2249ca1024 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:49.801397 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8f90-e086-414a-9cbf-cd2249ca1024 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:49.801668 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8f90-e086-414a-9cbf-cd2249ca1024 None admin] PATH_INFO: `/v3/users/aa59845ff5d94b178dee9bac1320e03e` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:49.803569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b8f90-e086-414a-9cbf-cd2249ca1024 None admin] RBAC: Authorizing `identity:get_user(user_id=aa59845ff5d94b178dee9bac1320e03e)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:49.805013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b8f90-e086-414a-9cbf-cd2249ca1024 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:49.808372 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 138/290] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:49 2022] GET /identity/v3/users/aa59845ff5d94b178dee9bac1320e03e => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:49.812860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b8f90-e086-414a-9cbf-cd2249ca1024 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:49.896957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f8901-f58a-4f7d-9c26-2d91ab7b20d7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:49.913378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b8f90-e086-414a-9cbf-cd2249ca1024 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:49.958722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29834c-31ba-4486-8599-16de4583c9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:49.959196 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29834c-31ba-4486-8599-16de4583c9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:49.959480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29834c-31ba-4486-8599-16de4583c9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:49.959758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29834c-31ba-4486-8599-16de4583c9c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:49.963679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4622c-3912-477d-8ced-6894bbad0e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:49.964576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4622c-3912-477d-8ced-6894bbad0e11 None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:49.964853 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4622c-3912-477d-8ced-6894bbad0e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:49.965130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4622c-3912-477d-8ced-6894bbad0e11 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/users/355b67d9f2474217839fbae7f31039a4/roles/24b48a19f5e94098b75009d75bdc90d9` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:49.969424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4622c-3912-477d-8ced-6894bbad0e11 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2d5fabbb53a41c7963507c6ce4bdabe, user_id=355b67d9f2474217839fbae7f31039a4, role_id=24b48a19f5e94098b75009d75bdc90d9)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:49.970888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4622c-3912-477d-8ced-6894bbad0e11 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:50.015663 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:50.043479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29834c-31ba-4486-8599-16de4583c9c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:50.045281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29834c-31ba-4486-8599-16de4583c9c4 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:50.057979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 153/291] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:27:49 2022] PUT /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/users/355b67d9f2474217839fbae7f31039a4/roles/24b48a19f5e94098b75009d75bdc90d9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:50.155513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 139/292] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:50.163364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4622c-3912-477d-8ced-6894bbad0e11 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:50.322198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:50.333142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4622c-3912-477d-8ced-6894bbad0e11 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:50.371493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286b916-760e-455f-8ed8-113e85ef3fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:50.372366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286b916-760e-455f-8ed8-113e85ef3fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:50.372644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286b916-760e-455f-8ed8-113e85ef3fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:50.372914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286b916-760e-455f-8ed8-113e85ef3fe9 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:50.374118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286b916-760e-455f-8ed8-113e85ef3fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:50.375614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286b916-760e-455f-8ed8-113e85ef3fe9 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:50.377616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 154/293] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:50 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:50.383266 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29834c-31ba-4486-8599-16de4583c9c4 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:50.464323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:50.503340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29834c-31ba-4486-8599-16de4583c9c4 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:50.548068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbeff2-e94b-429f-b894-8a4ef3adb0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:50.548727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbeff2-e94b-429f-b894-8a4ef3adb0cc None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:50.549007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbeff2-e94b-429f-b894-8a4ef3adb0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:50.549281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbeff2-e94b-429f-b894-8a4ef3adb0cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:50.550160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbeff2-e94b-429f-b894-8a4ef3adb0cc None admin] RBAC: Adding query filter params (role.id=5c89d9dc8b0949b98573064d572f981a, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe, user.id=aa59845ff5d94b178dee9bac1320e03e) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:50.550494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbeff2-e94b-429f-b894-8a4ef3adb0cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:50.551985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbeff2-e94b-429f-b894-8a4ef3adb0cc None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:50.558265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 140/294] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:50 2022] GET /identity/v3/role_assignments?user.id=aa59845ff5d94b178dee9bac1320e03e&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=5c89d9dc8b0949b98573064d572f981a => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:51.354607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5c309-1503-452a-9cc8-5ad6b34bc926 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:51.355612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5c309-1503-452a-9cc8-5ad6b34bc926 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:51.356120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5c309-1503-452a-9cc8-5ad6b34bc926 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:51.357690 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 155/295] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:51.363165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899d43c-6524-431b-9b04-0a7bbc421132 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:51.363968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899d43c-6524-431b-9b04-0a7bbc421132 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:51.364455 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899d43c-6524-431b-9b04-0a7bbc421132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:51.381871 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5899d43c-6524-431b-9b04-0a7bbc421132 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:51.383473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5899d43c-6524-431b-9b04-0a7bbc421132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:51.466410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 141/296] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:51.481932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5c309-1503-452a-9cc8-5ad6b34bc926 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:51.597328 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea4d51-09a2-4de2-8cde-c8a281636dc9 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:51.597617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea4d51-09a2-4de2-8cde-c8a281636dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:51.598113 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea4d51-09a2-4de2-8cde-c8a281636dc9 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:51.599530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 142/297] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:51.606292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde5dd-61e2-494f-b77a-db31fc1f0b43 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:51.606843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde5dd-61e2-494f-b77a-db31fc1f0b43 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:51.607365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde5dd-61e2-494f-b77a-db31fc1f0b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:51.615937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5c309-1503-452a-9cc8-5ad6b34bc926 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:51.633838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-96bde5dd-61e2-494f-b77a-db31fc1f0b43 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:51.635455 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-96bde5dd-61e2-494f-b77a-db31fc1f0b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:51.651223 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8f509-f938-4790-9e6e-23879caf9a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:51.652025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f509-f938-4790-9e6e-23879caf9a9e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:51.652462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f509-f938-4790-9e6e-23879caf9a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:51.652884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f509-f938-4790-9e6e-23879caf9a9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:51.664272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8f509-f938-4790-9e6e-23879caf9a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-b8f8f509-f938-4790-9e6e-23879caf9a9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:51.672256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:51.673308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:51.674320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:51.681120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 156/298] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:51.682507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8f509-f938-4790-9e6e-23879caf9a9e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:51.702831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:51.706533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:51.713287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 143/299] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:27:51.726570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a757176-f52d-4dc6-b149-e9b1f1fd44ce None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:51.726802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a757176-f52d-4dc6-b149-e9b1f1fd44ce None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:51.727077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a757176-f52d-4dc6-b149-e9b1f1fd44ce None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:51.732242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 144/300] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:51.733362 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3f6c3-1ae2-4a7c-8368-c41d4cbe5184 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:51.733649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3f6c3-1ae2-4a7c-8368-c41d4cbe5184 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:51.733926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3f6c3-1ae2-4a7c-8368-c41d4cbe5184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:51.750746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b0d3f6c3-1ae2-4a7c-8368-c41d4cbe5184 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:51.751963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b0d3f6c3-1ae2-4a7c-8368-c41d4cbe5184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:51.791596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8f509-f938-4790-9e6e-23879caf9a9e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:51.822790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 145/301] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:51.823953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3f6c3-1ae2-4a7c-8368-c41d4cbe5184 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:51.836003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed7c21-109a-46dc-9226-3025540d9c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:51.837298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed7c21-109a-46dc-9226-3025540d9c1a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:51.838130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed7c21-109a-46dc-9226-3025540d9c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:51.838650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed7c21-109a-46dc-9226-3025540d9c1a None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:51.839837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed7c21-109a-46dc-9226-3025540d9c1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:51.840312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed7c21-109a-46dc-9226-3025540d9c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:51.842671 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed7c21-109a-46dc-9226-3025540d9c1a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:51.852322 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 157/302] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:51.853321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed7c21-109a-46dc-9226-3025540d9c1a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:51.934427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:51.936534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3f6c3-1ae2-4a7c-8368-c41d4cbe5184 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:51.955455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed7c21-109a-46dc-9226-3025540d9c1a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:51.961363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:51.972518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166f04a-f133-4fae-8c5b-2800b87fc469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:51.973311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f04a-f133-4fae-8c5b-2800b87fc469 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:51.973597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f04a-f133-4fae-8c5b-2800b87fc469 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:51.973875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f04a-f133-4fae-8c5b-2800b87fc469 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:51.984397 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166f04a-f133-4fae-8c5b-2800b87fc469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:51.993389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298ddfd-792d-467d-8579-521b84047e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-f166f04a-f133-4fae-8c5b-2800b87fc469 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:51.993956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:51.995008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:51.995832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:51.996448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298ddfd-792d-467d-8579-521b84047e55 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:51.996448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298ddfd-792d-467d-8579-521b84047e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:51.996448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298ddfd-792d-467d-8579-521b84047e55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:51.996448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298ddfd-792d-467d-8579-521b84047e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:51.997419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298ddfd-792d-467d-8579-521b84047e55 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:51.999024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 146/303] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:51.999815 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166f04a-f133-4fae-8c5b-2800b87fc469 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:52.004739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 158/304] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:52.005574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298ddfd-792d-467d-8579-521b84047e55 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:52.106466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166f04a-f133-4fae-8c5b-2800b87fc469 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:52.125694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298ddfd-792d-467d-8579-521b84047e55 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:52.149589 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1eb9a7-ea9b-44ea-be29-3ac787b556a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:52.150490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eb9a7-ea9b-44ea-be29-3ac787b556a6 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:52.150772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eb9a7-ea9b-44ea-be29-3ac787b556a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:52.151045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eb9a7-ea9b-44ea-be29-3ac787b556a6 None admin] PATH_INFO: `/v3/users/366621e532c34aa6a381c335809a861d` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:52.152285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1eb9a7-ea9b-44ea-be29-3ac787b556a6 None admin] RBAC: Authorizing `identity:get_user(user_id=366621e532c34aa6a381c335809a861d)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:52.153715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1eb9a7-ea9b-44ea-be29-3ac787b556a6 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:52.155681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 147/305] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:51 2022] GET /identity/v3/users/366621e532c34aa6a381c335809a861d => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:52.156428 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1eb9a7-ea9b-44ea-be29-3ac787b556a6 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:52.166054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f664eb-97f9-407a-a756-ee39366fdd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:52.167131 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f664eb-97f9-407a-a756-ee39366fdd1c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:52.167131 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f664eb-97f9-407a-a756-ee39366fdd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:52.167338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f664eb-97f9-407a-a756-ee39366fdd1c None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:52.168065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f664eb-97f9-407a-a756-ee39366fdd1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:52.168370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f664eb-97f9-407a-a756-ee39366fdd1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:52.169736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f664eb-97f9-407a-a756-ee39366fdd1c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:52.178985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 159/306] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:52.180129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f664eb-97f9-407a-a756-ee39366fdd1c None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:52.193602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:52.219125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:52.271796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1eb9a7-ea9b-44ea-be29-3ac787b556a6 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:52.283549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f664eb-97f9-407a-a756-ee39366fdd1c None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:52.310809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaca64-0c80-4e28-952a-89961a36430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:52.311481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaca64-0c80-4e28-952a-89961a36430b None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:52.311764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaca64-0c80-4e28-952a-89961a36430b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:52.312038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaca64-0c80-4e28-952a-89961a36430b None admin] PATH_INFO: `/v3/groups` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:52.312823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaca64-0c80-4e28-952a-89961a36430b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:52.314305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaca64-0c80-4e28-952a-89961a36430b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:52.321580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41967a-777b-4d95-82c5-8edc21b0b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:52.322507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41967a-777b-4d95-82c5-8edc21b0b45b None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:52.322792 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41967a-777b-4d95-82c5-8edc21b0b45b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:52.323067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41967a-777b-4d95-82c5-8edc21b0b45b None admin] PATH_INFO: `/v3/system/users/366621e532c34aa6a381c335809a861d/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:52.325015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41967a-777b-4d95-82c5-8edc21b0b45b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=366621e532c34aa6a381c335809a861d, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:52.326460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41967a-777b-4d95-82c5-8edc21b0b45b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:52.384175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 148/307] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Jun 8 06:27:52 2022] POST /identity/v3/groups => generated 229 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:52.385161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaca64-0c80-4e28-952a-89961a36430b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:52.408294 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 160/308] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Jun 8 06:27:52 2022] PUT /identity/v3/system/users/366621e532c34aa6a381c335809a861d/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:52.515580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaca64-0c80-4e28-952a-89961a36430b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:52.531099 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:52.557409 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1f194-7948-4acc-80af-0067dfd7a1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:52.558411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1f194-7948-4acc-80af-0067dfd7a1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:52.558697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1f194-7948-4acc-80af-0067dfd7a1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:52.558976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1f194-7948-4acc-80af-0067dfd7a1d2 None admin] PATH_INFO: `/v3/users/282b255a9a544cefb1afecc10a332c93` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:52.576574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1f194-7948-4acc-80af-0067dfd7a1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=282b255a9a544cefb1afecc10a332c93)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:52.578192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1f194-7948-4acc-80af-0067dfd7a1d2 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:52.580563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 149/309] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:52 2022] GET /identity/v3/users/282b255a9a544cefb1afecc10a332c93 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:52.587465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41967a-777b-4d95-82c5-8edc21b0b45b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:52.681194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c86da-0467-47f1-8d8b-ea6f2d9bbc85 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:52.682323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c86da-0467-47f1-8d8b-ea6f2d9bbc85 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:52.682614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c86da-0467-47f1-8d8b-ea6f2d9bbc85 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:52.684014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 150/310] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:52.688791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:52.689882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2a185-4f74-4c1d-aa44-49ef07a65917 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:52.690195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2a185-4f74-4c1d-aa44-49ef07a65917 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:52.690470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2a185-4f74-4c1d-aa44-49ef07a65917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:52.711005 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-71e2a185-4f74-4c1d-aa44-49ef07a65917 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:52.712189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-71e2a185-4f74-4c1d-aa44-49ef07a65917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:52.714436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41967a-777b-4d95-82c5-8edc21b0b45b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:52.762096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16ea86-b467-4cc1-9cdb-f89c2f392aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:52.763174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ea86-b467-4cc1-9cdb-f89c2f392aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:52.763616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ea86-b467-4cc1-9cdb-f89c2f392aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:52.764079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ea86-b467-4cc1-9cdb-f89c2f392aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:52.765073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16ea86-b467-4cc1-9cdb-f89c2f392aa6 None admin] RBAC: Adding query filter params (role.id=24b48a19f5e94098b75009d75bdc90d9, user.id=282b255a9a544cefb1afecc10a332c93, scope.system=all) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:52.765546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16ea86-b467-4cc1-9cdb-f89c2f392aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:52.767238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16ea86-b467-4cc1-9cdb-f89c2f392aa6 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:52.773537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 161/311] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Jun 8 06:27:52 2022] GET /identity/v3/role_assignments?user.id=282b255a9a544cefb1afecc10a332c93&scope.system=all&role.id=24b48a19f5e94098b75009d75bdc90d9 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:52.795323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 151/312] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:27:52.819354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16ea86-b467-4cc1-9cdb-f89c2f392aa6 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:52.933011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16ea86-b467-4cc1-9cdb-f89c2f392aa6 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:52.971290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504e48f-8485-4490-8707-42b0f51450ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:52.972108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e48f-8485-4490-8707-42b0f51450ef None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:52.972395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e48f-8485-4490-8707-42b0f51450ef None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:52.976629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504e48f-8485-4490-8707-42b0f51450ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:52.987363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:52.992693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504e48f-8485-4490-8707-42b0f51450ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-c504e48f-8485-4490-8707-42b0f51450ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:53.000627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:53.001576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:53.002475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 162/313] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:53.010232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2a185-4f74-4c1d-aa44-49ef07a65917 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:53.123287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2a185-4f74-4c1d-aa44-49ef07a65917 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:53.130604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:53.168960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb21ba-5cde-413b-986b-092070aab64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:53.170033 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb21ba-5cde-413b-986b-092070aab64b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:53.170573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb21ba-5cde-413b-986b-092070aab64b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:53.170985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb21ba-5cde-413b-986b-092070aab64b None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:53.171888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb21ba-5cde-413b-986b-092070aab64b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:53.172329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb21ba-5cde-413b-986b-092070aab64b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:53.173844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb21ba-5cde-413b-986b-092070aab64b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:53.185755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 152/314] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:53.192480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504e48f-8485-4490-8707-42b0f51450ef None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:53.305372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504e48f-8485-4490-8707-42b0f51450ef None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:53.349644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b02b-a3a8-4293-9a6a-9fa7a458d815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:53.350801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b02b-a3a8-4293-9a6a-9fa7a458d815 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:53.351318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b02b-a3a8-4293-9a6a-9fa7a458d815 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:53.351726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b02b-a3a8-4293-9a6a-9fa7a458d815 None admin] PATH_INFO: `/v3/users/355b67d9f2474217839fbae7f31039a4` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:53.353052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491b02b-a3a8-4293-9a6a-9fa7a458d815 None admin] RBAC: Authorizing `identity:get_user(user_id=355b67d9f2474217839fbae7f31039a4)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:53.354661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491b02b-a3a8-4293-9a6a-9fa7a458d815 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:53.356836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 163/315] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:53 2022] GET /identity/v3/users/355b67d9f2474217839fbae7f31039a4 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:53.367460 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb21ba-5cde-413b-986b-092070aab64b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:53.478923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb21ba-5cde-413b-986b-092070aab64b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:53.518705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a5995-3949-492b-898a-dd602e3292d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:53.519622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a5995-3949-492b-898a-dd602e3292d1 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:53.520088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a5995-3949-492b-898a-dd602e3292d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:53.520527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a5995-3949-492b-898a-dd602e3292d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:53.555692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:53.600373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a5995-3949-492b-898a-dd602e3292d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:53.602408 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a5995-3949-492b-898a-dd602e3292d1 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:53.710002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 153/316] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:53.715698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b02b-a3a8-4293-9a6a-9fa7a458d815 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:53.784823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:53.820007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b02b-a3a8-4293-9a6a-9fa7a458d815 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:53.855382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b4a7e-1584-422e-ba61-acf1f8607809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:53.856240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b4a7e-1584-422e-ba61-acf1f8607809 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:53.856519 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b4a7e-1584-422e-ba61-acf1f8607809 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:53.856789 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b4a7e-1584-422e-ba61-acf1f8607809 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:53.857967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b4a7e-1584-422e-ba61-acf1f8607809 None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:53.859428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b4a7e-1584-422e-ba61-acf1f8607809 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:53.861465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 164/317] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:53 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:53.867828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a5995-3949-492b-898a-dd602e3292d1 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:53.930615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:53.968047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a5995-3949-492b-898a-dd602e3292d1 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:54.005402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1492204-023b-420f-ae61-e39ccd41a166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:54.006565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1492204-023b-420f-ae61-e39ccd41a166 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:54.007086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1492204-023b-420f-ae61-e39ccd41a166 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:54.008001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1492204-023b-420f-ae61-e39ccd41a166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:54.008834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1492204-023b-420f-ae61-e39ccd41a166 None admin] RBAC: Adding query filter params (role.id=24b48a19f5e94098b75009d75bdc90d9, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe, user.id=355b67d9f2474217839fbae7f31039a4) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:54.009144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1492204-023b-420f-ae61-e39ccd41a166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:54.010597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1492204-023b-420f-ae61-e39ccd41a166 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:54.016864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 154/318] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:27:53 2022] GET /identity/v3/role_assignments?user.id=355b67d9f2474217839fbae7f31039a4&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=24b48a19f5e94098b75009d75bdc90d9 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:54.846573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ffb3a-5a09-4c32-877f-514a561a117c None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:54.847084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ffb3a-5a09-4c32-877f-514a561a117c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:54.847156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ffb3a-5a09-4c32-877f-514a561a117c None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:54.848517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 165/319] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:54.853547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c568ad4-a31f-4d1b-9004-536ef116e6cd None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:54.853947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c568ad4-a31f-4d1b-9004-536ef116e6cd None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:54.854117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c568ad4-a31f-4d1b-9004-536ef116e6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:54.869738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f20934-c597-4f88-9fc9-6d9d0ca9bd0f None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:54.870046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f20934-c597-4f88-9fc9-6d9d0ca9bd0f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:54.870326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f20934-c597-4f88-9fc9-6d9d0ca9bd0f None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:54.870895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-4c568ad4-a31f-4d1b-9004-536ef116e6cd None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:54.871721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 166/320] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:27:54.872082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4c568ad4-a31f-4d1b-9004-536ef116e6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:54.876994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2117129-b67b-4f96-821b-5c04c0a7e102 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:54.877325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2117129-b67b-4f96-821b-5c04c0a7e102 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:54.877607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2117129-b67b-4f96-821b-5c04c0a7e102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:54.894431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e2117129-b67b-4f96-821b-5c04c0a7e102 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:54.895605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e2117129-b67b-4f96-821b-5c04c0a7e102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:54.946139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 155/321] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:54.963377 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c568ad4-a31f-4d1b-9004-536ef116e6cd None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:54.970287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 167/322] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:27:54.991195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2117129-b67b-4f96-821b-5c04c0a7e102 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:55.024837 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:55.055762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:55.070533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c568ad4-a31f-4d1b-9004-536ef116e6cd None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:55.097193 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2117129-b67b-4f96-821b-5c04c0a7e102 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:55.109135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce2a6c-10ae-447b-81b7-730abd7956ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:55.110270 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce2a6c-10ae-447b-81b7-730abd7956ef None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:55.110693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce2a6c-10ae-447b-81b7-730abd7956ef None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:55.111104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce2a6c-10ae-447b-81b7-730abd7956ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:55.112431 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce2a6c-10ae-447b-81b7-730abd7956ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:55.114012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce2a6c-10ae-447b-81b7-730abd7956ef None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:55.115803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 156/323] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:27:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:55.119597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c1770-2b61-4815-836f-9cec024bd90c None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:55.119887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c1770-2b61-4815-836f-9cec024bd90c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:55.120263 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c1770-2b61-4815-836f-9cec024bd90c None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:55.123271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 157/324] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:55.123271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c1770-2b61-4815-836f-9cec024bd90c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:55.134654 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce23843-499d-4be0-b84e-ce9bfab32262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:55.135447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce23843-499d-4be0-b84e-ce9bfab32262 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:55.135729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce23843-499d-4be0-b84e-ce9bfab32262 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:55.136003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce23843-499d-4be0-b84e-ce9bfab32262 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:55.148102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce23843-499d-4be0-b84e-ce9bfab32262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-9ce23843-499d-4be0-b84e-ce9bfab32262 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:55.155786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:55.156750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:55.157850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 168/325] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:27:55.159347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee26416-cda3-4129-a072-27c2c00575d6 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:55.159638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee26416-cda3-4129-a072-27c2c00575d6 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:55.159905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee26416-cda3-4129-a072-27c2c00575d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:55.176413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0ee26416-cda3-4129-a072-27c2c00575d6 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:55.177579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0ee26416-cda3-4129-a072-27c2c00575d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:55.228352 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c1770-2b61-4815-836f-9cec024bd90c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:55.241481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 169/326] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:55.242323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee26416-cda3-4129-a072-27c2c00575d6 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:55.257291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:55.268770 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52082-7628-4e72-9061-45a9dd9e5245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:55.269434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52082-7628-4e72-9061-45a9dd9e5245 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:55.269715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52082-7628-4e72-9061-45a9dd9e5245 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:55.269990 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52082-7628-4e72-9061-45a9dd9e5245 None admin] PATH_INFO: `/v3/groups` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:55.270753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c52082-7628-4e72-9061-45a9dd9e5245 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:55.272181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c52082-7628-4e72-9061-45a9dd9e5245 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:55.297455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:55.339620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee26416-cda3-4129-a072-27c2c00575d6 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:55.362676 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 158/327] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Jun 8 06:27:55 2022] POST /identity/v3/groups => generated 226 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:27:55.363526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52082-7628-4e72-9061-45a9dd9e5245 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:55.371726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd973d49-b6eb-45c1-b394-ddcbf9fd1346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:55.372420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd973d49-b6eb-45c1-b394-ddcbf9fd1346 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:55.372712 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd973d49-b6eb-45c1-b394-ddcbf9fd1346 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:55.373000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd973d49-b6eb-45c1-b394-ddcbf9fd1346 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:55.373860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd973d49-b6eb-45c1-b394-ddcbf9fd1346 None admin] RBAC: Adding query filter params (name=member) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:55.374166 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd973d49-b6eb-45c1-b394-ddcbf9fd1346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:55.375635 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd973d49-b6eb-45c1-b394-ddcbf9fd1346 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:55.390475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 170/328] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:55.391563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd973d49-b6eb-45c1-b394-ddcbf9fd1346 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:55.477154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52082-7628-4e72-9061-45a9dd9e5245 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:55.503601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd973d49-b6eb-45c1-b394-ddcbf9fd1346 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:55.513143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc17842-1e37-4128-bf5c-779ba40e3f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:55.513955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc17842-1e37-4128-bf5c-779ba40e3f73 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:55.514231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc17842-1e37-4128-bf5c-779ba40e3f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:55.514539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc17842-1e37-4128-bf5c-779ba40e3f73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:55.522910 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:55.527781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc17842-1e37-4128-bf5c-779ba40e3f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-ebc17842-1e37-4128-bf5c-779ba40e3f73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:55.535420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:55.536378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:55.537314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 159/329] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:55.542681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc17842-1e37-4128-bf5c-779ba40e3f73 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:55.544075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9e874-4ed5-40db-b181-d09af72fd56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:55.545191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9e874-4ed5-40db-b181-d09af72fd56d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:55.545474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9e874-4ed5-40db-b181-d09af72fd56d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:55.545756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9e874-4ed5-40db-b181-d09af72fd56d None admin] PATH_INFO: `/v3/users/366621e532c34aa6a381c335809a861d` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:55.547098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9e874-4ed5-40db-b181-d09af72fd56d None admin] RBAC: Authorizing `identity:get_user(user_id=366621e532c34aa6a381c335809a861d)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:55.548588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9e874-4ed5-40db-b181-d09af72fd56d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:55.550479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 171/330] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:55 2022] GET /identity/v3/users/366621e532c34aa6a381c335809a861d => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:55.556252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9e874-4ed5-40db-b181-d09af72fd56d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:55.603429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:55.676827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc17842-1e37-4128-bf5c-779ba40e3f73 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:55.680736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9e874-4ed5-40db-b181-d09af72fd56d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:55.721013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc8576-86a0-47e0-99f1-91af289cdc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:55.721330 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf100f-f6af-46d1-8eca-ede9a3f721d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:55.721672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc8576-86a0-47e0-99f1-91af289cdc90 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:55.721928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf100f-f6af-46d1-8eca-ede9a3f721d5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:55.722021 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc8576-86a0-47e0-99f1-91af289cdc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:55.722206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc8576-86a0-47e0-99f1-91af289cdc90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:55.722317 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf100f-f6af-46d1-8eca-ede9a3f721d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:55.722512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf100f-f6af-46d1-8eca-ede9a3f721d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:55.723078 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc8576-86a0-47e0-99f1-91af289cdc90 None admin] RBAC: Adding query filter params (role.id=5c89d9dc8b0949b98573064d572f981a, user.id=366621e532c34aa6a381c335809a861d, scope.system=all) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:55.723273 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf100f-f6af-46d1-8eca-ede9a3f721d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:55.723374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc8576-86a0-47e0-99f1-91af289cdc90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:55.723579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf100f-f6af-46d1-8eca-ede9a3f721d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:55.724790 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc8576-86a0-47e0-99f1-91af289cdc90 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:55.724944 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf100f-f6af-46d1-8eca-ede9a3f721d5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:55.736233 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 160/331] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:55.741381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 172/332] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Jun 8 06:27:55 2022] GET /identity/v3/role_assignments?user.id=366621e532c34aa6a381c335809a861d&scope.system=all&role.id=5c89d9dc8b0949b98573064d572f981a => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:55.742521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf100f-f6af-46d1-8eca-ede9a3f721d5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:55.871333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf100f-f6af-46d1-8eca-ede9a3f721d5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:55.882078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:55.918572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a004ae4-3e96-45e7-b868-226b6e9f14d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:55.919861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a004ae4-3e96-45e7-b868-226b6e9f14d0 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:55.920375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a004ae4-3e96-45e7-b868-226b6e9f14d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:55.920848 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a004ae4-3e96-45e7-b868-226b6e9f14d0 None admin] PATH_INFO: `/v3/users/282b255a9a544cefb1afecc10a332c93` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:55.924624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a004ae4-3e96-45e7-b868-226b6e9f14d0 None admin] RBAC: Authorizing `identity:get_user(user_id=282b255a9a544cefb1afecc10a332c93)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:55.926533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a004ae4-3e96-45e7-b868-226b6e9f14d0 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:55.928615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 161/333] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:27:55 2022] GET /identity/v3/users/282b255a9a544cefb1afecc10a332c93 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:27:55.935632 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc8576-86a0-47e0-99f1-91af289cdc90 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:55.991329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:56.052789 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc8576-86a0-47e0-99f1-91af289cdc90 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:56.087949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abd897-1dc0-4c5a-a53d-3e4d8ae43c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:56.088815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd897-1dc0-4c5a-a53d-3e4d8ae43c48 None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:56.089096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd897-1dc0-4c5a-a53d-3e4d8ae43c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:56.089368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd897-1dc0-4c5a-a53d-3e4d8ae43c48 None admin] PATH_INFO: `/v3/system/users/282b255a9a544cefb1afecc10a332c93/roles/24b48a19f5e94098b75009d75bdc90d9` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:56.090897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abd897-1dc0-4c5a-a53d-3e4d8ae43c48 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=282b255a9a544cefb1afecc10a332c93, role_id=24b48a19f5e94098b75009d75bdc90d9)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:56.092274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abd897-1dc0-4c5a-a53d-3e4d8ae43c48 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:56.159101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 173/334] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Jun 8 06:27:55 2022] PUT /identity/v3/system/users/282b255a9a544cefb1afecc10a332c93/roles/24b48a19f5e94098b75009d75bdc90d9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:27:58.460322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d35df-2a5f-47fa-a85c-11c17fed863d None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:58.460852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d35df-2a5f-47fa-a85c-11c17fed863d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:58.460852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d35df-2a5f-47fa-a85c-11c17fed863d None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:58.462408 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 162/335] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:58.468184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca96c0-ded6-4529-89fd-9d9e067dc068 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:58.468625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca96c0-ded6-4529-89fd-9d9e067dc068 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:58.468732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca96c0-ded6-4529-89fd-9d9e067dc068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:58.495227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-09ca96c0-ded6-4529-89fd-9d9e067dc068 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:58.499844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-09ca96c0-ded6-4529-89fd-9d9e067dc068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:58.499960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1f687-ebc3-401f-b16d-2ba4283b606c None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:58.499960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1f687-ebc3-401f-b16d-2ba4283b606c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:58.499960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1f687-ebc3-401f-b16d-2ba4283b606c None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:58.500299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 163/336] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:58.506583 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbf9f8-d05c-45ca-826f-6677c45c3ccd None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:58.507159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbf9f8-d05c-45ca-826f-6677c45c3ccd None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:58.507655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbf9f8-d05c-45ca-826f-6677c45c3ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:58.530440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-81fbf9f8-d05c-45ca-826f-6677c45c3ccd None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:58.531958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-81fbf9f8-d05c-45ca-826f-6677c45c3ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:58.611377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 174/337] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:58.630763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 164/338] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:58.654033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca96c0-ded6-4529-89fd-9d9e067dc068 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:58.668705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbf9f8-d05c-45ca-826f-6677c45c3ccd None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:58.729574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:58.788775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbf9f8-d05c-45ca-826f-6677c45c3ccd None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:58.791252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:58.828654 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bc473-82a3-48e4-9b9c-4c094f08301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:58.829735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc473-82a3-48e4-9b9c-4c094f08301b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:58.830172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc473-82a3-48e4-9b9c-4c094f08301b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:58.830694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc473-82a3-48e4-9b9c-4c094f08301b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:58.852480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bc473-82a3-48e4-9b9c-4c094f08301b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-587bc473-82a3-48e4-9b9c-4c094f08301b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:58.862540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:58.863641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:27:58.864635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:27:58.872477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca96c0-ded6-4529-89fd-9d9e067dc068 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:58.874555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 165/339] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:27:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:58.880465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11beb4-402c-4534-a8ad-3fb1cdca0ca6 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:58.885592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11beb4-402c-4534-a8ad-3fb1cdca0ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:58.886064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11beb4-402c-4534-a8ad-3fb1cdca0ca6 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:58.891564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 166/340] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:58.893742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9883fae-b3bd-4780-8799-8f95841c47d4 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:58.895691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9883fae-b3bd-4780-8799-8f95841c47d4 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:58.896133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9883fae-b3bd-4780-8799-8f95841c47d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:58.931356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-f9883fae-b3bd-4780-8799-8f95841c47d4 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:58.934110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f9883fae-b3bd-4780-8799-8f95841c47d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:27:58.950546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2e63b-0d76-4238-8a62-248311d1f5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:58.951624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2e63b-0d76-4238-8a62-248311d1f5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:58.952041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2e63b-0d76-4238-8a62-248311d1f5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:58.952449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2e63b-0d76-4238-8a62-248311d1f5b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:58.972642 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2e63b-0d76-4238-8a62-248311d1f5b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-98e2e63b-0d76-4238-8a62-248311d1f5b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:58.980586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:58.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:58.982613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:58.993696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 175/341] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:58.995493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2e63b-0d76-4238-8a62-248311d1f5b6 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:59.072656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 167/342] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:27:59.076895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9883fae-b3bd-4780-8799-8f95841c47d4 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:59.178751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:59.187874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2e63b-0d76-4238-8a62-248311d1f5b6 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:59.242773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:59.252240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba0b8b-3639-4be2-a51b-8ab79b25ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:59.258265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba0b8b-3639-4be2-a51b-8ab79b25ba92 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:59.258265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba0b8b-3639-4be2-a51b-8ab79b25ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:59.258265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba0b8b-3639-4be2-a51b-8ab79b25ba92 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:59.258265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba0b8b-3639-4be2-a51b-8ab79b25ba92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:59.258265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba0b8b-3639-4be2-a51b-8ab79b25ba92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:59.258630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9883fae-b3bd-4780-8799-8f95841c47d4 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:59.259507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba0b8b-3639-4be2-a51b-8ab79b25ba92 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:59.276830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 176/343] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:27:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:59.277680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba0b8b-3639-4be2-a51b-8ab79b25ba92 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:59.322285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094ba6-b377-4d76-8bab-76e27183b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:59.322975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094ba6-b377-4d76-8bab-76e27183b3ff None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:59.323259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094ba6-b377-4d76-8bab-76e27183b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:59.323536 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094ba6-b377-4d76-8bab-76e27183b3ff None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:59.324299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50094ba6-b377-4d76-8bab-76e27183b3ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:59.324862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50094ba6-b377-4d76-8bab-76e27183b3ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:59.326267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50094ba6-b377-4d76-8bab-76e27183b3ff None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:59.349600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 168/344] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:59.350600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094ba6-b377-4d76-8bab-76e27183b3ff None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:59.453537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba0b8b-3639-4be2-a51b-8ab79b25ba92 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:59.491198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69448645-370d-4562-8312-4b1f0742d34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:59.491999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448645-370d-4562-8312-4b1f0742d34c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:59.492283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448645-370d-4562-8312-4b1f0742d34c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:59.492558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448645-370d-4562-8312-4b1f0742d34c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:59.497417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094ba6-b377-4d76-8bab-76e27183b3ff None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:59.503526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69448645-370d-4562-8312-4b1f0742d34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-69448645-370d-4562-8312-4b1f0742d34c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:27:59.511432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:27:59.512527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:27:59.513529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:27:59.515864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 177/345] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:27:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:27:59.516815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69448645-370d-4562-8312-4b1f0742d34c None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:59.537267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4643fa9-afe7-48fc-982b-14447f2b8e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:59.539044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4643fa9-afe7-48fc-982b-14447f2b8e4f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:59.539326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4643fa9-afe7-48fc-982b-14447f2b8e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:59.539603 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4643fa9-afe7-48fc-982b-14447f2b8e4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:59.544461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:59.572160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:59.617597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4643fa9-afe7-48fc-982b-14447f2b8e4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:59.620776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4643fa9-afe7-48fc-982b-14447f2b8e4f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:59.639469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69448645-370d-4562-8312-4b1f0742d34c None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:59.677049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4caf-648a-4e63-9e57-efed063b5c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:59.678084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4caf-648a-4e63-9e57-efed063b5c20 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:59.678559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4caf-648a-4e63-9e57-efed063b5c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:59.678995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4caf-648a-4e63-9e57-efed063b5c20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:59.753925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 169/346] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:59.757482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f53f8-68ec-4bda-b0cb-900752ebd230 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:59.757482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f53f8-68ec-4bda-b0cb-900752ebd230 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:59.757482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f53f8-68ec-4bda-b0cb-900752ebd230 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:59.761564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 170/347] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:27:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:27:59.762615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f53f8-68ec-4bda-b0cb-900752ebd230 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:59.774811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f4caf-648a-4e63-9e57-efed063b5c20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:59.776284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f4caf-648a-4e63-9e57-efed063b5c20 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:59.798166 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:59.838653 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:27:59.910262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f53f8-68ec-4bda-b0cb-900752ebd230 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:27:59.914401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 178/348] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:27:59.915304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4caf-648a-4e63-9e57-efed063b5c20 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:27:59.958035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86326c0-0aeb-444a-84a4-779c0fa7292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:27:59.958806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86326c0-0aeb-444a-84a4-779c0fa7292f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:59.959092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86326c0-0aeb-444a-84a4-779c0fa7292f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:59.959368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86326c0-0aeb-444a-84a4-779c0fa7292f None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:59.960124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86326c0-0aeb-444a-84a4-779c0fa7292f None admin] RBAC: Adding query filter params (name=member) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:27:59.960433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86326c0-0aeb-444a-84a4-779c0fa7292f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:27:59.965357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86326c0-0aeb-444a-84a4-779c0fa7292f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:27:59.975879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 171/349] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:27:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:27:59.977444 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c15515-ddc5-43a9-935f-7eb0eb966bb5 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:27:59.977735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c15515-ddc5-43a9-935f-7eb0eb966bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:27:59.978010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c15515-ddc5-43a9-935f-7eb0eb966bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:27:59.995420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-49c15515-ddc5-43a9-935f-7eb0eb966bb5 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:27:59.997245 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-49c15515-ddc5-43a9-935f-7eb0eb966bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:00.038787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4caf-648a-4e63-9e57-efed063b5c20 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:00.067071 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:00.076308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 172/350] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:00.077474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31efb4-2f87-4d0e-aba8-82d4d708f295 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.077766 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31efb4-2f87-4d0e-aba8-82d4d708f295 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.078048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31efb4-2f87-4d0e-aba8-82d4d708f295 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.079413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 173/351] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:00.084423 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31efb4-2f87-4d0e-aba8-82d4d708f295 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:00.100070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61ab3d-99f2-4afe-8102-2da9967e48bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:00.101536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61ab3d-99f2-4afe-8102-2da9967e48bc None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.102567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61ab3d-99f2-4afe-8102-2da9967e48bc None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.103072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61ab3d-99f2-4afe-8102-2da9967e48bc None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.104649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61ab3d-99f2-4afe-8102-2da9967e48bc None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:00.107232 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61ab3d-99f2-4afe-8102-2da9967e48bc None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:00.110056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 179/352] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:27:59 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:00.111347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61ab3d-99f2-4afe-8102-2da9967e48bc None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:00.145130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:00.214515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31efb4-2f87-4d0e-aba8-82d4d708f295 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:00.237305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61ab3d-99f2-4afe-8102-2da9967e48bc None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:00.254138 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965a9fa-6ed9-4657-a153-38751ea7628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:00.255048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965a9fa-6ed9-4657-a153-38751ea7628e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.255327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965a9fa-6ed9-4657-a153-38751ea7628e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.255631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965a9fa-6ed9-4657-a153-38751ea7628e None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.256812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965a9fa-6ed9-4657-a153-38751ea7628e None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:00.258285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965a9fa-6ed9-4657-a153-38751ea7628e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:00.260824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 174/353] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:00 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:00.261774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482446b1-0751-4611-903c-7818c85f9f74 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.262052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482446b1-0751-4611-903c-7818c85f9f74 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.266777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482446b1-0751-4611-903c-7818c85f9f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.279838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518e2d3-73dd-49d2-ae59-42f02f171971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:00.280584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e2d3-73dd-49d2-ae59-42f02f171971 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.280867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e2d3-73dd-49d2-ae59-42f02f171971 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.281140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e2d3-73dd-49d2-ae59-42f02f171971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.284295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-482446b1-0751-4611-903c-7818c85f9f74 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:00.285470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-482446b1-0751-4611-903c-7818c85f9f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:00.346197 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:00.360163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518e2d3-73dd-49d2-ae59-42f02f171971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:00.362132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518e2d3-73dd-49d2-ae59-42f02f171971 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:00.366509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 175/354] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:00.367362 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482446b1-0751-4611-903c-7818c85f9f74 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:00.425970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:00.483030 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 180/355] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:00.483881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518e2d3-73dd-49d2-ae59-42f02f171971 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:00.484570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482446b1-0751-4611-903c-7818c85f9f74 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:00.527282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757d0b2-a2b6-45cc-9749-46be423144d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:00.528083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757d0b2-a2b6-45cc-9749-46be423144d8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.528366 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757d0b2-a2b6-45cc-9749-46be423144d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.528639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757d0b2-a2b6-45cc-9749-46be423144d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.539801 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757d0b2-a2b6-45cc-9749-46be423144d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-1757d0b2-a2b6-45cc-9749-46be423144d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:00.547551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:00.548611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:00.549950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 176/356] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:00.550946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227683-bf9d-48be-961c-c71f31f40d0d None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.551193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227683-bf9d-48be-961c-c71f31f40d0d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.551467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227683-bf9d-48be-961c-c71f31f40d0d None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.552748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 177/357] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:00.556762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec227683-bf9d-48be-961c-c71f31f40d0d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:00.590526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:00.605819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518e2d3-73dd-49d2-ae59-42f02f171971 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:00.645435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45e7ee-c132-4610-8355-313355484c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:00.646345 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45e7ee-c132-4610-8355-313355484c3b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.646628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45e7ee-c132-4610-8355-313355484c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.646901 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45e7ee-c132-4610-8355-313355484c3b None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.655534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45e7ee-c132-4610-8355-313355484c3b None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:00.656989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45e7ee-c132-4610-8355-313355484c3b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:00.659581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 181/358] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:00 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:00.660374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45e7ee-c132-4610-8355-313355484c3b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:00.689594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec227683-bf9d-48be-961c-c71f31f40d0d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:00.697601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:00.729406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6957af-0002-45b6-9739-9d05bf41977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:00.730297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6957af-0002-45b6-9739-9d05bf41977f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.730588 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6957af-0002-45b6-9739-9d05bf41977f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.730860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6957af-0002-45b6-9739-9d05bf41977f None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.732159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6957af-0002-45b6-9739-9d05bf41977f None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:00.733895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6957af-0002-45b6-9739-9d05bf41977f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:00.736313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 178/359] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:00 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:00.737813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6957af-0002-45b6-9739-9d05bf41977f None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:00.784320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45e7ee-c132-4610-8355-313355484c3b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:00.821381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0367a-6b39-4244-b32d-f24597e7c557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:00.822188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0367a-6b39-4244-b32d-f24597e7c557 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.822494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0367a-6b39-4244-b32d-f24597e7c557 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.822754 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0367a-6b39-4244-b32d-f24597e7c557 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.838191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0367a-6b39-4244-b32d-f24597e7c557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-9db0367a-6b39-4244-b32d-f24597e7c557 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:00.846644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:00.847522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:00.848361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:00.852210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 182/360] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:28:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:00.852210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0367a-6b39-4244-b32d-f24597e7c557 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:00.856602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6957af-0002-45b6-9739-9d05bf41977f None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:00.862331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:00.899856 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2496f4-cd3a-4e3f-8a23-bbc67e6ab9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:00.900832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2496f4-cd3a-4e3f-8a23-bbc67e6ab9de None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.901465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2496f4-cd3a-4e3f-8a23-bbc67e6ab9de None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.901465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2496f4-cd3a-4e3f-8a23-bbc67e6ab9de None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.902582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2496f4-cd3a-4e3f-8a23-bbc67e6ab9de None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:00.904128 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2496f4-cd3a-4e3f-8a23-bbc67e6ab9de None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:00.906274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 179/361] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:00 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:00.907114 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089077e-bb98-4553-bc85-d0437da1b94b None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:00.907394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089077e-bb98-4553-bc85-d0437da1b94b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:00.907665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089077e-bb98-4553-bc85-d0437da1b94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:00.927387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c089077e-bb98-4553-bc85-d0437da1b94b None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:00.928565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c089077e-bb98-4553-bc85-d0437da1b94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:00.966705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0367a-6b39-4244-b32d-f24597e7c557 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:00.971550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:01.010415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01d633-d322-4ed6-a1a4-e135d2f750c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:01.011091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01d633-d322-4ed6-a1a4-e135d2f750c3 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:01.011371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01d633-d322-4ed6-a1a4-e135d2f750c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:01.011645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01d633-d322-4ed6-a1a4-e135d2f750c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:01.011992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 180/362] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:01.012919 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089077e-bb98-4553-bc85-d0437da1b94b None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:01.013642 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01d633-d322-4ed6-a1a4-e135d2f750c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:01.013954 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01d633-d322-4ed6-a1a4-e135d2f750c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:01.015580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01d633-d322-4ed6-a1a4-e135d2f750c3 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:01.025857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 183/363] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:28:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:01.027009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01d633-d322-4ed6-a1a4-e135d2f750c3 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:01.118586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:01.131599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089077e-bb98-4553-bc85-d0437da1b94b None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:01.150744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01d633-d322-4ed6-a1a4-e135d2f750c3 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:01.172573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446230e-0b77-4b0f-9a10-15f740b32c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:01.173229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446230e-0b77-4b0f-9a10-15f740b32c9c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:01.173506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446230e-0b77-4b0f-9a10-15f740b32c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:01.173779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446230e-0b77-4b0f-9a10-15f740b32c9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:01.176987 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446230e-0b77-4b0f-9a10-15f740b32c9c None admin] RBAC: Adding query filter params (group.id=21a8c622c3f14a04b165d84caee9cdd5, role.id=d27765da961f442fa1ab376c59342273, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:01.177299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446230e-0b77-4b0f-9a10-15f740b32c9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:01.178763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446230e-0b77-4b0f-9a10-15f740b32c9c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:01.186369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 181/364] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jun 8 06:28:01 2022] GET /identity/v3/role_assignments?group.id=21a8c622c3f14a04b165d84caee9cdd5&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=d27765da961f442fa1ab376c59342273 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:01.186369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446230e-0b77-4b0f-9a10-15f740b32c9c None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:01.191751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0b6c7-907b-485b-a6a5-83b15b5393d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:01.192428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0b6c7-907b-485b-a6a5-83b15b5393d4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:01.192710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0b6c7-907b-485b-a6a5-83b15b5393d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:01.192982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0b6c7-907b-485b-a6a5-83b15b5393d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:01.193833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0b6c7-907b-485b-a6a5-83b15b5393d4 None admin] RBAC: Adding query filter params (group.id=21a8c622c3f14a04b165d84caee9cdd5, role.id=5c89d9dc8b0949b98573064d572f981a, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:01.194797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0b6c7-907b-485b-a6a5-83b15b5393d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:01.196726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0b6c7-907b-485b-a6a5-83b15b5393d4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:01.204172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 184/365] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jun 8 06:28:01 2022] GET /identity/v3/role_assignments?group.id=21a8c622c3f14a04b165d84caee9cdd5&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=5c89d9dc8b0949b98573064d572f981a => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:01.211140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0b6c7-907b-485b-a6a5-83b15b5393d4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:01.229900 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:01.318260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446230e-0b77-4b0f-9a10-15f740b32c9c None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:01.333946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0b6c7-907b-485b-a6a5-83b15b5393d4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:01.362663 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493dd92-eee4-4bd7-be2d-338512b727ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:01.363717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493dd92-eee4-4bd7-be2d-338512b727ae None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:01.364284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493dd92-eee4-4bd7-be2d-338512b727ae None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:01.364742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493dd92-eee4-4bd7-be2d-338512b727ae None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:01.365857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493dd92-eee4-4bd7-be2d-338512b727ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:01.366418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493dd92-eee4-4bd7-be2d-338512b727ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:01.368166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493dd92-eee4-4bd7-be2d-338512b727ae None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:01.374403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736a6fa-c212-46aa-a3e6-f9382fe18f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:01.375300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a6fa-c212-46aa-a3e6-f9382fe18f2b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:01.375680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a6fa-c212-46aa-a3e6-f9382fe18f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:01.376040 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a6fa-c212-46aa-a3e6-f9382fe18f2b None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:01.378102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736a6fa-c212-46aa-a3e6-f9382fe18f2b None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:01.379742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736a6fa-c212-46aa-a3e6-f9382fe18f2b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:01.381767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 182/366] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:01.381955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 185/367] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:01 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:01.383042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736a6fa-c212-46aa-a3e6-f9382fe18f2b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:01.383334 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493dd92-eee4-4bd7-be2d-338512b727ae None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:01.387249 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:01.498665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736a6fa-c212-46aa-a3e6-f9382fe18f2b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:01.516894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:01.522284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493dd92-eee4-4bd7-be2d-338512b727ae None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:01.545977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc7474-cfc5-49b3-b61f-25bd8963e315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:01.547475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7474-cfc5-49b3-b61f-25bd8963e315 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:01.548086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7474-cfc5-49b3-b61f-25bd8963e315 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:01.548939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7474-cfc5-49b3-b61f-25bd8963e315 None admin] PATH_INFO: `/v3/users/282b255a9a544cefb1afecc10a332c93` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:01.551309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc7474-cfc5-49b3-b61f-25bd8963e315 None admin] RBAC: Authorizing `identity:get_user(user_id=282b255a9a544cefb1afecc10a332c93)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:01.553756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc7474-cfc5-49b3-b61f-25bd8963e315 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:01.556448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 186/368] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:28:01 2022] GET /identity/v3/users/282b255a9a544cefb1afecc10a332c93 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:01.556805 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0be248-39db-4909-87fc-57fea9934d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:01.558209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc7474-cfc5-49b3-b61f-25bd8963e315 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:01.558545 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0be248-39db-4909-87fc-57fea9934d91 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:01.559265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0be248-39db-4909-87fc-57fea9934d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:01.560049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0be248-39db-4909-87fc-57fea9934d91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:01.576770 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0be248-39db-4909-87fc-57fea9934d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-9f0be248-39db-4909-87fc-57fea9934d91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:01.587570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:01.588646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:01.589590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:01.597832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 183/369] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:01.597832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0be248-39db-4909-87fc-57fea9934d91 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:01.658206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:01.700607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc7474-cfc5-49b3-b61f-25bd8963e315 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:01.710122 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0be248-39db-4909-87fc-57fea9934d91 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:01.746732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bb6d1-f9d2-4992-8305-c768d2a7959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:01.747549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bb6d1-f9d2-4992-8305-c768d2a7959a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:01.747925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bb6d1-f9d2-4992-8305-c768d2a7959a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:01.748295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bb6d1-f9d2-4992-8305-c768d2a7959a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:01.748499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084867fe-fd0c-4d80-8181-15400590283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:01.749463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084867fe-fd0c-4d80-8181-15400590283a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:01.749886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084867fe-fd0c-4d80-8181-15400590283a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:01.750326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084867fe-fd0c-4d80-8181-15400590283a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:01.751464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084867fe-fd0c-4d80-8181-15400590283a None admin] RBAC: Adding query filter params (group.id=21a8c622c3f14a04b165d84caee9cdd5, role.id=5c89d9dc8b0949b98573064d572f981a, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:01.751934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084867fe-fd0c-4d80-8181-15400590283a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:01.754450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084867fe-fd0c-4d80-8181-15400590283a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:01.761627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 187/370] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jun 8 06:28:01 2022] GET /identity/v3/role_assignments?group.id=21a8c622c3f14a04b165d84caee9cdd5&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=5c89d9dc8b0949b98573064d572f981a => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:01.762694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084867fe-fd0c-4d80-8181-15400590283a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:01.803999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:01.883588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084867fe-fd0c-4d80-8181-15400590283a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:01.923552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3555c8-c344-4826-b1f8-0e9fdbfd882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:01.925160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3555c8-c344-4826-b1f8-0e9fdbfd882d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:01.925610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3555c8-c344-4826-b1f8-0e9fdbfd882d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:01.926024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3555c8-c344-4826-b1f8-0e9fdbfd882d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:01.927205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3555c8-c344-4826-b1f8-0e9fdbfd882d None admin] RBAC: Adding query filter params (role.id=24b48a19f5e94098b75009d75bdc90d9, user.id=282b255a9a544cefb1afecc10a332c93, scope.system=all) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:01.927817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3555c8-c344-4826-b1f8-0e9fdbfd882d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:01.928737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bb6d1-f9d2-4992-8305-c768d2a7959a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:01.929587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3555c8-c344-4826-b1f8-0e9fdbfd882d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:01.930434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bb6d1-f9d2-4992-8305-c768d2a7959a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:01.945254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 188/371] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Jun 8 06:28:01 2022] GET /identity/v3/role_assignments?user.id=282b255a9a544cefb1afecc10a332c93&scope.system=all&role.id=24b48a19f5e94098b75009d75bdc90d9 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:01.945641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:01.957052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3555c8-c344-4826-b1f8-0e9fdbfd882d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:02.182183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3555c8-c344-4826-b1f8-0e9fdbfd882d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:02.221632 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 184/372] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:02.233240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bb6d1-f9d2-4992-8305-c768d2a7959a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:02.235024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babcbbd-4541-4fe7-a3a9-7a8eae59f4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:02.235795 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babcbbd-4541-4fe7-a3a9-7a8eae59f4cf None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:02.242268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babcbbd-4541-4fe7-a3a9-7a8eae59f4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:02.242268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babcbbd-4541-4fe7-a3a9-7a8eae59f4cf None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:02.242268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babcbbd-4541-4fe7-a3a9-7a8eae59f4cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:02.242268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babcbbd-4541-4fe7-a3a9-7a8eae59f4cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:02.242268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babcbbd-4541-4fe7-a3a9-7a8eae59f4cf None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:02.248684 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 189/373] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:02.256889 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babcbbd-4541-4fe7-a3a9-7a8eae59f4cf None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:02.362775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:02.365771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bb6d1-f9d2-4992-8305-c768d2a7959a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:02.408216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413aae-a3bd-42d5-8860-7a479958fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:02.409092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413aae-a3bd-42d5-8860-7a479958fc73 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:02.409371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413aae-a3bd-42d5-8860-7a479958fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:02.409641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413aae-a3bd-42d5-8860-7a479958fc73 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:02.415586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76413aae-a3bd-42d5-8860-7a479958fc73 None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:02.417284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76413aae-a3bd-42d5-8860-7a479958fc73 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:02.418834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:02.420940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 185/374] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:02 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:02.426718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413aae-a3bd-42d5-8860-7a479958fc73 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:02.526342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babcbbd-4541-4fe7-a3a9-7a8eae59f4cf None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:02.569247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413aae-a3bd-42d5-8860-7a479958fc73 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:02.598905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f8aa4-f2ad-469a-9fc5-fc97ab97fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:02.599573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f8aa4-f2ad-469a-9fc5-fc97ab97fabe None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:02.599858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f8aa4-f2ad-469a-9fc5-fc97ab97fabe None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:02.600133 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f8aa4-f2ad-469a-9fc5-fc97ab97fabe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:02.603282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:02.620568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7935b3e-6177-4b16-86ce-af088ac026bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:02.622013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7935b3e-6177-4b16-86ce-af088ac026bc None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:02.622638 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7935b3e-6177-4b16-86ce-af088ac026bc None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:02.623071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7935b3e-6177-4b16-86ce-af088ac026bc None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:02.624305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7935b3e-6177-4b16-86ce-af088ac026bc None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:02.626472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7935b3e-6177-4b16-86ce-af088ac026bc None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:02.629544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 186/375] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:02 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:02.636825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7935b3e-6177-4b16-86ce-af088ac026bc None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:02.703117 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f8aa4-f2ad-469a-9fc5-fc97ab97fabe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:02.704617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f8aa4-f2ad-469a-9fc5-fc97ab97fabe None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:02.774319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7935b3e-6177-4b16-86ce-af088ac026bc None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:02.815481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4b3af-bb1a-4479-9b19-259d0a93f29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:02.816117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4b3af-bb1a-4479-9b19-259d0a93f29f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:02.816401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4b3af-bb1a-4479-9b19-259d0a93f29f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:02.816678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4b3af-bb1a-4479-9b19-259d0a93f29f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:02.817508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4b3af-bb1a-4479-9b19-259d0a93f29f None admin] RBAC: Adding query filter params (group.id=21a8c622c3f14a04b165d84caee9cdd5, role.id=d27765da961f442fa1ab376c59342273, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:02.817816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4b3af-bb1a-4479-9b19-259d0a93f29f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:02.821359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4b3af-bb1a-4479-9b19-259d0a93f29f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:02.826356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 187/376] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jun 8 06:28:02 2022] GET /identity/v3/role_assignments?group.id=21a8c622c3f14a04b165d84caee9cdd5&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=d27765da961f442fa1ab376c59342273 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:02.831029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:02.902415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 190/377] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:02.909120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4b3af-bb1a-4479-9b19-259d0a93f29f None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:03.003074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:03.054130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4b3af-bb1a-4479-9b19-259d0a93f29f None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:03.099452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53979eda-3c6e-4292-97f5-72fe2c3e93c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:03.100327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979eda-3c6e-4292-97f5-72fe2c3e93c3 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:03.100607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979eda-3c6e-4292-97f5-72fe2c3e93c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:03.100881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979eda-3c6e-4292-97f5-72fe2c3e93c3 None admin] PATH_INFO: `/v3/projects/87773f44fe964196963231d64fa11c8f` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:03.102068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53979eda-3c6e-4292-97f5-72fe2c3e93c3 None admin] RBAC: Authorizing `identity:get_project(project_id=87773f44fe964196963231d64fa11c8f)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:03.103538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53979eda-3c6e-4292-97f5-72fe2c3e93c3 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:03.105529 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 188/378] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:02 2022] GET /identity/v3/projects/87773f44fe964196963231d64fa11c8f => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:03.110742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f8aa4-f2ad-469a-9fc5-fc97ab97fabe None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:03.249625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f8aa4-f2ad-469a-9fc5-fc97ab97fabe None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:03.295223 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc535c-1527-4373-92bf-e7fcec4530f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:03.296081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc535c-1527-4373-92bf-e7fcec4530f2 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:03.296363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc535c-1527-4373-92bf-e7fcec4530f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:03.296638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc535c-1527-4373-92bf-e7fcec4530f2 None admin] PATH_INFO: `/v3/groups/8ab68c043fb3476aacabf2bd9384cb6a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:03.307122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc535c-1527-4373-92bf-e7fcec4530f2 None admin] RBAC: Authorizing `identity:get_group(group_id=8ab68c043fb3476aacabf2bd9384cb6a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:03.308584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc535c-1527-4373-92bf-e7fcec4530f2 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:03.310265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 191/379] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:03 2022] GET /identity/v3/groups/8ab68c043fb3476aacabf2bd9384cb6a => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:03.316295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53979eda-3c6e-4292-97f5-72fe2c3e93c3 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:03.435249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53979eda-3c6e-4292-97f5-72fe2c3e93c3 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:03.462793 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:03.479703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a8ca8-13bc-40d8-b6d8-e308e1a99780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:03.485403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8ca8-13bc-40d8-b6d8-e308e1a99780 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:03.485403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8ca8-13bc-40d8-b6d8-e308e1a99780 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:03.485403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8ca8-13bc-40d8-b6d8-e308e1a99780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:03.485403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a8ca8-13bc-40d8-b6d8-e308e1a99780 None admin] RBAC: Adding query filter params (group.id=8ab68c043fb3476aacabf2bd9384cb6a, role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=87773f44fe964196963231d64fa11c8f) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:03.485403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a8ca8-13bc-40d8-b6d8-e308e1a99780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:03.485403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a8ca8-13bc-40d8-b6d8-e308e1a99780 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:03.493110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 189/380] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jun 8 06:28:03 2022] GET /identity/v3/role_assignments?group.id=8ab68c043fb3476aacabf2bd9384cb6a&scope.project.id=87773f44fe964196963231d64fa11c8f&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:03.949209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc8013-9027-4346-af97-070fefd59fe8 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:03.950183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc8013-9027-4346-af97-070fefd59fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:03.950183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc8013-9027-4346-af97-070fefd59fe8 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:03.951713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 192/381] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:03.957427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c716ae4-d4cb-4456-a75b-6bb698e14837 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:03.957953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c716ae4-d4cb-4456-a75b-6bb698e14837 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:03.957953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c716ae4-d4cb-4456-a75b-6bb698e14837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:03.978166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-4c716ae4-d4cb-4456-a75b-6bb698e14837 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:03.979402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4c716ae4-d4cb-4456-a75b-6bb698e14837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:04.072562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 190/382] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:28:04.075825 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f205d-bdc6-41ea-b008-1d78d0535847 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:04.076116 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f205d-bdc6-41ea-b008-1d78d0535847 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:04.076396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f205d-bdc6-41ea-b008-1d78d0535847 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:04.077864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 193/383] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:04.083207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048573c1-6773-4ed0-9971-558fed3e9457 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:04.083497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048573c1-6773-4ed0-9971-558fed3e9457 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:04.083779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048573c1-6773-4ed0-9971-558fed3e9457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:04.104654 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-048573c1-6773-4ed0-9971-558fed3e9457 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:04.105835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-048573c1-6773-4ed0-9971-558fed3e9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:04.126203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f205d-bdc6-41ea-b008-1d78d0535847 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:04.155367 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:04.207975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 191/384] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:04.254134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048573c1-6773-4ed0-9971-558fed3e9457 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:04.295256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f205d-bdc6-41ea-b008-1d78d0535847 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:04.332642 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba1658-17e1-4082-9050-40c988dcfff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:04.333533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba1658-17e1-4082-9050-40c988dcfff4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:04.333818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba1658-17e1-4082-9050-40c988dcfff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:04.334088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba1658-17e1-4082-9050-40c988dcfff4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:04.352132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:04.360677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba1658-17e1-4082-9050-40c988dcfff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-86ba1658-17e1-4082-9050-40c988dcfff4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:04.381064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:04.382029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:04.382834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:04.383885 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 194/385] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:28:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:04.390285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba1658-17e1-4082-9050-40c988dcfff4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:04.439784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048573c1-6773-4ed0-9971-558fed3e9457 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:04.477512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588b271-e522-46b7-8015-4002cf24cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:04.478684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588b271-e522-46b7-8015-4002cf24cc44 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:04.479162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588b271-e522-46b7-8015-4002cf24cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:04.479647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588b271-e522-46b7-8015-4002cf24cc44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:04.489959 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:04.497199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588b271-e522-46b7-8015-4002cf24cc44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3588b271-e522-46b7-8015-4002cf24cc44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:04.506757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:04.509491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:28:04.510283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:04.514692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 192/386] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:04.524552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588b271-e522-46b7-8015-4002cf24cc44 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:04.537403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba1658-17e1-4082-9050-40c988dcfff4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:04.596750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910c180-9e5d-4f35-ad9f-515aae41cedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:04.597437 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910c180-9e5d-4f35-ad9f-515aae41cedb None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:04.597724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910c180-9e5d-4f35-ad9f-515aae41cedb None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:04.598001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910c180-9e5d-4f35-ad9f-515aae41cedb None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:04.598812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910c180-9e5d-4f35-ad9f-515aae41cedb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:04.599106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910c180-9e5d-4f35-ad9f-515aae41cedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:04.600555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910c180-9e5d-4f35-ad9f-515aae41cedb None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:04.619166 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 195/387] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:04.622231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910c180-9e5d-4f35-ad9f-515aae41cedb None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:04.694298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588b271-e522-46b7-8015-4002cf24cc44 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:04.722598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:04.782374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15825c1a-5909-4e8e-92fe-54d263ca85ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:04.784502 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15825c1a-5909-4e8e-92fe-54d263ca85ff None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:04.786765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15825c1a-5909-4e8e-92fe-54d263ca85ff None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:04.787337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15825c1a-5909-4e8e-92fe-54d263ca85ff None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:04.788224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15825c1a-5909-4e8e-92fe-54d263ca85ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:04.788661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15825c1a-5909-4e8e-92fe-54d263ca85ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:04.790418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15825c1a-5909-4e8e-92fe-54d263ca85ff None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:04.821973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910c180-9e5d-4f35-ad9f-515aae41cedb None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:04.822280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 193/388] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:28:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:04.823860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2bb74-9812-42be-b1ab-263cf1c1f18e None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:04.824945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2bb74-9812-42be-b1ab-263cf1c1f18e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:04.825774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2bb74-9812-42be-b1ab-263cf1c1f18e None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:04.828491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 194/389] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:04.829408 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2bb74-9812-42be-b1ab-263cf1c1f18e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:04.894892 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08d44-dae8-419c-b739-3f9fd2238676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:04.897132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08d44-dae8-419c-b739-3f9fd2238676 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:04.897426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08d44-dae8-419c-b739-3f9fd2238676 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:04.897706 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08d44-dae8-419c-b739-3f9fd2238676 None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:04.904546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d08d44-dae8-419c-b739-3f9fd2238676 None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:04.906027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d08d44-dae8-419c-b739-3f9fd2238676 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:04.908033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 196/390] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:04 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:04.909793 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1724e-ac24-4ad5-89f7-91b3ae361f32 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:04.910076 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1724e-ac24-4ad5-89f7-91b3ae361f32 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:04.910377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1724e-ac24-4ad5-89f7-91b3ae361f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:04.947255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-14b1724e-ac24-4ad5-89f7-91b3ae361f32 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:04.948438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-14b1724e-ac24-4ad5-89f7-91b3ae361f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:04.970622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:05.013657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2bb74-9812-42be-b1ab-263cf1c1f18e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:05.081631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ec5a8-97c5-479b-a27f-af0137e325c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:05.082450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ec5a8-97c5-479b-a27f-af0137e325c9 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:05.082733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ec5a8-97c5-479b-a27f-af0137e325c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:05.083007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ec5a8-97c5-479b-a27f-af0137e325c9 None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:05.086619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ec5a8-97c5-479b-a27f-af0137e325c9 None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:05.088072 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ec5a8-97c5-479b-a27f-af0137e325c9 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:05.089704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 195/391] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:04 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:05.094287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 197/392] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:05.094416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ec5a8-97c5-479b-a27f-af0137e325c9 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:05.100451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1724e-ac24-4ad5-89f7-91b3ae361f32 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:05.196604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:05.226746 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1724e-ac24-4ad5-89f7-91b3ae361f32 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:05.267137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d902b2-2429-4b57-8ecb-5c7ed9e9f18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:05.268574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d902b2-2429-4b57-8ecb-5c7ed9e9f18d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:05.268856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d902b2-2429-4b57-8ecb-5c7ed9e9f18d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:05.269137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d902b2-2429-4b57-8ecb-5c7ed9e9f18d None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:05.270537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d902b2-2429-4b57-8ecb-5c7ed9e9f18d None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:05.272171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d902b2-2429-4b57-8ecb-5c7ed9e9f18d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:05.278782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 198/393] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:05 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:05.278782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d902b2-2429-4b57-8ecb-5c7ed9e9f18d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:05.291175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:05.301282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ec5a8-97c5-479b-a27f-af0137e325c9 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:05.338665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e30c1-9d2b-4a85-83bc-15b57d3cbd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:05.339507 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e30c1-9d2b-4a85-83bc-15b57d3cbd75 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:05.339812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e30c1-9d2b-4a85-83bc-15b57d3cbd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:05.340382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e30c1-9d2b-4a85-83bc-15b57d3cbd75 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:05.341414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e30c1-9d2b-4a85-83bc-15b57d3cbd75 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:05.343036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e30c1-9d2b-4a85-83bc-15b57d3cbd75 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:05.344860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 196/394] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:05 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:05.345621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e30c1-9d2b-4a85-83bc-15b57d3cbd75 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:05.397648 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d902b2-2429-4b57-8ecb-5c7ed9e9f18d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:05.434938 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563bcd4-35b6-4d10-8e54-19278a4cc332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:05.436117 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563bcd4-35b6-4d10-8e54-19278a4cc332 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:05.436603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563bcd4-35b6-4d10-8e54-19278a4cc332 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:05.437104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563bcd4-35b6-4d10-8e54-19278a4cc332 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:05.448687 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563bcd4-35b6-4d10-8e54-19278a4cc332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-4563bcd4-35b6-4d10-8e54-19278a4cc332 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:05.457128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:05.458024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:28:05.458865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:05.461559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 199/395] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:05.462636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563bcd4-35b6-4d10-8e54-19278a4cc332 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:05.470420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e30c1-9d2b-4a85-83bc-15b57d3cbd75 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:05.481085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:05.510141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb88ac-96f4-413b-af86-bdf3a8e9793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:05.511067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb88ac-96f4-413b-af86-bdf3a8e9793c None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:05.511394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb88ac-96f4-413b-af86-bdf3a8e9793c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:05.511622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb88ac-96f4-413b-af86-bdf3a8e9793c None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/groups/21a8c622c3f14a04b165d84caee9cdd5/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:05.513827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb88ac-96f4-413b-af86-bdf3a8e9793c None admin] RBAC: Authorizing `identity:create_grant(project_id=e2d5fabbb53a41c7963507c6ce4bdabe, group_id=21a8c622c3f14a04b165d84caee9cdd5, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:05.515508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb88ac-96f4-413b-af86-bdf3a8e9793c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:05.535893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:05.570766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563bcd4-35b6-4d10-8e54-19278a4cc332 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:05.603923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fbb35-5397-44f2-8695-ca4842cae06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:05.604814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fbb35-5397-44f2-8695-ca4842cae06d None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:05.605095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fbb35-5397-44f2-8695-ca4842cae06d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:05.605368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fbb35-5397-44f2-8695-ca4842cae06d None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/groups/21a8c622c3f14a04b165d84caee9cdd5/roles/d27765da961f442fa1ab376c59342273` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:05.607630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fbb35-5397-44f2-8695-ca4842cae06d None admin] RBAC: Authorizing `identity:create_grant(project_id=9f0c0c19dbc94fbbb1e7b582193cb386, group_id=21a8c622c3f14a04b165d84caee9cdd5, role_id=d27765da961f442fa1ab376c59342273)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:05.609072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fbb35-5397-44f2-8695-ca4842cae06d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:05.629858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 197/396] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Jun 8 06:28:05 2022] PUT /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/groups/21a8c622c3f14a04b165d84caee9cdd5/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:05.630940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb88ac-96f4-413b-af86-bdf3a8e9793c None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:05.718459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 200/397] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Jun 8 06:28:05 2022] PUT /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/groups/21a8c622c3f14a04b165d84caee9cdd5/roles/d27765da961f442fa1ab376c59342273 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:05.720150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aeecd-407a-45da-863f-524e555a19df None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:05.720457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aeecd-407a-45da-863f-524e555a19df None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:05.720807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aeecd-407a-45da-863f-524e555a19df None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:05.722928 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 201/398] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:05.732705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663770-74af-4f0e-9e76-2a718b318a50 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:05.732991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663770-74af-4f0e-9e76-2a718b318a50 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:05.733264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663770-74af-4f0e-9e76-2a718b318a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:05.764690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb88ac-96f4-413b-af86-bdf3a8e9793c None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:05.775528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-14663770-74af-4f0e-9e76-2a718b318a50 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:05.777054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-14663770-74af-4f0e-9e76-2a718b318a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:05.813401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fa4a5-e263-4410-8d01-5d5bfed0579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:05.814550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fa4a5-e263-4410-8d01-5d5bfed0579f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:05.815033 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fa4a5-e263-4410-8d01-5d5bfed0579f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:05.815529 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fa4a5-e263-4410-8d01-5d5bfed0579f None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:05.816513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fa4a5-e263-4410-8d01-5d5bfed0579f None admin] RBAC: Adding query filter params (name=member) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:05.817173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fa4a5-e263-4410-8d01-5d5bfed0579f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:05.819369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fa4a5-e263-4410-8d01-5d5bfed0579f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:05.832081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 198/399] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:28:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:05.848758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fa4a5-e263-4410-8d01-5d5bfed0579f None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:05.906411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:05.913939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 202/400] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 08 06:28:05.941380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663770-74af-4f0e-9e76-2a718b318a50 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:06.016288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fa4a5-e263-4410-8d01-5d5bfed0579f None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:06.020585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:06.061495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77619d87-4643-4c9b-898b-7028c5e5f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:06.062650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619d87-4643-4c9b-898b-7028c5e5f3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:06.062937 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619d87-4643-4c9b-898b-7028c5e5f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:06.063218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619d87-4643-4c9b-898b-7028c5e5f3a9 None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:06.064601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77619d87-4643-4c9b-898b-7028c5e5f3a9 None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:06.066691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77619d87-4643-4c9b-898b-7028c5e5f3a9 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:06.072682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 199/401] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:05 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:06.074926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77619d87-4643-4c9b-898b-7028c5e5f3a9 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:06.082492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663770-74af-4f0e-9e76-2a718b318a50 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:06.158933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d06b56-1e1b-4fc9-997e-d5252922adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:06.159729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d06b56-1e1b-4fc9-997e-d5252922adb3 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:06.161271 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d06b56-1e1b-4fc9-997e-d5252922adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:06.161554 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d06b56-1e1b-4fc9-997e-d5252922adb3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:06.184073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d06b56-1e1b-4fc9-997e-d5252922adb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-70d06b56-1e1b-4fc9-997e-d5252922adb3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:06.192100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:06.192985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:06.193777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 203/402] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:28:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:06.195091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e843e-866c-4d41-a786-fa8f9e4941b3 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:06.195379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e843e-866c-4d41-a786-fa8f9e4941b3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:06.195652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e843e-866c-4d41-a786-fa8f9e4941b3 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:06.197154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 204/403] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:06.201948 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e843e-866c-4d41-a786-fa8f9e4941b3 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:06.240070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:06.244860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77619d87-4643-4c9b-898b-7028c5e5f3a9 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:06.290593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000b4c3-f7a2-4ebb-ac1a-516bd3155609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:06.291894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000b4c3-f7a2-4ebb-ac1a-516bd3155609 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:06.292180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000b4c3-f7a2-4ebb-ac1a-516bd3155609 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:06.292604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000b4c3-f7a2-4ebb-ac1a-516bd3155609 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:06.293928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000b4c3-f7a2-4ebb-ac1a-516bd3155609 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:06.296141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000b4c3-f7a2-4ebb-ac1a-516bd3155609 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:06.299174 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 200/404] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:06 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:06.300333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c49bc-e5cd-4708-85a7-bf43decb7d38 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:06.300617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c49bc-e5cd-4708-85a7-bf43decb7d38 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:06.300889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c49bc-e5cd-4708-85a7-bf43decb7d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:06.319623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e843e-866c-4d41-a786-fa8f9e4941b3 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:06.325616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-601c49bc-e5cd-4708-85a7-bf43decb7d38 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:06.326912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-601c49bc-e5cd-4708-85a7-bf43decb7d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:06.341505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:06.366501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700d40d-7dfe-4614-ac3c-ed1e868d68dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:06.367218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700d40d-7dfe-4614-ac3c-ed1e868d68dd None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:06.368373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700d40d-7dfe-4614-ac3c-ed1e868d68dd None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:06.369050 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700d40d-7dfe-4614-ac3c-ed1e868d68dd None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:06.370831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700d40d-7dfe-4614-ac3c-ed1e868d68dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:06.371142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700d40d-7dfe-4614-ac3c-ed1e868d68dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:06.372630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700d40d-7dfe-4614-ac3c-ed1e868d68dd None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:06.381610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 205/405] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:06.382444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700d40d-7dfe-4614-ac3c-ed1e868d68dd None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:06.422420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 201/406] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:06.423236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c49bc-e5cd-4708-85a7-bf43decb7d38 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:06.508269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700d40d-7dfe-4614-ac3c-ed1e868d68dd None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:06.545393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad021f57-48ed-42f6-98d8-f8900aeb717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:06.546378 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad021f57-48ed-42f6-98d8-f8900aeb717f None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:06.546664 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad021f57-48ed-42f6-98d8-f8900aeb717f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:06.546940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad021f57-48ed-42f6-98d8-f8900aeb717f None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/groups/21a8c622c3f14a04b165d84caee9cdd5/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:06.549160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad021f57-48ed-42f6-98d8-f8900aeb717f None admin] RBAC: Authorizing `identity:create_grant(project_id=9f0c0c19dbc94fbbb1e7b582193cb386, group_id=21a8c622c3f14a04b165d84caee9cdd5, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:06.550679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad021f57-48ed-42f6-98d8-f8900aeb717f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:06.556632 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:06.562797 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c49bc-e5cd-4708-85a7-bf43decb7d38 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:06.598291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a48c14-05fe-488c-b097-6817880c77ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:06.599353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a48c14-05fe-488c-b097-6817880c77ed None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:06.599640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a48c14-05fe-488c-b097-6817880c77ed None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:06.599929 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a48c14-05fe-488c-b097-6817880c77ed None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:06.601085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a48c14-05fe-488c-b097-6817880c77ed None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:06.602586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a48c14-05fe-488c-b097-6817880c77ed None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:06.604380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 202/407] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:06 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:06.604964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a48c14-05fe-488c-b097-6817880c77ed None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:06.647830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 206/408] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Jun 8 06:28:06 2022] PUT /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386/groups/21a8c622c3f14a04b165d84caee9cdd5/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:06.648678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad021f57-48ed-42f6-98d8-f8900aeb717f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:06.728172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a48c14-05fe-488c-b097-6817880c77ed None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:06.769292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a7a46-555c-450a-93a6-8f55a55d4d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:06.770106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a7a46-555c-450a-93a6-8f55a55d4d24 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:06.770418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a7a46-555c-450a-93a6-8f55a55d4d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:06.770692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a7a46-555c-450a-93a6-8f55a55d4d24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:06.783368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a7a46-555c-450a-93a6-8f55a55d4d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-1b1a7a46-555c-450a-93a6-8f55a55d4d24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:06.792781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:06.793729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:06.794542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 203/409] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:06.803565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a7a46-555c-450a-93a6-8f55a55d4d24 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:06.804972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:06.840065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:06.931157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a7a46-555c-450a-93a6-8f55a55d4d24 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:06.969475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd351-b918-4cfd-9cf7-5c39040161df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:06.970148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd351-b918-4cfd-9cf7-5c39040161df None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:06.970475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd351-b918-4cfd-9cf7-5c39040161df None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:06.970782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd351-b918-4cfd-9cf7-5c39040161df None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:06.971537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fd351-b918-4cfd-9cf7-5c39040161df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:06.971844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fd351-b918-4cfd-9cf7-5c39040161df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:06.973211 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fd351-b918-4cfd-9cf7-5c39040161df None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:06.982935 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 204/410] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:06.989737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd351-b918-4cfd-9cf7-5c39040161df None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:06.997523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad021f57-48ed-42f6-98d8-f8900aeb717f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:07.069278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaae930-7c5b-431c-a711-507aa20bf956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:07.071057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae930-7c5b-431c-a711-507aa20bf956 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:07.071536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae930-7c5b-431c-a711-507aa20bf956 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:07.072018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae930-7c5b-431c-a711-507aa20bf956 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:07.075850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaae930-7c5b-431c-a711-507aa20bf956 None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:07.077718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaae930-7c5b-431c-a711-507aa20bf956 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:07.079989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 207/411] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:06 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:07.095944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaae930-7c5b-431c-a711-507aa20bf956 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:07.102753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:07.114964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd351-b918-4cfd-9cf7-5c39040161df None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:07.159803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba07214-9e47-4745-a657-2b217d1eaffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:07.160677 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba07214-9e47-4745-a657-2b217d1eaffe None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:07.160959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba07214-9e47-4745-a657-2b217d1eaffe None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:07.161232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba07214-9e47-4745-a657-2b217d1eaffe None admin] PATH_INFO: `/v3/groups/8ab68c043fb3476aacabf2bd9384cb6a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:07.163626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba07214-9e47-4745-a657-2b217d1eaffe None admin] RBAC: Authorizing `identity:get_group(group_id=8ab68c043fb3476aacabf2bd9384cb6a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:07.165071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba07214-9e47-4745-a657-2b217d1eaffe None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:07.167091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 205/412] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:06 2022] GET /identity/v3/groups/8ab68c043fb3476aacabf2bd9384cb6a => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:07.172363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba07214-9e47-4745-a657-2b217d1eaffe None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:07.299666 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba07214-9e47-4745-a657-2b217d1eaffe None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:07.305434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaae930-7c5b-431c-a711-507aa20bf956 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:07.323426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:07.358851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38a110-2643-43b1-b9e0-d0410e3892fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:07.359735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38a110-2643-43b1-b9e0-d0410e3892fe None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:07.360024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38a110-2643-43b1-b9e0-d0410e3892fe None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:07.360307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38a110-2643-43b1-b9e0-d0410e3892fe None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/groups/21a8c622c3f14a04b165d84caee9cdd5/roles/d27765da961f442fa1ab376c59342273` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:07.363269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38a110-2643-43b1-b9e0-d0410e3892fe None admin] RBAC: Authorizing `identity:create_grant(project_id=e2d5fabbb53a41c7963507c6ce4bdabe, group_id=21a8c622c3f14a04b165d84caee9cdd5, role_id=d27765da961f442fa1ab376c59342273)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:07.364940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38a110-2643-43b1-b9e0-d0410e3892fe None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:07.371620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387f01-d69c-4201-9514-3fae46c168d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:07.372533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387f01-d69c-4201-9514-3fae46c168d7 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:07.372858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387f01-d69c-4201-9514-3fae46c168d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:07.373139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387f01-d69c-4201-9514-3fae46c168d7 None admin] PATH_INFO: `/v3/projects/87773f44fe964196963231d64fa11c8f` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:07.374359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30387f01-d69c-4201-9514-3fae46c168d7 None admin] RBAC: Authorizing `identity:get_project(project_id=87773f44fe964196963231d64fa11c8f)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:07.375880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30387f01-d69c-4201-9514-3fae46c168d7 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:07.377665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 206/413] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:07 2022] GET /identity/v3/projects/87773f44fe964196963231d64fa11c8f => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:07.383117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387f01-d69c-4201-9514-3fae46c168d7 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:07.408908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:07.443762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 208/414] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Jun 8 06:28:07 2022] PUT /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe/groups/21a8c622c3f14a04b165d84caee9cdd5/roles/d27765da961f442fa1ab376c59342273 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:28:07.498275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387f01-d69c-4201-9514-3fae46c168d7 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:07.548624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7c4de-b8e4-4df8-9791-005776c428aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:07.554698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7c4de-b8e4-4df8-9791-005776c428aa None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:07.555339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7c4de-b8e4-4df8-9791-005776c428aa None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:07.555802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7c4de-b8e4-4df8-9791-005776c428aa None admin] PATH_INFO: `/v3/projects/87773f44fe964196963231d64fa11c8f/groups/8ab68c043fb3476aacabf2bd9384cb6a/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:07.558250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7c4de-b8e4-4df8-9791-005776c428aa None admin] RBAC: Authorizing `identity:create_grant(project_id=87773f44fe964196963231d64fa11c8f, group_id=8ab68c043fb3476aacabf2bd9384cb6a, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:07.559923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7c4de-b8e4-4df8-9791-005776c428aa None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:07.732859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 207/415] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Jun 8 06:28:07 2022] PUT /identity/v3/projects/87773f44fe964196963231d64fa11c8f/groups/8ab68c043fb3476aacabf2bd9384cb6a/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:08.222186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca084ad-f8e1-4a7e-ad9c-d1fa0bf6d7c1 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:08.222705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca084ad-f8e1-4a7e-ad9c-d1fa0bf6d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:08.222778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca084ad-f8e1-4a7e-ad9c-d1fa0bf6d7c1 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:08.224524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 209/416] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:28:08.229726 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3aaec-cc87-4bd4-9928-f87ed51cb018 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:08.230131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3aaec-cc87-4bd4-9928-f87ed51cb018 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:08.230322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3aaec-cc87-4bd4-9928-f87ed51cb018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:08.256125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-bfb3aaec-cc87-4bd4-9928-f87ed51cb018 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:08.257322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-bfb3aaec-cc87-4bd4-9928-f87ed51cb018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:08.333479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 208/417] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:08.363903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca084ad-f8e1-4a7e-ad9c-d1fa0bf6d7c1 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:08.446378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d90f9-dce1-4669-98d0-807677502d88 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:08.446755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d90f9-dce1-4669-98d0-807677502d88 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:08.447133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d90f9-dce1-4669-98d0-807677502d88 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:08.449911 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 209/418] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:08.455514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735b5ec-3e27-40ec-b6e7-a86da1627bc9 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:08.455909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735b5ec-3e27-40ec-b6e7-a86da1627bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:08.456290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735b5ec-3e27-40ec-b6e7-a86da1627bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:08.490741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b735b5ec-3e27-40ec-b6e7-a86da1627bc9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:08.491930 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b735b5ec-3e27-40ec-b6e7-a86da1627bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:08.499904 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca084ad-f8e1-4a7e-ad9c-d1fa0bf6d7c1 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:08.513590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:08.571408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bd033-5f6c-42a8-868a-45a6e5cba591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:08.572260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd033-5f6c-42a8-868a-45a6e5cba591 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:08.572541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd033-5f6c-42a8-868a-45a6e5cba591 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:08.572811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd033-5f6c-42a8-868a-45a6e5cba591 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:08.594105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bd033-5f6c-42a8-868a-45a6e5cba591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-ff8bd033-5f6c-42a8-868a-45a6e5cba591 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:08.611981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:08.612937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:28:08.613707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:08.614790 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 210/419] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:08.623886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bd033-5f6c-42a8-868a-45a6e5cba591 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:08.634289 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 210/420] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:08.670589 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735b5ec-3e27-40ec-b6e7-a86da1627bc9 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:08.680506 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:08.832144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bd033-5f6c-42a8-868a-45a6e5cba591 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:08.891747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735b5ec-3e27-40ec-b6e7-a86da1627bc9 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:08.895466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f30b-3fad-4b60-85e4-202a0aa3c0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:08.896362 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f30b-3fad-4b60-85e4-202a0aa3c0bc None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:08.896973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f30b-3fad-4b60-85e4-202a0aa3c0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:08.898258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f30b-3fad-4b60-85e4-202a0aa3c0bc None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:08.899246 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7f30b-3fad-4b60-85e4-202a0aa3c0bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:08.904178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7f30b-3fad-4b60-85e4-202a0aa3c0bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:08.905797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7f30b-3fad-4b60-85e4-202a0aa3c0bc None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:08.923256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 211/421] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:28:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:08.934463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f30b-3fad-4b60-85e4-202a0aa3c0bc None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:08.954911 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056fdbd-106a-43d8-a16c-011ee96d0186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:08.956245 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056fdbd-106a-43d8-a16c-011ee96d0186 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:08.956526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056fdbd-106a-43d8-a16c-011ee96d0186 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:08.956798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056fdbd-106a-43d8-a16c-011ee96d0186 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:08.982659 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056fdbd-106a-43d8-a16c-011ee96d0186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-5056fdbd-106a-43d8-a16c-011ee96d0186 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:08.990898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:08.991746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:08.992550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 211/422] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:28:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:08.999445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056fdbd-106a-43d8-a16c-011ee96d0186 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:09.014545 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:09.063821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:09.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f30b-3fad-4b60-85e4-202a0aa3c0bc None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:09.148951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbd4ca-b8ab-4c97-ba9a-a78374c41bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:09.149604 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbd4ca-b8ab-4c97-ba9a-a78374c41bfd None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:09.149887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbd4ca-b8ab-4c97-ba9a-a78374c41bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:09.150161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbd4ca-b8ab-4c97-ba9a-a78374c41bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:09.221120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056fdbd-106a-43d8-a16c-011ee96d0186 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:09.277264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbd4ca-b8ab-4c97-ba9a-a78374c41bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:09.278752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbd4ca-b8ab-4c97-ba9a-a78374c41bfd None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:09.290601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9db2c0-a90a-41f6-8c3d-ee9e5b28e0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:09.291354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db2c0-a90a-41f6-8c3d-ee9e5b28e0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:09.291643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db2c0-a90a-41f6-8c3d-ee9e5b28e0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:09.291922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db2c0-a90a-41f6-8c3d-ee9e5b28e0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:09.292704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9db2c0-a90a-41f6-8c3d-ee9e5b28e0e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:09.293015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9db2c0-a90a-41f6-8c3d-ee9e5b28e0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:09.294458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9db2c0-a90a-41f6-8c3d-ee9e5b28e0e1 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:09.310733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 212/423] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:09.312034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d18e3f-4fae-45f7-ba5d-6ab8c9d2bd56 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:09.312324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d18e3f-4fae-45f7-ba5d-6ab8c9d2bd56 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:09.317596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d18e3f-4fae-45f7-ba5d-6ab8c9d2bd56 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:09.320343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 213/424] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:09.320343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d18e3f-4fae-45f7-ba5d-6ab8c9d2bd56 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:09.399278 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:09.400392 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 212/425] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:09.400681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:09.406676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31cf8-d73c-4efa-9127-bb82361b3e5c None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:09.406986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31cf8-d73c-4efa-9127-bb82361b3e5c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:09.407268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31cf8-d73c-4efa-9127-bb82361b3e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:09.427947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-4bb31cf8-d73c-4efa-9127-bb82361b3e5c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:09.429136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-4bb31cf8-d73c-4efa-9127-bb82361b3e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:09.446026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d18e3f-4fae-45f7-ba5d-6ab8c9d2bd56 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:09.489474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cb71d-6c72-4312-a6aa-3e8ac7b24579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:09.490676 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cb71d-6c72-4312-a6aa-3e8ac7b24579 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:09.491106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cb71d-6c72-4312-a6aa-3e8ac7b24579 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:09.491713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cb71d-6c72-4312-a6aa-3e8ac7b24579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:09.514372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 213/426] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:09.515453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb31cf8-d73c-4efa-9127-bb82361b3e5c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:09.584744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cb71d-6c72-4312-a6aa-3e8ac7b24579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:09.586185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cb71d-6c72-4312-a6aa-3e8ac7b24579 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:09.646972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb31cf8-d73c-4efa-9127-bb82361b3e5c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:09.668490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:09.677243 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:09.682642 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164988c7-f7ba-4cca-b85a-85785310d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:09.683602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164988c7-f7ba-4cca-b85a-85785310d263 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:09.683952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164988c7-f7ba-4cca-b85a-85785310d263 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:09.684289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164988c7-f7ba-4cca-b85a-85785310d263 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:09.685711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164988c7-f7ba-4cca-b85a-85785310d263 None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:09.688093 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164988c7-f7ba-4cca-b85a-85785310d263 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:09.694484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 214/427] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:09 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:09.695417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164988c7-f7ba-4cca-b85a-85785310d263 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:09.729816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 214/428] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:09.729816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cb71d-6c72-4312-a6aa-3e8ac7b24579 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:09.828727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164988c7-f7ba-4cca-b85a-85785310d263 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:09.836829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cb71d-6c72-4312-a6aa-3e8ac7b24579 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:09.873732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f98d44-7d12-4d21-a6c2-87a895f11847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:09.874809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc6547-378e-45dd-a3a6-bef63bc06c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:09.875110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f98d44-7d12-4d21-a6c2-87a895f11847 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:09.875591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f98d44-7d12-4d21-a6c2-87a895f11847 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:09.875865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6547-378e-45dd-a3a6-bef63bc06c78 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:09.876210 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6547-378e-45dd-a3a6-bef63bc06c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:09.876392 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f98d44-7d12-4d21-a6c2-87a895f11847 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:09.876590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6547-378e-45dd-a3a6-bef63bc06c78 None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:09.878777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc6547-378e-45dd-a3a6-bef63bc06c78 None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:09.880485 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc6547-378e-45dd-a3a6-bef63bc06c78 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:09.886394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 215/429] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:09 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:09.887621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc6547-378e-45dd-a3a6-bef63bc06c78 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:09.894053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f98d44-7d12-4d21-a6c2-87a895f11847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-75f98d44-7d12-4d21-a6c2-87a895f11847 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:09.902302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:09.903154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 06:28:09.903927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:09.906438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 215/430] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:09.907500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f98d44-7d12-4d21-a6c2-87a895f11847 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:09.924450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:09.964926 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:10.004331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc6547-378e-45dd-a3a6-bef63bc06c78 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:10.018953 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f98d44-7d12-4d21-a6c2-87a895f11847 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:10.038772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbb7e4-a9b1-4422-897d-4c6375d43002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:10.039638 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbb7e4-a9b1-4422-897d-4c6375d43002 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.039924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbb7e4-a9b1-4422-897d-4c6375d43002 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.040200 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbb7e4-a9b1-4422-897d-4c6375d43002 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.041396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbb7e4-a9b1-4422-897d-4c6375d43002 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:10.042859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbb7e4-a9b1-4422-897d-4c6375d43002 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:10.044727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 216/431] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:09 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:10.045315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbb7e4-a9b1-4422-897d-4c6375d43002 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:10.062899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f3977-a465-4390-a404-0d72661b4386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:10.063556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f3977-a465-4390-a404-0d72661b4386 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.063839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f3977-a465-4390-a404-0d72661b4386 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.064138 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f3977-a465-4390-a404-0d72661b4386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.065596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f3977-a465-4390-a404-0d72661b4386 None admin] RBAC: Adding query filter params (group.id=21a8c622c3f14a04b165d84caee9cdd5, role.id=5c89d9dc8b0949b98573064d572f981a, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:10.065908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f3977-a465-4390-a404-0d72661b4386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:10.067371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f3977-a465-4390-a404-0d72661b4386 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:10.081358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 216/432] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jun 8 06:28:09 2022] GET /identity/v3/role_assignments?group.id=21a8c622c3f14a04b165d84caee9cdd5&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=5c89d9dc8b0949b98573064d572f981a => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:10.081358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb588e-7591-4df4-bdb4-8448aa1cf79a None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.081358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb588e-7591-4df4-bdb4-8448aa1cf79a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.081358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb588e-7591-4df4-bdb4-8448aa1cf79a None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.081358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 217/433] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:10.081358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb588e-7591-4df4-bdb4-8448aa1cf79a None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:10.183602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:10.189195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbb7e4-a9b1-4422-897d-4c6375d43002 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:10.213142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb588e-7591-4df4-bdb4-8448aa1cf79a None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:10.233280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:10.235956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3ac4f-e309-480d-a3f1-6533ab7ccf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:10.237565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3ac4f-e309-480d-a3f1-6533ab7ccf27 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.237954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3ac4f-e309-480d-a3f1-6533ab7ccf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.238365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3ac4f-e309-480d-a3f1-6533ab7ccf27 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.239408 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3ac4f-e309-480d-a3f1-6533ab7ccf27 None admin] RBAC: Adding query filter params (name=member) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:10.239820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3ac4f-e309-480d-a3f1-6533ab7ccf27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:10.241731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3ac4f-e309-480d-a3f1-6533ab7ccf27 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:10.258806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 217/434] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:28:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:10.258806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c418c-ad09-4120-8a7a-b2aaeb9d6153 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.258806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c418c-ad09-4120-8a7a-b2aaeb9d6153 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.258806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c418c-ad09-4120-8a7a-b2aaeb9d6153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.264054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa2410-5683-4bfa-9cfa-7de01868c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:10.266014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2410-5683-4bfa-9cfa-7de01868c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.266349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2410-5683-4bfa-9cfa-7de01868c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.266633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2410-5683-4bfa-9cfa-7de01868c7b8 None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.268033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa2410-5683-4bfa-9cfa-7de01868c7b8 None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:10.269629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa2410-5683-4bfa-9cfa-7de01868c7b8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:10.276402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 218/435] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:10 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:10.276402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa2410-5683-4bfa-9cfa-7de01868c7b8 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:10.283767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-d39c418c-ad09-4120-8a7a-b2aaeb9d6153 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:10.285961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d39c418c-ad09-4120-8a7a-b2aaeb9d6153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:10.375675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 218/436] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:10.376652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c418c-ad09-4120-8a7a-b2aaeb9d6153 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:10.400636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa2410-5683-4bfa-9cfa-7de01868c7b8 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:10.440580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e846165-b7fe-4b93-ab19-b33f56680241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:10.441156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846165-b7fe-4b93-ab19-b33f56680241 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.441437 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846165-b7fe-4b93-ab19-b33f56680241 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.441809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846165-b7fe-4b93-ab19-b33f56680241 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.476456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:10.484682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c418c-ad09-4120-8a7a-b2aaeb9d6153 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:10.491978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:10.510624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e846165-b7fe-4b93-ab19-b33f56680241 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:10.512880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e846165-b7fe-4b93-ab19-b33f56680241 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:10.517422 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83f203-fe76-4eaa-81ea-66066aa7b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:10.518074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83f203-fe76-4eaa-81ea-66066aa7b554 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.518395 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83f203-fe76-4eaa-81ea-66066aa7b554 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.518672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83f203-fe76-4eaa-81ea-66066aa7b554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.519510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83f203-fe76-4eaa-81ea-66066aa7b554 None admin] RBAC: Adding query filter params (group.id=21a8c622c3f14a04b165d84caee9cdd5, role.id=d27765da961f442fa1ab376c59342273, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:10.519819 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83f203-fe76-4eaa-81ea-66066aa7b554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:10.521227 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83f203-fe76-4eaa-81ea-66066aa7b554 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:10.526967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 219/437] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jun 8 06:28:10 2022] GET /identity/v3/role_assignments?group.id=21a8c622c3f14a04b165d84caee9cdd5&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=d27765da961f442fa1ab376c59342273 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:10.527825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83f203-fe76-4eaa-81ea-66066aa7b554 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:10.624454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 219/438] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:10.625916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4237f-3a6e-4a0b-afbc-7430ba241cd3 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.626210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4237f-3a6e-4a0b-afbc-7430ba241cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.626527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4237f-3a6e-4a0b-afbc-7430ba241cd3 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.628081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 220/439] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:10.629939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4237f-3a6e-4a0b-afbc-7430ba241cd3 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:10.650454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83f203-fe76-4eaa-81ea-66066aa7b554 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:10.692306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79b1c5-8cd0-4800-b083-ffa44f1e6ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:10.693065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b1c5-8cd0-4800-b083-ffa44f1e6ced None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.693346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b1c5-8cd0-4800-b083-ffa44f1e6ced None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.693616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b1c5-8cd0-4800-b083-ffa44f1e6ced None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.706736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79b1c5-8cd0-4800-b083-ffa44f1e6ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-7e79b1c5-8cd0-4800-b083-ffa44f1e6ced None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:10.714780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:10.716521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 220/440] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:28:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:10.717492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c239ae-5ae4-4f17-bb20-89509fea6e70 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.718371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c239ae-5ae4-4f17-bb20-89509fea6e70 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.718371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c239ae-5ae4-4f17-bb20-89509fea6e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.732731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:10.735215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-59c239ae-5ae4-4f17-bb20-89509fea6e70 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:10.736496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-59c239ae-5ae4-4f17-bb20-89509fea6e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:10.752088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:10.759039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4237f-3a6e-4a0b-afbc-7430ba241cd3 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:10.795919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254883e-c9f9-4aad-b949-e6f4ae6f9725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:10.796813 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254883e-c9f9-4aad-b949-e6f4ae6f9725 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.797163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254883e-c9f9-4aad-b949-e6f4ae6f9725 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.797438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254883e-c9f9-4aad-b949-e6f4ae6f9725 None admin] PATH_INFO: `/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.798676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254883e-c9f9-4aad-b949-e6f4ae6f9725 None admin] RBAC: Authorizing `identity:get_project(project_id=9f0c0c19dbc94fbbb1e7b582193cb386)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:10.800085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254883e-c9f9-4aad-b949-e6f4ae6f9725 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:10.801839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 221/441] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:10 2022] GET /identity/v3/projects/9f0c0c19dbc94fbbb1e7b582193cb386 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:10.802631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254883e-c9f9-4aad-b949-e6f4ae6f9725 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:10.816181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 221/442] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:10.819158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c239ae-5ae4-4f17-bb20-89509fea6e70 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:10.901107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254883e-c9f9-4aad-b949-e6f4ae6f9725 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:10.917052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c239ae-5ae4-4f17-bb20-89509fea6e70 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:10.935644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d733c-5cfa-47e3-a917-4bbc8e84280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:10.936295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d733c-5cfa-47e3-a917-4bbc8e84280c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.936579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d733c-5cfa-47e3-a917-4bbc8e84280c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.936846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d733c-5cfa-47e3-a917-4bbc8e84280c None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.937584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d733c-5cfa-47e3-a917-4bbc8e84280c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:10.937885 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d733c-5cfa-47e3-a917-4bbc8e84280c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:10.939280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d733c-5cfa-47e3-a917-4bbc8e84280c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:10.947427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 222/443] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:10.947978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d733c-5cfa-47e3-a917-4bbc8e84280c None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:10.952627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d710-6189-423a-be90-f987432384ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:10.953482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d710-6189-423a-be90-f987432384ee None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:10.953761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d710-6189-423a-be90-f987432384ee None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:10.954036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d710-6189-423a-be90-f987432384ee None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:10.956091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9d710-6189-423a-be90-f987432384ee None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:10.958769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9d710-6189-423a-be90-f987432384ee None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:10.961132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 222/444] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:10 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:10.961898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d710-6189-423a-be90-f987432384ee None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:10.964877 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:10.977891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:11.061016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d710-6189-423a-be90-f987432384ee None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:11.065068 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d733c-5cfa-47e3-a917-4bbc8e84280c None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:11.095367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e28a4-b883-4ab4-85f4-91e6aa6fbe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:11.096010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e28a4-b883-4ab4-85f4-91e6aa6fbe7d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:11.096293 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e28a4-b883-4ab4-85f4-91e6aa6fbe7d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:11.096568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e28a4-b883-4ab4-85f4-91e6aa6fbe7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:11.099526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccd1bc-8822-4ed3-a2f7-24b0a992c088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:11.100305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd1bc-8822-4ed3-a2f7-24b0a992c088 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:11.100584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd1bc-8822-4ed3-a2f7-24b0a992c088 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:11.100852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd1bc-8822-4ed3-a2f7-24b0a992c088 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:11.110580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccd1bc-8822-4ed3-a2f7-24b0a992c088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-fcccd1bc-8822-4ed3-a2f7-24b0a992c088 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:11.118095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:11.119004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 223/445] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:11.124749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccd1bc-8822-4ed3-a2f7-24b0a992c088 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:11.166062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e28a4-b883-4ab4-85f4-91e6aa6fbe7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:11.167550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e28a4-b883-4ab4-85f4-91e6aa6fbe7d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:11.181603 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:11.196163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:11.226704 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccd1bc-8822-4ed3-a2f7-24b0a992c088 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:11.261778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1eeee-934e-45e4-b756-354a123f22d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:11.262458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1eeee-934e-45e4-b756-354a123f22d5 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:11.262746 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1eeee-934e-45e4-b756-354a123f22d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:11.263022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1eeee-934e-45e4-b756-354a123f22d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:11.263855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1eeee-934e-45e4-b756-354a123f22d5 None admin] RBAC: Adding query filter params (group.id=21a8c622c3f14a04b165d84caee9cdd5, role.id=5c89d9dc8b0949b98573064d572f981a, scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:11.264169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1eeee-934e-45e4-b756-354a123f22d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:11.265594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1eeee-934e-45e4-b756-354a123f22d5 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:11.268297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 223/446] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:11.269132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e28a4-b883-4ab4-85f4-91e6aa6fbe7d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:11.272420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 224/447] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jun 8 06:28:11 2022] GET /identity/v3/role_assignments?group.id=21a8c622c3f14a04b165d84caee9cdd5&scope.project.id=9f0c0c19dbc94fbbb1e7b582193cb386&role.id=5c89d9dc8b0949b98573064d572f981a => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:11.273652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1eeee-934e-45e4-b756-354a123f22d5 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:11.382581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e28a4-b883-4ab4-85f4-91e6aa6fbe7d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:11.386198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1eeee-934e-45e4-b756-354a123f22d5 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:11.398305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:11.420807 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb66b9-df1d-4a2a-b961-be57b8e41d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:11.421484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb66b9-df1d-4a2a-b961-be57b8e41d2e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:11.421762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb66b9-df1d-4a2a-b961-be57b8e41d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:11.421858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7307a-1b3e-4d31-950e-ecc98fea9165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:11.422427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb66b9-df1d-4a2a-b961-be57b8e41d2e None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:11.422764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7307a-1b3e-4d31-950e-ecc98fea9165 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:11.422859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb66b9-df1d-4a2a-b961-be57b8e41d2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:11.423143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb66b9-df1d-4a2a-b961-be57b8e41d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:11.423315 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7307a-1b3e-4d31-950e-ecc98fea9165 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:11.426370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7307a-1b3e-4d31-950e-ecc98fea9165 None admin] PATH_INFO: `/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:11.426620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb66b9-df1d-4a2a-b961-be57b8e41d2e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:11.427526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7307a-1b3e-4d31-950e-ecc98fea9165 None admin] RBAC: Authorizing `identity:get_project(project_id=e2d5fabbb53a41c7963507c6ce4bdabe)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:11.429167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7307a-1b3e-4d31-950e-ecc98fea9165 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:11.431568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 225/448] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:11 2022] GET /identity/v3/projects/e2d5fabbb53a41c7963507c6ce4bdabe => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:11.437754 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7307a-1b3e-4d31-950e-ecc98fea9165 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:11.440989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:11.441787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 224/449] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:11.447264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb66b9-df1d-4a2a-b961-be57b8e41d2e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:11.556449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7307a-1b3e-4d31-950e-ecc98fea9165 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:11.578270 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb66b9-df1d-4a2a-b961-be57b8e41d2e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:11.594739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56e3e4-ae91-4651-a0b1-ee02688483b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:11.595692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56e3e4-ae91-4651-a0b1-ee02688483b5 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:11.595980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56e3e4-ae91-4651-a0b1-ee02688483b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:11.596256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56e3e4-ae91-4651-a0b1-ee02688483b5 None admin] PATH_INFO: `/v3/groups/21a8c622c3f14a04b165d84caee9cdd5` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:11.597462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56e3e4-ae91-4651-a0b1-ee02688483b5 None admin] RBAC: Authorizing `identity:get_group(group_id=21a8c622c3f14a04b165d84caee9cdd5)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:11.599024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56e3e4-ae91-4651-a0b1-ee02688483b5 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:11.600650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 226/450] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:11 2022] GET /identity/v3/groups/21a8c622c3f14a04b165d84caee9cdd5 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:11.607617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56e3e4-ae91-4651-a0b1-ee02688483b5 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:11.624934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83619a13-55c9-4ac0-b933-33991dbf862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:11.625582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83619a13-55c9-4ac0-b933-33991dbf862d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:11.625861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83619a13-55c9-4ac0-b933-33991dbf862d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:11.626133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83619a13-55c9-4ac0-b933-33991dbf862d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:11.677153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:11.690840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:11.702117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83619a13-55c9-4ac0-b933-33991dbf862d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:11.703730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83619a13-55c9-4ac0-b933-33991dbf862d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:11.724214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56e3e4-ae91-4651-a0b1-ee02688483b5 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:11.766280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ff419-be5f-4b7f-9daf-cfc11c5cdb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:11.766915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ff419-be5f-4b7f-9daf-cfc11c5cdb83 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:11.767229 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ff419-be5f-4b7f-9daf-cfc11c5cdb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:11.767516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ff419-be5f-4b7f-9daf-cfc11c5cdb83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:11.768361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ff419-be5f-4b7f-9daf-cfc11c5cdb83 None admin] RBAC: Adding query filter params (group.id=21a8c622c3f14a04b165d84caee9cdd5, role.id=d27765da961f442fa1ab376c59342273, scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:11.768674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ff419-be5f-4b7f-9daf-cfc11c5cdb83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:11.770118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ff419-be5f-4b7f-9daf-cfc11c5cdb83 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:11.777200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 227/451] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jun 8 06:28:11 2022] GET /identity/v3/role_assignments?group.id=21a8c622c3f14a04b165d84caee9cdd5&scope.project.id=e2d5fabbb53a41c7963507c6ce4bdabe&role.id=d27765da961f442fa1ab376c59342273 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:11.829954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 225/452] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 06:28:11.836018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ff419-be5f-4b7f-9daf-cfc11c5cdb83 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:11.950207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ff419-be5f-4b7f-9daf-cfc11c5cdb83 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:11.988382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2cbb2-36fb-4682-ab55-27e8cdcc50ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:11.989574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2cbb2-36fb-4682-ab55-27e8cdcc50ce None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:11.989854 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2cbb2-36fb-4682-ab55-27e8cdcc50ce None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:11.990125 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2cbb2-36fb-4682-ab55-27e8cdcc50ce None admin] PATH_INFO: `/v3/projects/87773f44fe964196963231d64fa11c8f` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:11.991335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2cbb2-36fb-4682-ab55-27e8cdcc50ce None admin] RBAC: Authorizing `identity:get_project(project_id=87773f44fe964196963231d64fa11c8f)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:11.992773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2cbb2-36fb-4682-ab55-27e8cdcc50ce None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:11.994658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 228/453] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:28:11 2022] GET /identity/v3/projects/87773f44fe964196963231d64fa11c8f => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:11.999972 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83619a13-55c9-4ac0-b933-33991dbf862d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:12.078478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:12.101348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83619a13-55c9-4ac0-b933-33991dbf862d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:12.137676 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434e8dc-0a55-49ee-be9f-b65cc1b1f917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:12.138645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e8dc-0a55-49ee-be9f-b65cc1b1f917 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:12.138931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e8dc-0a55-49ee-be9f-b65cc1b1f917 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:12.139210 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e8dc-0a55-49ee-be9f-b65cc1b1f917 None admin] PATH_INFO: `/v3/groups/8ab68c043fb3476aacabf2bd9384cb6a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:12.140417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434e8dc-0a55-49ee-be9f-b65cc1b1f917 None admin] RBAC: Authorizing `identity:get_group(group_id=8ab68c043fb3476aacabf2bd9384cb6a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:12.141857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434e8dc-0a55-49ee-be9f-b65cc1b1f917 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:12.144165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 226/454] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jun 8 06:28:11 2022] GET /identity/v3/groups/8ab68c043fb3476aacabf2bd9384cb6a => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:12.149867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2cbb2-36fb-4682-ab55-27e8cdcc50ce None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:12.152819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:12.249070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2cbb2-36fb-4682-ab55-27e8cdcc50ce None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:12.281047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38e936-90d4-4474-abef-ba638464b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:12.281690 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38e936-90d4-4474-abef-ba638464b884 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:12.281976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38e936-90d4-4474-abef-ba638464b884 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:12.282278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38e936-90d4-4474-abef-ba638464b884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:12.283739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38e936-90d4-4474-abef-ba638464b884 None admin] RBAC: Adding query filter params (group.id=8ab68c043fb3476aacabf2bd9384cb6a, role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=87773f44fe964196963231d64fa11c8f) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:12.284053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38e936-90d4-4474-abef-ba638464b884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:12.285472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38e936-90d4-4474-abef-ba638464b884 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:12.291153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 229/455] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jun 8 06:28:12 2022] GET /identity/v3/role_assignments?group.id=8ab68c043fb3476aacabf2bd9384cb6a&scope.project.id=87773f44fe964196963231d64fa11c8f&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:14.892254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980e797-bf41-4030-b895-b9d09edcf7fa None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:14.893151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980e797-bf41-4030-b895-b9d09edcf7fa None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:14.893575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980e797-bf41-4030-b895-b9d09edcf7fa None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:14.895534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 227/456] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:14.901923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3f28b-96e8-4d76-a714-a657505a3e3e None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:14.902805 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3f28b-96e8-4d76-a714-a657505a3e3e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:14.903226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3f28b-96e8-4d76-a714-a657505a3e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:14.921782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-5eb3f28b-96e8-4d76-a714-a657505a3e3e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:14.923421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5eb3f28b-96e8-4d76-a714-a657505a3e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:15.003150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:15.010772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 230/457] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:28:15.035385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980e797-bf41-4030-b895-b9d09edcf7fa None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:15.188524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980e797-bf41-4030-b895-b9d09edcf7fa None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:15.224636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33619ad-66fc-47dd-bd0f-17cbc1530394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:15.225428 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33619ad-66fc-47dd-bd0f-17cbc1530394 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:15.225708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33619ad-66fc-47dd-bd0f-17cbc1530394 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:15.225982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33619ad-66fc-47dd-bd0f-17cbc1530394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:15.236478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33619ad-66fc-47dd-bd0f-17cbc1530394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:15.238490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33619ad-66fc-47dd-bd0f-17cbc1530394 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:15.250678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-c33619ad-66fc-47dd-bd0f-17cbc1530394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:15.260057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:15.260912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:15.261736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:15.261736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:15.261736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:15.261736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:15.262436 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 228/458] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:15.268221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3f28b-96e8-4d76-a714-a657505a3e3e None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:15.290702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2e44-36ef-43fa-8033-e81a07e09b89 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:15.291020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2e44-36ef-43fa-8033-e81a07e09b89 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:15.291261 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2e44-36ef-43fa-8033-e81a07e09b89 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:15.293598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 229/459] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:15.304049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b4a7a-385e-461e-9ca6-c8e6f110ef0c None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:15.304357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b4a7a-385e-461e-9ca6-c8e6f110ef0c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:15.304612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b4a7a-385e-461e-9ca6-c8e6f110ef0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:15.335259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-d07b4a7a-385e-461e-9ca6-c8e6f110ef0c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:15.336451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d07b4a7a-385e-461e-9ca6-c8e6f110ef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:15.379710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3f28b-96e8-4d76-a714-a657505a3e3e None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:15.425629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9366ca0-07eb-40ad-9ca4-f3f957e1c109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:15.426871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366ca0-07eb-40ad-9ca4-f3f957e1c109 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:15.427348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366ca0-07eb-40ad-9ca4-f3f957e1c109 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:15.427839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366ca0-07eb-40ad-9ca4-f3f957e1c109 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:15.428777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9366ca0-07eb-40ad-9ca4-f3f957e1c109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:15.429292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9366ca0-07eb-40ad-9ca4-f3f957e1c109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:15.431034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9366ca0-07eb-40ad-9ca4-f3f957e1c109 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:15.444509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 231/460] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:15.456173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9366ca0-07eb-40ad-9ca4-f3f957e1c109 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:15.458287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 230/461] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:15.506826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b4a7a-385e-461e-9ca6-c8e6f110ef0c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:15.547491 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:15.605668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9366ca0-07eb-40ad-9ca4-f3f957e1c109 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:15.635778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b4a7a-385e-461e-9ca6-c8e6f110ef0c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:15.651293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed18b6-de85-45cf-b012-32841ec30885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:15.651987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed18b6-de85-45cf-b012-32841ec30885 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:15.652524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed18b6-de85-45cf-b012-32841ec30885 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:15.652814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed18b6-de85-45cf-b012-32841ec30885 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:15.653542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed18b6-de85-45cf-b012-32841ec30885 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:15.655674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed18b6-de85-45cf-b012-32841ec30885 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:15.663808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:15.673343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1e3a6-f18c-4f62-b7dc-7b3bde877d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:15.677274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e3a6-f18c-4f62-b7dc-7b3bde877d3a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:15.677274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e3a6-f18c-4f62-b7dc-7b3bde877d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:15.677274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e3a6-f18c-4f62-b7dc-7b3bde877d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:15.685246 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1e3a6-f18c-4f62-b7dc-7b3bde877d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:15.686809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1e3a6-f18c-4f62-b7dc-7b3bde877d3a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-96b1e3a6-f18c-4f62-b7dc-7b3bde877d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:15.707633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:15.708615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:15.709546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:15.709546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:15.709546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:15.709546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:15.709546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 231/462] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:15.712391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b7a46-ea33-48ab-87bd-d8da4076f4be None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:15.712391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b7a46-ea33-48ab-87bd-d8da4076f4be None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:15.712391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b7a46-ea33-48ab-87bd-d8da4076f4be None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:15.716131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 232/463] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:15.716923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b7a46-ea33-48ab-87bd-d8da4076f4be None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:15.744026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 232/464] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:28:15 2022] POST /identity/v3/users => generated 246 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:28:15.746061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb6b73-594e-4461-aa09-704288e02614 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:15.746433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb6b73-594e-4461-aa09-704288e02614 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:15.746719 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb6b73-594e-4461-aa09-704288e02614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:15.770326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-edcb6b73-594e-4461-aa09-704288e02614 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:15.771867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-edcb6b73-594e-4461-aa09-704288e02614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:15.838373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b7a46-ea33-48ab-87bd-d8da4076f4be None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:15.872042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 233/465] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:15.873726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cb0c9-a36e-43df-b620-c02da71dbfd3 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:15.874193 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cb0c9-a36e-43df-b620-c02da71dbfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:15.874649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cb0c9-a36e-43df-b620-c02da71dbfd3 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:15.876512 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 234/466] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:15.883046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056fa5f-59ed-4d12-86ef-1fbfc4a01ceb None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:15.883448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056fa5f-59ed-4d12-86ef-1fbfc4a01ceb None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:15.883565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3bcf-347e-4f76-a656-4efac77194ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:15.883930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056fa5f-59ed-4d12-86ef-1fbfc4a01ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:15.884116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3bcf-347e-4f76-a656-4efac77194ed None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:15.884405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3bcf-347e-4f76-a656-4efac77194ed None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:15.884680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3bcf-347e-4f76-a656-4efac77194ed None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:15.885424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b3bcf-347e-4f76-a656-4efac77194ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:15.885830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b3bcf-347e-4f76-a656-4efac77194ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:15.887331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b3bcf-347e-4f76-a656-4efac77194ed None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:15.903393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 233/467] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:15.910164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3bcf-347e-4f76-a656-4efac77194ed None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:15.917393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-b056fa5f-59ed-4d12-86ef-1fbfc4a01ceb None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:15.918791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b056fa5f-59ed-4d12-86ef-1fbfc4a01ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:15.960174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:15.967626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:15.998379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 235/468] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:15.999646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056fa5f-59ed-4d12-86ef-1fbfc4a01ceb None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:16.048353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3bcf-347e-4f76-a656-4efac77194ed None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:16.094558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c85c-2abd-49a9-900e-6f3acf7921e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:16.096025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c85c-2abd-49a9-900e-6f3acf7921e5 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:16.096315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c85c-2abd-49a9-900e-6f3acf7921e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:16.096592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c85c-2abd-49a9-900e-6f3acf7921e5 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:16.097319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7c85c-2abd-49a9-900e-6f3acf7921e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:16.098992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7c85c-2abd-49a9-900e-6f3acf7921e5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:16.182849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 234/469] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:28:15 2022] POST /identity/v3/users => generated 248 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:28:16.184338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c85c-2abd-49a9-900e-6f3acf7921e5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:16.249102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056fa5f-59ed-4d12-86ef-1fbfc4a01ceb None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:16.295384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124cd61-bba0-495f-a76e-a08936e5f06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:16.295384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124cd61-bba0-495f-a76e-a08936e5f06a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:16.295384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124cd61-bba0-495f-a76e-a08936e5f06a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:16.295384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124cd61-bba0-495f-a76e-a08936e5f06a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:16.308435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124cd61-bba0-495f-a76e-a08936e5f06a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:16.310819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124cd61-bba0-495f-a76e-a08936e5f06a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-3124cd61-bba0-495f-a76e-a08936e5f06a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:16.334517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:16.335413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:16.336251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:16.336251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:16.336251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:16.336251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:16.336489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 236/470] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:16.342312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124cd61-bba0-495f-a76e-a08936e5f06a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:16.382623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:16.425206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:16.433737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c85c-2abd-49a9-900e-6f3acf7921e5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:16.479369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386f4af-aa18-489a-98fb-3394854b801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:16.480529 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386f4af-aa18-489a-98fb-3394854b801b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:16.480880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386f4af-aa18-489a-98fb-3394854b801b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:16.481225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386f4af-aa18-489a-98fb-3394854b801b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:16.496701 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386f4af-aa18-489a-98fb-3394854b801b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:16.499101 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386f4af-aa18-489a-98fb-3394854b801b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:16.503819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124cd61-bba0-495f-a76e-a08936e5f06a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-c386f4af-aa18-489a-98fb-3394854b801b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:16.525674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:16.528142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:16.528996 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:16.528996 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:16.528996 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:16.528996 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:16.528996 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 235/471] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:16.535298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386f4af-aa18-489a-98fb-3394854b801b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:16.549295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f321f-f934-4ab0-8e4f-4a4817f0d064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:16.550655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f321f-f934-4ab0-8e4f-4a4817f0d064 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:16.551114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f321f-f934-4ab0-8e4f-4a4817f0d064 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:16.551615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f321f-f934-4ab0-8e4f-4a4817f0d064 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:16.552838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f321f-f934-4ab0-8e4f-4a4817f0d064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:16.553469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f321f-f934-4ab0-8e4f-4a4817f0d064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:16.555368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f321f-f934-4ab0-8e4f-4a4817f0d064 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:16.572422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 237/472] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:16.577726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f321f-f934-4ab0-8e4f-4a4817f0d064 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:16.667164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386f4af-aa18-489a-98fb-3394854b801b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:16.701702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f321f-f934-4ab0-8e4f-4a4817f0d064 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:16.703419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:16.706773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9c961-6ea1-48d7-b531-cb11ac0bfe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:16.707440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9c961-6ea1-48d7-b531-cb11ac0bfe0d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:16.707722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9c961-6ea1-48d7-b531-cb11ac0bfe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:16.707998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9c961-6ea1-48d7-b531-cb11ac0bfe0d None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:16.708726 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9c961-6ea1-48d7-b531-cb11ac0bfe0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:16.711131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9c961-6ea1-48d7-b531-cb11ac0bfe0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:16.713358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9c961-6ea1-48d7-b531-cb11ac0bfe0d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:16.729706 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 236/473] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:16.731084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127780e-46cf-4906-85be-a4ae14cd82bf None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:16.731370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127780e-46cf-4906-85be-a4ae14cd82bf None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:16.731643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127780e-46cf-4906-85be-a4ae14cd82bf None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:16.732958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 237/474] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:16.739301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127780e-46cf-4906-85be-a4ae14cd82bf None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:16.746320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de3224-3ad8-427a-a6ce-0a5c3a1579e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:16.747015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de3224-3ad8-427a-a6ce-0a5c3a1579e8 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:16.747298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de3224-3ad8-427a-a6ce-0a5c3a1579e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:16.747577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de3224-3ad8-427a-a6ce-0a5c3a1579e8 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:16.748530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:16.748870 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de3224-3ad8-427a-a6ce-0a5c3a1579e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:16.750457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de3224-3ad8-427a-a6ce-0a5c3a1579e8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:16.842601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 238/475] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:28:16 2022] POST /identity/v3/users => generated 248 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:28:16.843780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e0a2e-23ff-4d0a-a1a7-c78e7722a7eb None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:16.844074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e0a2e-23ff-4d0a-a1a7-c78e7722a7eb None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:16.844359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e0a2e-23ff-4d0a-a1a7-c78e7722a7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:16.877543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0b1e0a2e-23ff-4d0a-a1a7-c78e7722a7eb None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:16.881087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0b1e0a2e-23ff-4d0a-a1a7-c78e7722a7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:16.887769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127780e-46cf-4906-85be-a4ae14cd82bf None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:16.955888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4de51d-0f10-4927-935f-90f540aaafda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:16.956656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4de51d-0f10-4927-935f-90f540aaafda None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:16.962299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4de51d-0f10-4927-935f-90f540aaafda None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:16.962299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4de51d-0f10-4927-935f-90f540aaafda None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:16.962299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4de51d-0f10-4927-935f-90f540aaafda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:16.964564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4de51d-0f10-4927-935f-90f540aaafda None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:16.997082 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 239/476] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:17.022012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e0a2e-23ff-4d0a-a1a7-c78e7722a7eb None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:17.078185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 238/477] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:28:16 2022] POST /identity/v3/users => generated 249 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:28:17.107463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:17.159261 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e0a2e-23ff-4d0a-a1a7-c78e7722a7eb None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:17.201146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414d560-9025-4b51-baf0-eb15f2ad7e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:17.201825 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414d560-9025-4b51-baf0-eb15f2ad7e51 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:17.202102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414d560-9025-4b51-baf0-eb15f2ad7e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:17.202400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414d560-9025-4b51-baf0-eb15f2ad7e51 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:17.203178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414d560-9025-4b51-baf0-eb15f2ad7e51 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:17.205139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414d560-9025-4b51-baf0-eb15f2ad7e51 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:17.248231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.sql.core [None req-f414d560-9025-4b51-baf0-eb15f2ad7e51 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 06:28:17.248231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 08 06:28:17.248231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [parameters: {'id': '62392f0657bc4a458c52561e5911017c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 08 06:28:17.248231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80764) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-f414d560-9025-4b51-baf0-eb15f2ad7e51 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application conn.query(q) Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result.read() Jun 08 06:28:17.266995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return ref.to_dict() Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 06:28:17.268413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application next(self.gen) Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application yield resource Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application next(self.gen) Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise self.value Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application session.commit() Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 06:28:17.269299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.session.flush() Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application compat.raise_( Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 06:28:17.270129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 06:28:17.271059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application conn.query(q) Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result.read() Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 06:28:17.271881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [parameters: {'id': '62392f0657bc4a458c52561e5911017c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:17.272668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 08 06:28:17.275074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:17.277005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 240/478] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Jun 8 06:28:17 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:17.277147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4de51d-0f10-4927-935f-90f540aaafda None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:17.353629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:17.391379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4de51d-0f10-4927-935f-90f540aaafda None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:17.426867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710eef14-4173-47dd-981b-7437068f0189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:17.427686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710eef14-4173-47dd-981b-7437068f0189 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:17.427973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710eef14-4173-47dd-981b-7437068f0189 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:17.428253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710eef14-4173-47dd-981b-7437068f0189 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:17.439834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710eef14-4173-47dd-981b-7437068f0189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-710eef14-4173-47dd-981b-7437068f0189 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:17.448454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:17.450822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:17.452732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 239/479] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:28:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:17.459309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414d560-9025-4b51-baf0-eb15f2ad7e51 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:17.569836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414d560-9025-4b51-baf0-eb15f2ad7e51 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:17.604693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67442fe5-34ed-4c79-9ae9-90a98a71fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:17.605377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442fe5-34ed-4c79-9ae9-90a98a71fe1a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:17.605660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442fe5-34ed-4c79-9ae9-90a98a71fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:17.605938 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442fe5-34ed-4c79-9ae9-90a98a71fe1a None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:17.606730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67442fe5-34ed-4c79-9ae9-90a98a71fe1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:17.607038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67442fe5-34ed-4c79-9ae9-90a98a71fe1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:17.608411 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67442fe5-34ed-4c79-9ae9-90a98a71fe1a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:17.609749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:17.619120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 241/480] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:18.394277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df39fd-3535-4134-b520-9ccd6207e675 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:18.394277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df39fd-3535-4134-b520-9ccd6207e675 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:18.394277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df39fd-3535-4134-b520-9ccd6207e675 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:18.394277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 240/481] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:18.401110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418709ef-8def-4516-abf2-0d64499c23b9 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:18.401110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418709ef-8def-4516-abf2-0d64499c23b9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:18.401110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418709ef-8def-4516-abf2-0d64499c23b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:18.423840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-418709ef-8def-4516-abf2-0d64499c23b9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:18.425386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-418709ef-8def-4516-abf2-0d64499c23b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:18.509008 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 242/482] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:18.555696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df39fd-3535-4134-b520-9ccd6207e675 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:18.677634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df39fd-3535-4134-b520-9ccd6207e675 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:18.710807 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:18.724506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828774e-f2a2-41bd-8e01-6dda7a6c8ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:18.725424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828774e-f2a2-41bd-8e01-6dda7a6c8ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:18.725589 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828774e-f2a2-41bd-8e01-6dda7a6c8ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:18.725862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828774e-f2a2-41bd-8e01-6dda7a6c8ab0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:18.743943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828774e-f2a2-41bd-8e01-6dda7a6c8ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-4828774e-f2a2-41bd-8e01-6dda7a6c8ab0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:18.752287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:18.753158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:18.754011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 241/483] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:18.759372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418709ef-8def-4516-abf2-0d64499c23b9 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:18.861553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418709ef-8def-4516-abf2-0d64499c23b9 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:18.894591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:18.905279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc92b0-35a8-4075-b613-1854442ca164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:18.905952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc92b0-35a8-4075-b613-1854442ca164 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:18.906252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc92b0-35a8-4075-b613-1854442ca164 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:18.906536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc92b0-35a8-4075-b613-1854442ca164 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:18.908388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc92b0-35a8-4075-b613-1854442ca164 None admin] RBAC: Adding query filter params (name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:18.908388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc92b0-35a8-4075-b613-1854442ca164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:18.908978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc92b0-35a8-4075-b613-1854442ca164 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:18.922202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 243/484] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:18.927359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828774e-f2a2-41bd-8e01-6dda7a6c8ab0 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:19.081317 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828774e-f2a2-41bd-8e01-6dda7a6c8ab0 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:19.096359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6c31b-3cf0-4ae4-b6b8-eef4873070c5 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:19.097006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6c31b-3cf0-4ae4-b6b8-eef4873070c5 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:19.097479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6c31b-3cf0-4ae4-b6b8-eef4873070c5 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:19.099539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 244/485] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:19.104680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361560c3-3abc-4d69-8d01-83a9c256f01b None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:19.105218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361560c3-3abc-4d69-8d01-83a9c256f01b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:19.105760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361560c3-3abc-4d69-8d01-83a9c256f01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:19.125196 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-361560c3-3abc-4d69-8d01-83a9c256f01b None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:19.127039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-361560c3-3abc-4d69-8d01-83a9c256f01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:19.141270 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d5bf8-918c-497b-8644-1468405ff0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:19.142114 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d5bf8-918c-497b-8644-1468405ff0be None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:19.142430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d5bf8-918c-497b-8644-1468405ff0be None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:19.142707 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d5bf8-918c-497b-8644-1468405ff0be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:19.153255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d5bf8-918c-497b-8644-1468405ff0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:19.154745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d5bf8-918c-497b-8644-1468405ff0be None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-d81d5bf8-918c-497b-8644-1468405ff0be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:19.184254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:19.185151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:19.185978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:19.185978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:19.185978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:19.185978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:19.188807 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 242/486] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:19.191852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d5bf8-918c-497b-8644-1468405ff0be None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:19.250937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 245/487] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:28:19.259519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:19.285719 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361560c3-3abc-4d69-8d01-83a9c256f01b None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:19.369176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d5bf8-918c-497b-8644-1468405ff0be None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:19.412562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e4bee-c7dc-4626-bc49-cf30d40e5d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:19.415395 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e4bee-c7dc-4626-bc49-cf30d40e5d40 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:19.416196 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e4bee-c7dc-4626-bc49-cf30d40e5d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:19.417004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e4bee-c7dc-4626-bc49-cf30d40e5d40 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:19.419082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e4bee-c7dc-4626-bc49-cf30d40e5d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:19.420381 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e4bee-c7dc-4626-bc49-cf30d40e5d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:19.422554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e4bee-c7dc-4626-bc49-cf30d40e5d40 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:19.439847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 243/488] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:19.445267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e4bee-c7dc-4626-bc49-cf30d40e5d40 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:19.488205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361560c3-3abc-4d69-8d01-83a9c256f01b None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:19.526153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:19.546372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890deb25-4858-49a9-acd0-a62c8fc22819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:19.547427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890deb25-4858-49a9-acd0-a62c8fc22819 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:19.547888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890deb25-4858-49a9-acd0-a62c8fc22819 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:19.548891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890deb25-4858-49a9-acd0-a62c8fc22819 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:19.560071 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890deb25-4858-49a9-acd0-a62c8fc22819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-890deb25-4858-49a9-acd0-a62c8fc22819 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:19.568361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:19.569419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:19.570414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:19.572717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 246/489] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:19.582371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890deb25-4858-49a9-acd0-a62c8fc22819 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:19.687450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:19.695775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e4bee-c7dc-4626-bc49-cf30d40e5d40 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:19.758484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf105a0-d305-4dfc-9e5b-b03e5b47ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:19.759280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf105a0-d305-4dfc-9e5b-b03e5b47ab7a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:19.759808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf105a0-d305-4dfc-9e5b-b03e5b47ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:19.760084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf105a0-d305-4dfc-9e5b-b03e5b47ab7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:19.765957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890deb25-4858-49a9-acd0-a62c8fc22819 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:19.777333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf105a0-d305-4dfc-9e5b-b03e5b47ab7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:19.778809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf105a0-d305-4dfc-9e5b-b03e5b47ab7a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-9bf105a0-d305-4dfc-9e5b-b03e5b47ab7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:19.804039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:19.804961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:19.805854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:19.805854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:19.805854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:19.805854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:19.805854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:19.805854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:19.805854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:19.805854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:19.805854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:19.805854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:19.805854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 244/490] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jun 8 06:28:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:19.812574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf105a0-d305-4dfc-9e5b-b03e5b47ab7a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:19.830951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e0629-da6a-431e-a70c-a844db85734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:19.831630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e0629-da6a-431e-a70c-a844db85734a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:19.831914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e0629-da6a-431e-a70c-a844db85734a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:19.832190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e0629-da6a-431e-a70c-a844db85734a None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:19.832948 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e0629-da6a-431e-a70c-a844db85734a None admin] RBAC: Adding query filter params (name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:19.833257 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e0629-da6a-431e-a70c-a844db85734a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:19.834656 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e0629-da6a-431e-a70c-a844db85734a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:19.848052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 247/491] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:19.859204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e0629-da6a-431e-a70c-a844db85734a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:19.926114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:19.978775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf105a0-d305-4dfc-9e5b-b03e5b47ab7a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:19.992986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e0629-da6a-431e-a70c-a844db85734a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:20.012127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e227c2a-2d95-47ab-ad53-05de39f396b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:20.013035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e227c2a-2d95-47ab-ad53-05de39f396b5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.013467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e227c2a-2d95-47ab-ad53-05de39f396b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.013884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e227c2a-2d95-47ab-ad53-05de39f396b5 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.014909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e227c2a-2d95-47ab-ad53-05de39f396b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:20.015375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e227c2a-2d95-47ab-ad53-05de39f396b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:20.016816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e227c2a-2d95-47ab-ad53-05de39f396b5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:20.029837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103a13d-dafe-4330-9558-0f078934bc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:20.030670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a13d-dafe-4330-9558-0f078934bc9e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.030952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a13d-dafe-4330-9558-0f078934bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.031227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a13d-dafe-4330-9558-0f078934bc9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.041966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103a13d-dafe-4330-9558-0f078934bc9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:20.043446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103a13d-dafe-4330-9558-0f078934bc9e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:20.056083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 245/492] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jun 8 06:28:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-6103a13d-dafe-4330-9558-0f078934bc9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:20.061013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:20.061831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:20.067883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:20.067883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:20.067883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:20.067883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:20.068109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e451e-8bf0-4671-9917-0f83c59b58bc None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.068109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e451e-8bf0-4671-9917-0f83c59b58bc None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.068226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 248/493] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:20.068287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e451e-8bf0-4671-9917-0f83c59b58bc None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.068348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf02b1-9c62-4989-a388-cae8d753936f None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.068419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 246/494] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:20.068419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e451e-8bf0-4671-9917-0f83c59b58bc None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:20.068777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf02b1-9c62-4989-a388-cae8d753936f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.068965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf02b1-9c62-4989-a388-cae8d753936f None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.070359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 249/495] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:20.071096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf02b1-9c62-4989-a388-cae8d753936f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:20.083301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:20.170090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:20.182300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf02b1-9c62-4989-a388-cae8d753936f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:20.186514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e451e-8bf0-4671-9917-0f83c59b58bc None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:20.219634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fe3ba-c3ae-4b47-a1e3-eedc4b5d625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:20.220586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe3ba-c3ae-4b47-a1e3-eedc4b5d625c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.220866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe3ba-c3ae-4b47-a1e3-eedc4b5d625c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.221135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe3ba-c3ae-4b47-a1e3-eedc4b5d625c None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.221873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fe3ba-c3ae-4b47-a1e3-eedc4b5d625c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:20.222153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fe3ba-c3ae-4b47-a1e3-eedc4b5d625c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:20.223540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fe3ba-c3ae-4b47-a1e3-eedc4b5d625c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:20.223782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e08fec-588d-4a36-8e8e-ddbc46689b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:20.224546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08fec-588d-4a36-8e8e-ddbc46689b82 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.225012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08fec-588d-4a36-8e8e-ddbc46689b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.225297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08fec-588d-4a36-8e8e-ddbc46689b82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.235661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 250/496] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:20.237608 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07a7b-c399-40e1-a4f3-7973f264cd23 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.238419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07a7b-c399-40e1-a4f3-7973f264cd23 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.239187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07a7b-c399-40e1-a4f3-7973f264cd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.256845 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-b7d07a7b-c399-40e1-a4f3-7973f264cd23 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:20.258213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b7d07a7b-c399-40e1-a4f3-7973f264cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:20.302034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e08fec-588d-4a36-8e8e-ddbc46689b82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:20.303842 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e08fec-588d-4a36-8e8e-ddbc46689b82 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:20.320648 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:20.335608 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 251/497] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:20.340156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2b36-0385-4fe0-9fee-893761ba2fce None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.340689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2b36-0385-4fe0-9fee-893761ba2fce None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.341164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2b36-0385-4fe0-9fee-893761ba2fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.361961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-076d2b36-0385-4fe0-9fee-893761ba2fce None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:20.363176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-076d2b36-0385-4fe0-9fee-893761ba2fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:20.412340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 247/498] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:20.413006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e08fec-588d-4a36-8e8e-ddbc46689b82 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:20.441154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 252/499] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:20.442016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d2b36-0385-4fe0-9fee-893761ba2fce None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:20.463176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:20.530104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e08fec-588d-4a36-8e8e-ddbc46689b82 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:20.543659 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:20.554605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d2b36-0385-4fe0-9fee-893761ba2fce None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:20.566127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1fcf-6780-46b5-ba7b-de739a0c6359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:20.567024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1fcf-6780-46b5-ba7b-de739a0c6359 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.567309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1fcf-6780-46b5-ba7b-de739a0c6359 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.567590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1fcf-6780-46b5-ba7b-de739a0c6359 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.575149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad1fcf-6780-46b5-ba7b-de739a0c6359 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:20.576599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad1fcf-6780-46b5-ba7b-de739a0c6359 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:20.591263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6026d7-c9a8-47e7-8ea9-699c09bb0ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:20.592056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6026d7-c9a8-47e7-8ea9-699c09bb0ded None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-c8ad1fcf-6780-46b5-ba7b-de739a0c6359 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:20.592287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:20.593137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:20.598891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:20.598891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:20.598891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:20.598891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:20.598891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:20.598891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:20.598891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:20.598891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:20.598891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 06:28:20.598891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:20.599445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6026d7-c9a8-47e7-8ea9-699c09bb0ded None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.599445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6026d7-c9a8-47e7-8ea9-699c09bb0ded None admin] PATH_INFO: `/v3/roles/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.599577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 248/500] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:20.599577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1fcf-6780-46b5-ba7b-de739a0c6359 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:20.607533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6026d7-c9a8-47e7-8ea9-699c09bb0ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-1f6026d7-c9a8-47e7-8ea9-699c09bb0ded None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:20.616324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:20.617214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 253/501] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:20.623098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6026d7-c9a8-47e7-8ea9-699c09bb0ded None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:20.698174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:20.707745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1fcf-6780-46b5-ba7b-de739a0c6359 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:20.727039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6026d7-c9a8-47e7-8ea9-699c09bb0ded None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:20.741941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1251daf-05ee-4299-9687-55d513acc862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:20.742762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1251daf-05ee-4299-9687-55d513acc862 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.743046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1251daf-05ee-4299-9687-55d513acc862 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.743320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1251daf-05ee-4299-9687-55d513acc862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.754178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1251daf-05ee-4299-9687-55d513acc862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:20.755634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1251daf-05ee-4299-9687-55d513acc862 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:20.761557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfff6d-d9d3-4a7d-93b4-893e643ab1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:20.762367 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfff6d-d9d3-4a7d-93b4-893e643ab1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.762679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfff6d-d9d3-4a7d-93b4-893e643ab1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.762927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfff6d-d9d3-4a7d-93b4-893e643ab1a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.772836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfff6d-d9d3-4a7d-93b4-893e643ab1a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-b1251daf-05ee-4299-9687-55d513acc862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:20.773108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:20.773912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:20.774860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:20.774860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:20.774860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:20.774860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:20.774860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 249/502] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:20.775154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1251daf-05ee-4299-9687-55d513acc862 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-d4bfff6d-d9d3-4a7d-93b4-893e643ab1a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:20.780523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:20.781566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 254/503] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:20.782937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfff6d-d9d3-4a7d-93b4-893e643ab1a3 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:20.805441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:20.878354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1251daf-05ee-4299-9687-55d513acc862 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:20.887122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfff6d-d9d3-4a7d-93b4-893e643ab1a3 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:20.912004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbc629-3bde-4676-9c43-b223c290ce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:20.912599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbc629-3bde-4676-9c43-b223c290ce02 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.912883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbc629-3bde-4676-9c43-b223c290ce02 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.913166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbc629-3bde-4676-9c43-b223c290ce02 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.914001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbc629-3bde-4676-9c43-b223c290ce02 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:20.914435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbc629-3bde-4676-9c43-b223c290ce02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:20.915868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:20.915977 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbc629-3bde-4676-9c43-b223c290ce02 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:20.920487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7462fa-16eb-4809-b388-5a726c6140b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:20.921143 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7462fa-16eb-4809-b388-5a726c6140b3 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.921425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7462fa-16eb-4809-b388-5a726c6140b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.921705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7462fa-16eb-4809-b388-5a726c6140b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.922487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7462fa-16eb-4809-b388-5a726c6140b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:20.928492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7462fa-16eb-4809-b388-5a726c6140b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:20.928492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7462fa-16eb-4809-b388-5a726c6140b3 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:20.932888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 255/504] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:20.937789 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 250/505] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jun 8 06:28:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:20.937930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab25a8-51aa-44e2-8db3-37936094298a None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:20.938039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbc629-3bde-4676-9c43-b223c290ce02 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:20.938123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab25a8-51aa-44e2-8db3-37936094298a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:20.938123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab25a8-51aa-44e2-8db3-37936094298a None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:20.938123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 256/506] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:20.938123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab25a8-51aa-44e2-8db3-37936094298a None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:21.017686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:21.035680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbc629-3bde-4676-9c43-b223c290ce02 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:21.036060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab25a8-51aa-44e2-8db3-37936094298a None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:21.073243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b55776-7233-4f80-984b-359a5041c63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:21.073900 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55776-7233-4f80-984b-359a5041c63d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:21.074179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55776-7233-4f80-984b-359a5041c63d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:21.074808 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55776-7233-4f80-984b-359a5041c63d None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:21.075483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b55776-7233-4f80-984b-359a5041c63d None admin] RBAC: Adding query filter params (name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:21.075783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b55776-7233-4f80-984b-359a5041c63d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:21.076246 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4716a-aff8-4d92-82e0-af5a3dfc29e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:21.076904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4716a-aff8-4d92-82e0-af5a3dfc29e7 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:21.077133 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b55776-7233-4f80-984b-359a5041c63d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:21.077222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4716a-aff8-4d92-82e0-af5a3dfc29e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:21.077448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4716a-aff8-4d92-82e0-af5a3dfc29e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:21.078165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4716a-aff8-4d92-82e0-af5a3dfc29e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:21.078517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4716a-aff8-4d92-82e0-af5a3dfc29e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:21.079876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4716a-aff8-4d92-82e0-af5a3dfc29e7 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:21.085064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 257/507] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:21.086108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b55776-7233-4f80-984b-359a5041c63d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:21.099302 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 251/508] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:21.099302 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4716a-aff8-4d92-82e0-af5a3dfc29e7 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:21.141446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:21.185400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b55776-7233-4f80-984b-359a5041c63d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:21.221777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f435a8-4c1e-4ea3-9c52-615de49289aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:21.222618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f435a8-4c1e-4ea3-9c52-615de49289aa None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:21.222902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f435a8-4c1e-4ea3-9c52-615de49289aa None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:21.223172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f435a8-4c1e-4ea3-9c52-615de49289aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:21.235151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f435a8-4c1e-4ea3-9c52-615de49289aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:21.236688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f435a8-4c1e-4ea3-9c52-615de49289aa None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-18f435a8-4c1e-4ea3-9c52-615de49289aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:21.254911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:21.255858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:21.256675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:21.256675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:21.256675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:21.256675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:21.256675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 258/509] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:21.257752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241f602-c7d9-4529-b9df-f9bc5f1c4657 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:21.258041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241f602-c7d9-4529-b9df-f9bc5f1c4657 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:21.258342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241f602-c7d9-4529-b9df-f9bc5f1c4657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:21.278358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-b241f602-c7d9-4529-b9df-f9bc5f1c4657 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:21.279556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b241f602-c7d9-4529-b9df-f9bc5f1c4657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:21.319094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4716a-aff8-4d92-82e0-af5a3dfc29e7 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:21.346639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 259/510] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:21.347479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241f602-c7d9-4529-b9df-f9bc5f1c4657 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:21.353386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71870a-1348-4102-b65a-c074f9d23cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:21.354021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71870a-1348-4102-b65a-c074f9d23cad None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:21.354326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71870a-1348-4102-b65a-c074f9d23cad None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:21.354601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71870a-1348-4102-b65a-c074f9d23cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:21.366337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:21.396982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:21.422910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71870a-1348-4102-b65a-c074f9d23cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:21.424365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71870a-1348-4102-b65a-c074f9d23cad None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:21.455973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241f602-c7d9-4529-b9df-f9bc5f1c4657 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:21.489612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e08f0-4f89-4b7b-88f2-58b5804e3eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:21.490444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e08f0-4f89-4b7b-88f2-58b5804e3eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:21.490728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e08f0-4f89-4b7b-88f2-58b5804e3eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:21.491000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e08f0-4f89-4b7b-88f2-58b5804e3eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:21.503278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e08f0-4f89-4b7b-88f2-58b5804e3eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:21.504723 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e08f0-4f89-4b7b-88f2-58b5804e3eb5 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-729e08f0-4f89-4b7b-88f2-58b5804e3eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:21.523139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:21.524004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:21.529631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:21.529631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:21.529631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:21.529631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:21.529884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 252/511] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:21.529965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 260/512] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:21.530048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71870a-1348-4102-b65a-c074f9d23cad None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:21.530128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e08f0-4f89-4b7b-88f2-58b5804e3eb5 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:21.618071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:21.662139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:21.671535 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e08f0-4f89-4b7b-88f2-58b5804e3eb5 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:21.673232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71870a-1348-4102-b65a-c074f9d23cad None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:21.705897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c1f10-d44c-4956-b293-136b9d091166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:21.706206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b82126-5869-4d7d-b31e-aad9648336c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:21.706584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c1f10-d44c-4956-b293-136b9d091166 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:21.706867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c1f10-d44c-4956-b293-136b9d091166 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:21.707011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82126-5869-4d7d-b31e-aad9648336c3 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:21.707139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c1f10-d44c-4956-b293-136b9d091166 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:21.707292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82126-5869-4d7d-b31e-aad9648336c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:21.707565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82126-5869-4d7d-b31e-aad9648336c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:21.707852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c1f10-d44c-4956-b293-136b9d091166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:21.708160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c1f10-d44c-4956-b293-136b9d091166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:21.709517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c1f10-d44c-4956-b293-136b9d091166 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:21.714089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b82126-5869-4d7d-b31e-aad9648336c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:21.715531 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b82126-5869-4d7d-b31e-aad9648336c3 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:21.720496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 261/513] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:21.721265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c1f10-d44c-4956-b293-136b9d091166 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-b6b82126-5869-4d7d-b31e-aad9648336c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:21.730013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:21.731061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:21.731958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:21.731958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:21.731958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:21.731958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:21.731958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:21.731958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:21.731958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:21.731958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:21.731958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 253/514] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:21.732411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b82126-5869-4d7d-b31e-aad9648336c3 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:21.822689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c1f10-d44c-4956-b293-136b9d091166 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:21.830429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b82126-5869-4d7d-b31e-aad9648336c3 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:21.831939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:21.857227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5fd5-a444-438e-a25f-5bd26803a922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:21.858016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5fd5-a444-438e-a25f-5bd26803a922 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:21.858335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5fd5-a444-438e-a25f-5bd26803a922 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:21.858683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5fd5-a444-438e-a25f-5bd26803a922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:21.863059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07b9bb-5c55-4e9c-b745-1943ccfd8fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:21.863834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b9bb-5c55-4e9c-b745-1943ccfd8fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:21.864118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b9bb-5c55-4e9c-b745-1943ccfd8fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:21.864391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b9bb-5c55-4e9c-b745-1943ccfd8fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:21.869149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa5fd5-a444-438e-a25f-5bd26803a922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:21.870558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa5fd5-a444-438e-a25f-5bd26803a922 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:21.874642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07b9bb-5c55-4e9c-b745-1943ccfd8fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:21.876064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07b9bb-5c55-4e9c-b745-1943ccfd8fe5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-bffa5fd5-a444-438e-a25f-5bd26803a922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:21.887846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:21.888804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:21.889634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:21.889634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:21.889634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:21.889634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:21.889634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 262/515] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:21.889883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5fd5-a444-438e-a25f-5bd26803a922 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:21.893065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-fa07b9bb-5c55-4e9c-b745-1943ccfd8fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:21.894400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:21.895212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:21.896035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:21.896035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:21.896035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:21.896035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:21.896035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 254/516] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:21.896710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07b9bb-5c55-4e9c-b745-1943ccfd8fe5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:21.990967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5fd5-a444-438e-a25f-5bd26803a922 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:21.993717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07b9bb-5c55-4e9c-b745-1943ccfd8fe5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:22.023903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4abb8c-82f4-4e1e-ac9f-123cee7b2eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.024558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4abb8c-82f4-4e1e-ac9f-123cee7b2eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.024838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4abb8c-82f4-4e1e-ac9f-123cee7b2eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.025111 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4abb8c-82f4-4e1e-ac9f-123cee7b2eb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:22.025833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4abb8c-82f4-4e1e-ac9f-123cee7b2eb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:22.026138 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4abb8c-82f4-4e1e-ac9f-123cee7b2eb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:22.027530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4abb8c-82f4-4e1e-ac9f-123cee7b2eb8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:22.028137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce20a5-5a45-4545-a0b1-a69b596afa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.028923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce20a5-5a45-4545-a0b1-a69b596afa32 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.029208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce20a5-5a45-4545-a0b1-a69b596afa32 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.029486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce20a5-5a45-4545-a0b1-a69b596afa32 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:22.036853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce20a5-5a45-4545-a0b1-a69b596afa32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:22.038305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce20a5-5a45-4545-a0b1-a69b596afa32 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:22.039762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 263/517] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:22.040547 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4abb8c-82f4-4e1e-ac9f-123cee7b2eb8 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-99ce20a5-5a45-4545-a0b1-a69b596afa32 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:22.057469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:22.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 255/518] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:22.059601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce20a5-5a45-4545-a0b1-a69b596afa32 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:22.075578 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:22.104318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:22.145919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4abb8c-82f4-4e1e-ac9f-123cee7b2eb8 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:22.160436 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce20a5-5a45-4545-a0b1-a69b596afa32 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:22.180060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eb3e1-fda4-4c89-9f34-98b0fa5a5f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.180715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb3e1-fda4-4c89-9f34-98b0fa5a5f8b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.180999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb3e1-fda4-4c89-9f34-98b0fa5a5f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.181278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb3e1-fda4-4c89-9f34-98b0fa5a5f8b None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:22.182064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eb3e1-fda4-4c89-9f34-98b0fa5a5f8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:22.182406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eb3e1-fda4-4c89-9f34-98b0fa5a5f8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:22.183819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eb3e1-fda4-4c89-9f34-98b0fa5a5f8b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:22.193779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59a8dc-03b1-4a81-a54f-0edca01ed313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.194491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a8dc-03b1-4a81-a54f-0edca01ed313 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.194783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a8dc-03b1-4a81-a54f-0edca01ed313 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.195056 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a8dc-03b1-4a81-a54f-0edca01ed313 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:22.195772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59a8dc-03b1-4a81-a54f-0edca01ed313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:22.196078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59a8dc-03b1-4a81-a54f-0edca01ed313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:22.197427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59a8dc-03b1-4a81-a54f-0edca01ed313 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:22.201885 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 264/519] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:22.202878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eb3e1-fda4-4c89-9f34-98b0fa5a5f8b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:22.211775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 256/520] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:22.212586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59a8dc-03b1-4a81-a54f-0edca01ed313 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:22.286217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:22.305366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eb3e1-fda4-4c89-9f34-98b0fa5a5f8b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:22.310867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59a8dc-03b1-4a81-a54f-0edca01ed313 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:22.328329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:22.339255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d05048-5a36-43c9-b651-f031cc71660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.339981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d05048-5a36-43c9-b651-f031cc71660a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.340433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d05048-5a36-43c9-b651-f031cc71660a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.340745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d05048-5a36-43c9-b651-f031cc71660a None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:22.341429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d05048-5a36-43c9-b651-f031cc71660a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:22.341735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d05048-5a36-43c9-b651-f031cc71660a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:22.343126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d05048-5a36-43c9-b651-f031cc71660a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:22.345627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a663c-e9b5-442f-91a0-fd753847d531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.346499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a663c-e9b5-442f-91a0-fd753847d531 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.346780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a663c-e9b5-442f-91a0-fd753847d531 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.347050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a663c-e9b5-442f-91a0-fd753847d531 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:22.354505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a663c-e9b5-442f-91a0-fd753847d531 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:22.355095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 265/521] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:22.355888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d05048-5a36-43c9-b651-f031cc71660a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:22.355995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a663c-e9b5-442f-91a0-fd753847d531 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-535a663c-e9b5-442f-91a0-fd753847d531 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:22.371051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:22.372194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 257/522] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:22.373254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a663c-e9b5-442f-91a0-fd753847d531 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:22.458516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d05048-5a36-43c9-b651-f031cc71660a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:22.469064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a663c-e9b5-442f-91a0-fd753847d531 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:22.493017 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a708f-4b9a-42ba-9c30-be6b3a854209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.493689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a708f-4b9a-42ba-9c30-be6b3a854209 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.493958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a708f-4b9a-42ba-9c30-be6b3a854209 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.494228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a708f-4b9a-42ba-9c30-be6b3a854209 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:22.495087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a708f-4b9a-42ba-9c30-be6b3a854209 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:22.495400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a708f-4b9a-42ba-9c30-be6b3a854209 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:22.496822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a708f-4b9a-42ba-9c30-be6b3a854209 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:22.504789 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2d734-ea0a-4d51-a98b-ee99ca037513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.505471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d734-ea0a-4d51-a98b-ee99ca037513 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.505757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d734-ea0a-4d51-a98b-ee99ca037513 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.506058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d734-ea0a-4d51-a98b-ee99ca037513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:22.506909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2d734-ea0a-4d51-a98b-ee99ca037513 None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=b8661ef27af34bbea11e215831d50843) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:22.507225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2d734-ea0a-4d51-a98b-ee99ca037513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:22.508679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2d734-ea0a-4d51-a98b-ee99ca037513 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:22.510681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:22.514957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 258/523] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:22 2022] GET /identity/v3/role_assignments?user.id=b8661ef27af34bbea11e215831d50843&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:22.515720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2d734-ea0a-4d51-a98b-ee99ca037513 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:22.535897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 266/524] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jun 8 06:28:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:22.539335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a708f-4b9a-42ba-9c30-be6b3a854209 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:22.589420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:22.630606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2d734-ea0a-4d51-a98b-ee99ca037513 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:22.658085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a708f-4b9a-42ba-9c30-be6b3a854209 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:22.670360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182993f8-0c8c-492b-8cc6-804da207cb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.671514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182993f8-0c8c-492b-8cc6-804da207cb30 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.671947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182993f8-0c8c-492b-8cc6-804da207cb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.672371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182993f8-0c8c-492b-8cc6-804da207cb30 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:22.673311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182993f8-0c8c-492b-8cc6-804da207cb30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:22.675124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182993f8-0c8c-492b-8cc6-804da207cb30 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:22.694803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677f81-d334-44df-9016-e59c08c7e1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.695617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677f81-d334-44df-9016-e59c08c7e1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.695895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677f81-d334-44df-9016-e59c08c7e1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.696169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677f81-d334-44df-9016-e59c08c7e1e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:22.703778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8677f81-d334-44df-9016-e59c08c7e1e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:22.706444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8677f81-d334-44df-9016-e59c08c7e1e8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-b8677f81-d334-44df-9016-e59c08c7e1e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:22.720911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:22.721861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:22.722791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:22.722791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:22.722791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:22.722791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:22.722791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:22.722791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:22.722791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:22.722791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:22.722791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 267/525] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:22.723268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677f81-d334-44df-9016-e59c08c7e1e8 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:22.783830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 259/526] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:28:22 2022] POST /identity/v3/users => generated 247 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:28:22.785656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182993f8-0c8c-492b-8cc6-804da207cb30 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:22.834177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:22.837433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677f81-d334-44df-9016-e59c08c7e1e8 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:22.876847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376102-7f7b-4ce2-853b-c2d576b7cf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.877587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376102-7f7b-4ce2-853b-c2d576b7cf3d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.877988 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376102-7f7b-4ce2-853b-c2d576b7cf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.878407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376102-7f7b-4ce2-853b-c2d576b7cf3d None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:22.878664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:22.879187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3376102-7f7b-4ce2-853b-c2d576b7cf3d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:22.879499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3376102-7f7b-4ce2-853b-c2d576b7cf3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:22.880973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3376102-7f7b-4ce2-853b-c2d576b7cf3d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:22.902004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 268/527] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Jun 8 06:28:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:22.902653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376102-7f7b-4ce2-853b-c2d576b7cf3d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:22.930652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182993f8-0c8c-492b-8cc6-804da207cb30 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:22.968173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f827d33-f67d-443b-932c-6b71df10a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:22.969211 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f827d33-f67d-443b-932c-6b71df10a46a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:22.969712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f827d33-f67d-443b-932c-6b71df10a46a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:22.970219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f827d33-f67d-443b-932c-6b71df10a46a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:23.019680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376102-7f7b-4ce2-853b-c2d576b7cf3d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:23.046881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f827d33-f67d-443b-932c-6b71df10a46a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:23.048694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f827d33-f67d-443b-932c-6b71df10a46a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:23.067617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b7962-8faa-4f63-8bab-cffc9ac9c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:23.068288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b7962-8faa-4f63-8bab-cffc9ac9c6cf None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:23.068576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b7962-8faa-4f63-8bab-cffc9ac9c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:23.068847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b7962-8faa-4f63-8bab-cffc9ac9c6cf None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:23.069639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b7962-8faa-4f63-8bab-cffc9ac9c6cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:23.069945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b7962-8faa-4f63-8bab-cffc9ac9c6cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:23.071548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b7962-8faa-4f63-8bab-cffc9ac9c6cf None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:23.084360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 269/528] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:23.085284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b7962-8faa-4f63-8bab-cffc9ac9c6cf None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:23.106551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:23.117125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:23.172792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 260/529] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:23.174367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f827d33-f67d-443b-932c-6b71df10a46a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:23.215703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b7962-8faa-4f63-8bab-cffc9ac9c6cf None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:23.252007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74ee3b-7d91-4164-801a-6186384481a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:23.252802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74ee3b-7d91-4164-801a-6186384481a6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:23.253192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74ee3b-7d91-4164-801a-6186384481a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:23.253575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74ee3b-7d91-4164-801a-6186384481a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:23.308175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f827d33-f67d-443b-932c-6b71df10a46a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:23.329267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74ee3b-7d91-4164-801a-6186384481a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:23.330984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74ee3b-7d91-4164-801a-6186384481a6 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:23.351656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eef001-1e5b-402f-99c1-e901e720c1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:23.352395 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eef001-1e5b-402f-99c1-e901e720c1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:23.352785 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eef001-1e5b-402f-99c1-e901e720c1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:23.353162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eef001-1e5b-402f-99c1-e901e720c1c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:23.355542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eef001-1e5b-402f-99c1-e901e720c1c2 None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=8c060a0a42824aa589135ea357165268) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:23.355914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:23.356029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eef001-1e5b-402f-99c1-e901e720c1c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:23.358402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eef001-1e5b-402f-99c1-e901e720c1c2 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:23.378607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 261/530] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:23 2022] GET /identity/v3/role_assignments?user.id=8c060a0a42824aa589135ea357165268&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:23.379778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eef001-1e5b-402f-99c1-e901e720c1c2 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:23.405327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:23.449884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 270/531] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:23.458161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74ee3b-7d91-4164-801a-6186384481a6 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:23.544256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eef001-1e5b-402f-99c1-e901e720c1c2 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:23.606430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74ee3b-7d91-4164-801a-6186384481a6 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:23.630621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:23.652368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c677b-5132-4771-aef7-4551c1bbb5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:23.652593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56723393-688f-4a04-9b68-822a4e3e61d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:23.653176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c677b-5132-4771-aef7-4551c1bbb5ed None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:23.653458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c677b-5132-4771-aef7-4551c1bbb5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:23.653738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56723393-688f-4a04-9b68-822a4e3e61d5 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:23.653843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c677b-5132-4771-aef7-4551c1bbb5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:23.654189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56723393-688f-4a04-9b68-822a4e3e61d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:23.654610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56723393-688f-4a04-9b68-822a4e3e61d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:23.667413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56723393-688f-4a04-9b68-822a4e3e61d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:23.667804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c677b-5132-4771-aef7-4551c1bbb5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:23.668922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56723393-688f-4a04-9b68-822a4e3e61d5 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:23.669274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c677b-5132-4771-aef7-4551c1bbb5ed None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-56723393-688f-4a04-9b68-822a4e3e61d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:23.689418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:23.690342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:23.691169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:23.691169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:23.691169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:23.691169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:23.691169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 271/532] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-d62c677b-5132-4771-aef7-4551c1bbb5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:23.692419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:23.693739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:23.695231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:23.695231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:23.695231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:23.695231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:23.700067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56723393-688f-4a04-9b68-822a4e3e61d5 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:23.700580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 262/533] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:23.700580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c677b-5132-4771-aef7-4551c1bbb5ed None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:23.784655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:23.808745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c677b-5132-4771-aef7-4551c1bbb5ed None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:23.849446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8d280-00f0-48b5-9019-e2beed17c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:23.850264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d280-00f0-48b5-9019-e2beed17c203 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:23.850562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d280-00f0-48b5-9019-e2beed17c203 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:23.850840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d280-00f0-48b5-9019-e2beed17c203 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:23.851576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8d280-00f0-48b5-9019-e2beed17c203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:23.851881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8d280-00f0-48b5-9019-e2beed17c203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:23.853407 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8d280-00f0-48b5-9019-e2beed17c203 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:23.870273 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 263/534] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:23.871406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8d280-00f0-48b5-9019-e2beed17c203 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:23.978831 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8d280-00f0-48b5-9019-e2beed17c203 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:24.011319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:24.018924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f4eb2-babb-4ce6-9517-cfa5354d5195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:24.021555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4eb2-babb-4ce6-9517-cfa5354d5195 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:24.021555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4eb2-babb-4ce6-9517-cfa5354d5195 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:24.021555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4eb2-babb-4ce6-9517-cfa5354d5195 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:24.028809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f4eb2-babb-4ce6-9517-cfa5354d5195 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:24.031010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f4eb2-babb-4ce6-9517-cfa5354d5195 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:24.040279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56723393-688f-4a04-9b68-822a4e3e61d5 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-514f4eb2-babb-4ce6-9517-cfa5354d5195 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:24.057374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:24.058230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:24.059098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:24.059098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:24.059098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:24.059098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:24.059098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:24.059098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:24.059098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:24.059098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:24.060092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 264/535] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:24.065862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f4eb2-babb-4ce6-9517-cfa5354d5195 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:24.102512 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f04403-32b9-42a2-8aab-6d5206f69a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:24.103182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f04403-32b9-42a2-8aab-6d5206f69a25 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:24.104649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f04403-32b9-42a2-8aab-6d5206f69a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:24.104940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f04403-32b9-42a2-8aab-6d5206f69a25 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:24.105662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f04403-32b9-42a2-8aab-6d5206f69a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:24.105963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f04403-32b9-42a2-8aab-6d5206f69a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:24.107347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f04403-32b9-42a2-8aab-6d5206f69a25 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:24.131602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 272/536] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:24.142329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f04403-32b9-42a2-8aab-6d5206f69a25 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:24.195966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:24.253619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f4eb2-babb-4ce6-9517-cfa5354d5195 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:24.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f04403-32b9-42a2-8aab-6d5206f69a25 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:24.292451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab4194-286f-4eeb-8258-941566086661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:24.293236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4194-286f-4eeb-8258-941566086661 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:24.293522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4194-286f-4eeb-8258-941566086661 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:24.293798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4194-286f-4eeb-8258-941566086661 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:24.294630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab4194-286f-4eeb-8258-941566086661 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:24.294941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab4194-286f-4eeb-8258-941566086661 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:24.296507 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab4194-286f-4eeb-8258-941566086661 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:24.317608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 265/537] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:24.327255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab4194-286f-4eeb-8258-941566086661 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:24.338878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e406f8a-eae8-4d27-a8b8-d9a929f5402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:24.339728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e406f8a-eae8-4d27-a8b8-d9a929f5402d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:24.340012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e406f8a-eae8-4d27-a8b8-d9a929f5402d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:24.340283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e406f8a-eae8-4d27-a8b8-d9a929f5402d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:24.352301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e406f8a-eae8-4d27-a8b8-d9a929f5402d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:24.353769 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e406f8a-eae8-4d27-a8b8-d9a929f5402d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-9e406f8a-eae8-4d27-a8b8-d9a929f5402d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:24.380343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:24.381254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:24.382122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:24.382122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:24.382122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:24.382122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:24.382122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:24.382122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:24.382122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:24.382122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:24.382122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 273/538] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:24.388191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e406f8a-eae8-4d27-a8b8-d9a929f5402d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:24.434531 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:24.515355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:24.526686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e406f8a-eae8-4d27-a8b8-d9a929f5402d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:24.531014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab4194-286f-4eeb-8258-941566086661 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:24.590429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076115-c692-415f-a0e2-d9923e4671cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:24.591093 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076115-c692-415f-a0e2-d9923e4671cd None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:24.591376 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076115-c692-415f-a0e2-d9923e4671cd None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:24.591599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce34ca2-ab30-4478-8b11-4b206da92704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:24.592052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076115-c692-415f-a0e2-d9923e4671cd None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:24.592262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce34ca2-ab30-4478-8b11-4b206da92704 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:24.592432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b076115-c692-415f-a0e2-d9923e4671cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:24.592578 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce34ca2-ab30-4478-8b11-4b206da92704 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:24.592720 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b076115-c692-415f-a0e2-d9923e4671cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:24.592806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce34ca2-ab30-4478-8b11-4b206da92704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:24.594152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b076115-c692-415f-a0e2-d9923e4671cd None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:24.599688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce34ca2-ab30-4478-8b11-4b206da92704 None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=5498a6912a08408d9ea30920faceee7a) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:24.600021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce34ca2-ab30-4478-8b11-4b206da92704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:24.601450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce34ca2-ab30-4478-8b11-4b206da92704 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:24.607696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 274/539] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:24.613853 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076115-c692-415f-a0e2-d9923e4671cd None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:24.614993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 266/540] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:24 2022] GET /identity/v3/role_assignments?user.id=5498a6912a08408d9ea30920faceee7a&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:24.725005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076115-c692-415f-a0e2-d9923e4671cd None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:24.764650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4f687-00a7-459a-bac8-a2a49c91b3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:24.765321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4f687-00a7-459a-bac8-a2a49c91b3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:24.765602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4f687-00a7-459a-bac8-a2a49c91b3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:24.765878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4f687-00a7-459a-bac8-a2a49c91b3c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:24.766806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4f687-00a7-459a-bac8-a2a49c91b3c1 None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=11838a2908884cc79df912b3b2199564) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:24.767119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4f687-00a7-459a-bac8-a2a49c91b3c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:24.768582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4f687-00a7-459a-bac8-a2a49c91b3c1 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:24.775564 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 275/541] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:24 2022] GET /identity/v3/role_assignments?user.id=11838a2908884cc79df912b3b2199564&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:24.894969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba939d-cddf-4175-b6ae-8786ba936bab None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:24.895327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba939d-cddf-4175-b6ae-8786ba936bab None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:24.895538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba939d-cddf-4175-b6ae-8786ba936bab None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:24.897357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 267/542] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:24.908860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8058c-1277-412d-acd1-8bb879214160 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:24.909215 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8058c-1277-412d-acd1-8bb879214160 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:24.909409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8058c-1277-412d-acd1-8bb879214160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:24.929431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-f1e8058c-1277-412d-acd1-8bb879214160 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:24.931609 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f1e8058c-1277-412d-acd1-8bb879214160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:24.942474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:25.014999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 276/543] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:25.050128 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba939d-cddf-4175-b6ae-8786ba936bab None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:25.158629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba939d-cddf-4175-b6ae-8786ba936bab None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:25.173338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:25.197857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ffbc9-e33e-447a-9d21-793bab189398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:25.198686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ffbc9-e33e-447a-9d21-793bab189398 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:25.198968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ffbc9-e33e-447a-9d21-793bab189398 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:25.199242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ffbc9-e33e-447a-9d21-793bab189398 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:25.217182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ffbc9-e33e-447a-9d21-793bab189398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-995ffbc9-e33e-447a-9d21-793bab189398 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:25.225950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:25.228151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:25.230073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:25.234269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 268/544] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:25.237408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8058c-1277-412d-acd1-8bb879214160 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:25.364507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8058c-1277-412d-acd1-8bb879214160 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:25.405727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bab8a2-2a91-47ea-9c99-201e735ae43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:25.406443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bab8a2-2a91-47ea-9c99-201e735ae43b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:25.406729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bab8a2-2a91-47ea-9c99-201e735ae43b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:25.407005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bab8a2-2a91-47ea-9c99-201e735ae43b None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:25.407813 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bab8a2-2a91-47ea-9c99-201e735ae43b None admin] RBAC: Adding query filter params (name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:25.408122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bab8a2-2a91-47ea-9c99-201e735ae43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:25.409496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bab8a2-2a91-47ea-9c99-201e735ae43b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:25.418566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 277/545] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:25.424159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ffbc9-e33e-447a-9d21-793bab189398 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:25.572417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ffbc9-e33e-447a-9d21-793bab189398 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:25.615035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310b91e-3e42-4e93-8ad1-80f3505708d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:25.616675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b91e-3e42-4e93-8ad1-80f3505708d4 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:25.617151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b91e-3e42-4e93-8ad1-80f3505708d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:25.617614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b91e-3e42-4e93-8ad1-80f3505708d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:25.638392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310b91e-3e42-4e93-8ad1-80f3505708d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:25.640143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310b91e-3e42-4e93-8ad1-80f3505708d4 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-d310b91e-3e42-4e93-8ad1-80f3505708d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:25.662956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:25.663896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:25.664906 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:25.664906 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:25.664906 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:25.664906 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:25.667423 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 269/546] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:25.674297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bab8a2-2a91-47ea-9c99-201e735ae43b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:25.691678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:25.728751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1050272-bbf4-4839-a24b-d14e853d228f None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:25.729106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1050272-bbf4-4839-a24b-d14e853d228f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:25.729613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1050272-bbf4-4839-a24b-d14e853d228f None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:25.731091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 270/547] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:25.737862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd60e-9188-408d-be6a-794f26f9231f None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:25.738151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd60e-9188-408d-be6a-794f26f9231f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:25.738464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd60e-9188-408d-be6a-794f26f9231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:25.757414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-272cd60e-9188-408d-be6a-794f26f9231f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:25.758781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-272cd60e-9188-408d-be6a-794f26f9231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:25.798499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:25.891563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 271/548] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:28:25.893157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bab8a2-2a91-47ea-9c99-201e735ae43b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:25.940425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cd60e-9188-408d-be6a-794f26f9231f None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:25.942280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6fdc0-f67c-4a11-a9b0-a8d536d780d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:25.943053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6fdc0-f67c-4a11-a9b0-a8d536d780d7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:25.943451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6fdc0-f67c-4a11-a9b0-a8d536d780d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:25.943736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6fdc0-f67c-4a11-a9b0-a8d536d780d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:25.944475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6fdc0-f67c-4a11-a9b0-a8d536d780d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:25.944789 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6fdc0-f67c-4a11-a9b0-a8d536d780d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:25.946164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6fdc0-f67c-4a11-a9b0-a8d536d780d7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:25.959655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 278/549] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:25.964851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6fdc0-f67c-4a11-a9b0-a8d536d780d7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:26.044920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:26.112536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6fdc0-f67c-4a11-a9b0-a8d536d780d7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:26.142088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cd60e-9188-408d-be6a-794f26f9231f None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:26.161658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9ab3c-054d-4ee8-b2bd-311c5bc76466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:26.162771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9ab3c-054d-4ee8-b2bd-311c5bc76466 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:26.163194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9ab3c-054d-4ee8-b2bd-311c5bc76466 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:26.163631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9ab3c-054d-4ee8-b2bd-311c5bc76466 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:26.177027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9ab3c-054d-4ee8-b2bd-311c5bc76466 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:26.179506 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9ab3c-054d-4ee8-b2bd-311c5bc76466 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-8ca9ab3c-054d-4ee8-b2bd-311c5bc76466 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:26.198775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:26.200149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:26.201192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:26.201192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:26.201192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:26.201192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:26.201192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:26.201192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:26.201192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:26.201192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:26.201192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:26.201192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:26.201192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 279/550] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jun 8 06:28:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:26.201897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d38a30-52cd-4f75-9da1-1c660f776389 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:26.202185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d38a30-52cd-4f75-9da1-1c660f776389 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:26.202818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d38a30-52cd-4f75-9da1-1c660f776389 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:26.203489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d0ff3-fb6d-4240-9e5c-c9d1a41aeb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:26.204653 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0ff3-fb6d-4240-9e5c-c9d1a41aeb6e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:26.205136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0ff3-fb6d-4240-9e5c-c9d1a41aeb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:26.205596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0ff3-fb6d-4240-9e5c-c9d1a41aeb6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:26.206308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 280/551] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:26.209040 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d38a30-52cd-4f75-9da1-1c660f776389 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:26.221464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d0ff3-fb6d-4240-9e5c-c9d1a41aeb6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-fd2d0ff3-fb6d-4240-9e5c-c9d1a41aeb6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:26.231462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:26.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:26.233744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 272/552] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:26.234497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501b54-ec7c-484f-b2a6-1f09623727b8 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:26.234497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501b54-ec7c-484f-b2a6-1f09623727b8 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:26.234804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501b54-ec7c-484f-b2a6-1f09623727b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:26.255340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b3501b54-ec7c-484f-b2a6-1f09623727b8 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:26.256509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b3501b54-ec7c-484f-b2a6-1f09623727b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:26.269781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:26.325934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d38a30-52cd-4f75-9da1-1c660f776389 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:26.346273 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 273/553] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:26.346273 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501b54-ec7c-484f-b2a6-1f09623727b8 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:26.373681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:26.385248 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a7860-78ac-419d-9c2e-93d047bf41db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:26.386411 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a7860-78ac-419d-9c2e-93d047bf41db None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:26.386949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a7860-78ac-419d-9c2e-93d047bf41db None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:26.387399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a7860-78ac-419d-9c2e-93d047bf41db None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:26.388213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a7860-78ac-419d-9c2e-93d047bf41db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:26.388588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a7860-78ac-419d-9c2e-93d047bf41db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:26.390092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a7860-78ac-419d-9c2e-93d047bf41db None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:26.411188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 281/554] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jun 8 06:28:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:26.412120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a7860-78ac-419d-9c2e-93d047bf41db None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:26.477539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501b54-ec7c-484f-b2a6-1f09623727b8 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:26.515005 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96effa-eb18-470d-b16a-a26a07179683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:26.515681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96effa-eb18-470d-b16a-a26a07179683 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:26.517808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96effa-eb18-470d-b16a-a26a07179683 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:26.517808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96effa-eb18-470d-b16a-a26a07179683 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:26.517964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96effa-eb18-470d-b16a-a26a07179683 None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:26.518463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96effa-eb18-470d-b16a-a26a07179683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:26.519918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96effa-eb18-470d-b16a-a26a07179683 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:26.521301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a7860-78ac-419d-9c2e-93d047bf41db None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:26.533988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 274/555] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:26.534970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96effa-eb18-470d-b16a-a26a07179683 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:26.547215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:26.558652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d4c23-6469-4f16-8a00-ec2e172b0c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:26.559634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d4c23-6469-4f16-8a00-ec2e172b0c2f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:26.560101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d4c23-6469-4f16-8a00-ec2e172b0c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:26.560509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d4c23-6469-4f16-8a00-ec2e172b0c2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:26.571410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d4c23-6469-4f16-8a00-ec2e172b0c2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-914d4c23-6469-4f16-8a00-ec2e172b0c2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:26.580302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:26.581406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:26.582496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:26.585431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 282/556] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:26.586815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d4c23-6469-4f16-8a00-ec2e172b0c2f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:26.637300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:26.644461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96effa-eb18-470d-b16a-a26a07179683 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:26.681170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aa280-ad80-41dd-8c5f-5050ebd0b0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:26.682049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aa280-ad80-41dd-8c5f-5050ebd0b0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:26.682368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aa280-ad80-41dd-8c5f-5050ebd0b0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:26.682647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aa280-ad80-41dd-8c5f-5050ebd0b0d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:26.695622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aa280-ad80-41dd-8c5f-5050ebd0b0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:26.697160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aa280-ad80-41dd-8c5f-5050ebd0b0d5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:26.698885 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d4c23-6469-4f16-8a00-ec2e172b0c2f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-860aa280-ad80-41dd-8c5f-5050ebd0b0d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:26.716901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:26.718287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:26.719434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:26.719434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:26.719434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:26.719434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:26.723267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 275/557] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:26.724130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aa280-ad80-41dd-8c5f-5050ebd0b0d5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:26.739581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c61620-6821-4766-9645-b5bf3c6f754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:26.740727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c61620-6821-4766-9645-b5bf3c6f754d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:26.741240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c61620-6821-4766-9645-b5bf3c6f754d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:26.741685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c61620-6821-4766-9645-b5bf3c6f754d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:26.753995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c61620-6821-4766-9645-b5bf3c6f754d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:26.755807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c61620-6821-4766-9645-b5bf3c6f754d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-64c61620-6821-4766-9645-b5bf3c6f754d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:26.774817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:26.775919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:26.776921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:26.776921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:26.776921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:26.776921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:26.778732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 283/558] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:26.779702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c61620-6821-4766-9645-b5bf3c6f754d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:26.793502 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:26.843624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aa280-ad80-41dd-8c5f-5050ebd0b0d5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:26.880879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c53c0-0a3f-49cb-9935-3a36a5494552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:26.881556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c53c0-0a3f-49cb-9935-3a36a5494552 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:26.881882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c53c0-0a3f-49cb-9935-3a36a5494552 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:26.882160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c53c0-0a3f-49cb-9935-3a36a5494552 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:26.883048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c53c0-0a3f-49cb-9935-3a36a5494552 None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:26.883362 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c53c0-0a3f-49cb-9935-3a36a5494552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:26.884784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c53c0-0a3f-49cb-9935-3a36a5494552 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:26.896123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 276/559] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:26.897115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c53c0-0a3f-49cb-9935-3a36a5494552 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:26.913246 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:26.922646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c61620-6821-4766-9645-b5bf3c6f754d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:26.973726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aa6e8-21a2-40d9-ac5e-0d39091cb48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:26.974889 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa6e8-21a2-40d9-ac5e-0d39091cb48e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:26.975323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa6e8-21a2-40d9-ac5e-0d39091cb48e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:26.975771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa6e8-21a2-40d9-ac5e-0d39091cb48e None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:26.976643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77aa6e8-21a2-40d9-ac5e-0d39091cb48e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:26.977365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77aa6e8-21a2-40d9-ac5e-0d39091cb48e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:26.979483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77aa6e8-21a2-40d9-ac5e-0d39091cb48e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:27.001958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 284/560] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:27.003158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aa6e8-21a2-40d9-ac5e-0d39091cb48e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:27.023207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c53c0-0a3f-49cb-9935-3a36a5494552 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:27.055195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:27.072382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b28d4-baab-4c90-a107-5c24ccdc1484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:27.073549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b28d4-baab-4c90-a107-5c24ccdc1484 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.074633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b28d4-baab-4c90-a107-5c24ccdc1484 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.075340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b28d4-baab-4c90-a107-5c24ccdc1484 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.076231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b28d4-baab-4c90-a107-5c24ccdc1484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:27.076696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b28d4-baab-4c90-a107-5c24ccdc1484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:27.078612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b28d4-baab-4c90-a107-5c24ccdc1484 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:27.096099 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 277/561] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:27.097201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b28d4-baab-4c90-a107-5c24ccdc1484 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:27.123386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aa6e8-21a2-40d9-ac5e-0d39091cb48e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:27.170010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10682224-b185-4353-92ff-46f05c82cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:27.170976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10682224-b185-4353-92ff-46f05c82cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.171267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10682224-b185-4353-92ff-46f05c82cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.171538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10682224-b185-4353-92ff-46f05c82cfa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.184142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10682224-b185-4353-92ff-46f05c82cfa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:27.185814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10682224-b185-4353-92ff-46f05c82cfa2 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-10682224-b185-4353-92ff-46f05c82cfa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:27.206400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:27.207365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:27.208874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:27.208874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:27.208874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:27.208874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:27.208874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 285/562] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:27.208874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10682224-b185-4353-92ff-46f05c82cfa2 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:27.221419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:27.243737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b28d4-baab-4c90-a107-5c24ccdc1484 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:27.283749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512789c-9700-4258-8144-4b4d8c89d888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:27.284825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512789c-9700-4258-8144-4b4d8c89d888 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.285150 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512789c-9700-4258-8144-4b4d8c89d888 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.285375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512789c-9700-4258-8144-4b4d8c89d888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.292271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512789c-9700-4258-8144-4b4d8c89d888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:27.294466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512789c-9700-4258-8144-4b4d8c89d888 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-b512789c-9700-4258-8144-4b4d8c89d888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:27.308782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:27.309845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:27.316146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:27.316146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:27.316146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:27.316146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:27.316146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:27.316146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:27.316146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:27.316146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:27.316146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 278/563] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:27.316146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512789c-9700-4258-8144-4b4d8c89d888 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:27.334483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10682224-b185-4353-92ff-46f05c82cfa2 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:27.361459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:27.372785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9b50b-f25c-4ec4-8322-aa0ee83ab8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:27.373679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9b50b-f25c-4ec4-8322-aa0ee83ab8bf None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.373974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9b50b-f25c-4ec4-8322-aa0ee83ab8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.374274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9b50b-f25c-4ec4-8322-aa0ee83ab8bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.382612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9b50b-f25c-4ec4-8322-aa0ee83ab8bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:27.384118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9b50b-f25c-4ec4-8322-aa0ee83ab8bf None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-3be9b50b-f25c-4ec4-8322-aa0ee83ab8bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:27.399432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:27.400562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:27.401688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:27.401688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:27.401688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:27.401688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:27.401688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:27.401688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:27.401688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:27.401688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:27.401688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:27.401688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:27.405251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 286/564] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:27.406569 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa1484-7096-4bdc-baa2-0ebd2ab2e243 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.406863 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa1484-7096-4bdc-baa2-0ebd2ab2e243 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.407161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa1484-7096-4bdc-baa2-0ebd2ab2e243 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.408438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 287/565] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:27.409131 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa1484-7096-4bdc-baa2-0ebd2ab2e243 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:27.429334 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512789c-9700-4258-8144-4b4d8c89d888 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:27.466171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2d649-8526-4d23-95a8-012c1f6a1778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:27.467262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2d649-8526-4d23-95a8-012c1f6a1778 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.467850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2d649-8526-4d23-95a8-012c1f6a1778 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.468131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2d649-8526-4d23-95a8-012c1f6a1778 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.468854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2d649-8526-4d23-95a8-012c1f6a1778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:27.469161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2d649-8526-4d23-95a8-012c1f6a1778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:27.470709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2d649-8526-4d23-95a8-012c1f6a1778 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:27.478004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:27.484466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 279/566] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:27.485794 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2d649-8526-4d23-95a8-012c1f6a1778 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:27.513630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa1484-7096-4bdc-baa2-0ebd2ab2e243 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:27.547152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1ce05-f243-4962-8bfc-659810df7b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:27.547902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1ce05-f243-4962-8bfc-659810df7b6f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.548689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1ce05-f243-4962-8bfc-659810df7b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.548964 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1ce05-f243-4962-8bfc-659810df7b6f None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.549750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1ce05-f243-4962-8bfc-659810df7b6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:27.550063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1ce05-f243-4962-8bfc-659810df7b6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:27.551521 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1ce05-f243-4962-8bfc-659810df7b6f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:27.562757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 288/567] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:27.567935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8acd18-df85-4a70-9e3b-fb289f837d3b None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.568226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8acd18-df85-4a70-9e3b-fb289f837d3b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.568505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8acd18-df85-4a70-9e3b-fb289f837d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.584345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2d649-8526-4d23-95a8-012c1f6a1778 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:27.584635 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-6a8acd18-df85-4a70-9e3b-fb289f837d3b None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:27.585850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6a8acd18-df85-4a70-9e3b-fb289f837d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:27.585959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:27.620515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbc767-f6ff-4df2-9579-466b6645faa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:27.621178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc767-f6ff-4df2-9579-466b6645faa6 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.621461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc767-f6ff-4df2-9579-466b6645faa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.621738 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbc767-f6ff-4df2-9579-466b6645faa6 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.622606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbc767-f6ff-4df2-9579-466b6645faa6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:27.622913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbc767-f6ff-4df2-9579-466b6645faa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:27.624379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbc767-f6ff-4df2-9579-466b6645faa6 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:27.641677 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 280/568] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jun 8 06:28:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:27.642930 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d13c81-32f1-4e2c-8288-d790a20594e8 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.643209 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d13c81-32f1-4e2c-8288-d790a20594e8 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.643478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d13c81-32f1-4e2c-8288-d790a20594e8 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.644870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 281/569] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:27.647289 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d13c81-32f1-4e2c-8288-d790a20594e8 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:27.653021 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 289/570] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:27.653822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8acd18-df85-4a70-9e3b-fb289f837d3b None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:27.722888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:27.748850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d13c81-32f1-4e2c-8288-d790a20594e8 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:27.765285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8acd18-df85-4a70-9e3b-fb289f837d3b None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:27.783159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb061d-fd24-43f1-8a08-ca1ead216c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:27.783938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb061d-fd24-43f1-8a08-ca1ead216c28 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.784216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb061d-fd24-43f1-8a08-ca1ead216c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.784486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb061d-fd24-43f1-8a08-ca1ead216c28 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.791290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb061d-fd24-43f1-8a08-ca1ead216c28 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:27.792696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb061d-fd24-43f1-8a08-ca1ead216c28 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:27.798386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f631b3-5703-434f-83c9-d4daea6183a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:27.799263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f631b3-5703-434f-83c9-d4daea6183a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.799541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f631b3-5703-434f-83c9-d4daea6183a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.799819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f631b3-5703-434f-83c9-d4daea6183a5 None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/b8661ef27af34bbea11e215831d50843/roles/be311caafffd48cfa80fbe10e110493c` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-cadb061d-fd24-43f1-8a08-ca1ead216c28 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:27.806832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:27.807749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 282/571] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:27.808780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb061d-fd24-43f1-8a08-ca1ead216c28 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:27.819262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f631b3-5703-434f-83c9-d4daea6183a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=b8661ef27af34bbea11e215831d50843, role_id=be311caafffd48cfa80fbe10e110493c)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:27.820678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f631b3-5703-434f-83c9-d4daea6183a5 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:27.831674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:27.898884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 290/572] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:28:27 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/b8661ef27af34bbea11e215831d50843/roles/be311caafffd48cfa80fbe10e110493c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:27.900257 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bfc10-d6d2-48c7-983f-530e350ba2c8 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.900605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bfc10-d6d2-48c7-983f-530e350ba2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.900891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bfc10-d6d2-48c7-983f-530e350ba2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:27.907095 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb061d-fd24-43f1-8a08-ca1ead216c28 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:27.919698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-068bfc10-d6d2-48c7-983f-530e350ba2c8 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:27.920932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-068bfc10-d6d2-48c7-983f-530e350ba2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:27.948954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59af0-3cd2-4282-af4c-7d6bc32fd03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:27.949953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59af0-3cd2-4282-af4c-7d6bc32fd03b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:27.950225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59af0-3cd2-4282-af4c-7d6bc32fd03b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:27.950527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59af0-3cd2-4282-af4c-7d6bc32fd03b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:28.006793 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 291/573] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:28.006793 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bfc10-d6d2-48c7-983f-530e350ba2c8 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:28.036962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b59af0-3cd2-4282-af4c-7d6bc32fd03b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:28.038392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b59af0-3cd2-4282-af4c-7d6bc32fd03b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:28.056211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:28.062804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:28.128862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bfc10-d6d2-48c7-983f-530e350ba2c8 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:28.153803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 283/574] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:28.154923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59af0-3cd2-4282-af4c-7d6bc32fd03b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:28.169946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc3555-4d89-4359-9a25-ffba96a76147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:28.170772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc3555-4d89-4359-9a25-ffba96a76147 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:28.171049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc3555-4d89-4359-9a25-ffba96a76147 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:28.171349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc3555-4d89-4359-9a25-ffba96a76147 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:28.182024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc3555-4d89-4359-9a25-ffba96a76147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-9fbc3555-4d89-4359-9a25-ffba96a76147 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:28.190168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:28.191134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:28.191976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 292/575] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:28.192695 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc3555-4d89-4359-9a25-ffba96a76147 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:28.267632 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59af0-3cd2-4282-af4c-7d6bc32fd03b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:28.290419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:28.299561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:28.303449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc3555-4d89-4359-9a25-ffba96a76147 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:28.305519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c99d05-cb54-4085-bd05-abce413676bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:28.306307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99d05-cb54-4085-bd05-abce413676bf None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:28.306593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99d05-cb54-4085-bd05-abce413676bf None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:28.306870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99d05-cb54-4085-bd05-abce413676bf None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:28.307708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c99d05-cb54-4085-bd05-abce413676bf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:28.308016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c99d05-cb54-4085-bd05-abce413676bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:28.309492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c99d05-cb54-4085-bd05-abce413676bf None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:28.328934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 284/576] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jun 8 06:28:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:28.330020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c99d05-cb54-4085-bd05-abce413676bf None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:28.342644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcd22c-b404-4eab-a992-3de42c0eeaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:28.343463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd22c-b404-4eab-a992-3de42c0eeaaf None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:28.343762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd22c-b404-4eab-a992-3de42c0eeaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:28.344074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd22c-b404-4eab-a992-3de42c0eeaaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:28.355873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcd22c-b404-4eab-a992-3de42c0eeaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-4edcd22c-b404-4eab-a992-3de42c0eeaaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:28.364203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:28.365136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:28.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 293/577] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:28.366691 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcd22c-b404-4eab-a992-3de42c0eeaaf None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:28.439340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c99d05-cb54-4085-bd05-abce413676bf None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:28.466979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcd22c-b404-4eab-a992-3de42c0eeaaf None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:28.475634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375338a-250c-4ff9-82ef-a075b9a188ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:28.476696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375338a-250c-4ff9-82ef-a075b9a188ec None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:28.477124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375338a-250c-4ff9-82ef-a075b9a188ec None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:28.477617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375338a-250c-4ff9-82ef-a075b9a188ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:28.488685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375338a-250c-4ff9-82ef-a075b9a188ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:28.490526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375338a-250c-4ff9-82ef-a075b9a188ec None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:28.504264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61335eeb-b57b-46fc-810f-ad130fe1fb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:28.504936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335eeb-b57b-46fc-810f-ad130fe1fb3e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:28.505216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335eeb-b57b-46fc-810f-ad130fe1fb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:28.505521 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335eeb-b57b-46fc-810f-ad130fe1fb3e None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:28.506299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61335eeb-b57b-46fc-810f-ad130fe1fb3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:28.506640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61335eeb-b57b-46fc-810f-ad130fe1fb3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:28.508070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61335eeb-b57b-46fc-810f-ad130fe1fb3e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-0375338a-250c-4ff9-82ef-a075b9a188ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:28.510724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:28.511963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:28.513159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:28.513159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:28.513159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:28.513159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:28.513159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 285/578] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:28.513159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375338a-250c-4ff9-82ef-a075b9a188ec None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:28.522399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 294/579] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:28.523519 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61335eeb-b57b-46fc-810f-ad130fe1fb3e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:28.548827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:28.550925 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:28.621716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375338a-250c-4ff9-82ef-a075b9a188ec None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:28.629491 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61335eeb-b57b-46fc-810f-ad130fe1fb3e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:28.654889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbbc18-9e64-44af-8ace-6f4dc3a5661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:28.655687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbbc18-9e64-44af-8ace-6f4dc3a5661c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:28.655956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbbc18-9e64-44af-8ace-6f4dc3a5661c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:28.656232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbbc18-9e64-44af-8ace-6f4dc3a5661c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:28.664255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f9caf-1605-480e-9125-dffd3375dc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:28.664925 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f9caf-1605-480e-9125-dffd3375dc6c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:28.665204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f9caf-1605-480e-9125-dffd3375dc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:28.665500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f9caf-1605-480e-9125-dffd3375dc6c None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:28.666218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f9caf-1605-480e-9125-dffd3375dc6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:28.666555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f9caf-1605-480e-9125-dffd3375dc6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:28.667504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbbc18-9e64-44af-8ace-6f4dc3a5661c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:28.667913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f9caf-1605-480e-9125-dffd3375dc6c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:28.668925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbbc18-9e64-44af-8ace-6f4dc3a5661c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:28.676011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 295/580] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:28.676827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f9caf-1605-480e-9125-dffd3375dc6c None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-5ecbbc18-9e64-44af-8ace-6f4dc3a5661c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:28.691778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:28.692867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:28.693749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:28.693749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:28.693749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:28.693749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:28.693749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 286/581] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:28.693749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbbc18-9e64-44af-8ace-6f4dc3a5661c None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:28.786966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f9caf-1605-480e-9125-dffd3375dc6c None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:28.794110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbbc18-9e64-44af-8ace-6f4dc3a5661c None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:28.822907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62586b8-041d-41a3-a16b-d6e459837006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:28.823616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62586b8-041d-41a3-a16b-d6e459837006 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:28.823897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62586b8-041d-41a3-a16b-d6e459837006 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:28.824174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62586b8-041d-41a3-a16b-d6e459837006 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:28.825144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62586b8-041d-41a3-a16b-d6e459837006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:28.825446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62586b8-041d-41a3-a16b-d6e459837006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:28.826887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62586b8-041d-41a3-a16b-d6e459837006 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:28.834188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23f4a8-d850-478d-a7a6-028a64ea681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:28.834998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f4a8-d850-478d-a7a6-028a64ea681d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:28.835280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f4a8-d850-478d-a7a6-028a64ea681d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:28.835553 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f4a8-d850-478d-a7a6-028a64ea681d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:28.843391 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 296/582] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:28.843391 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62586b8-041d-41a3-a16b-d6e459837006 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:28.848256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23f4a8-d850-478d-a7a6-028a64ea681d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:28.850135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23f4a8-d850-478d-a7a6-028a64ea681d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3f23f4a8-d850-478d-a7a6-028a64ea681d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:28.867343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:28.868399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:28.869475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:28.869475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:28.869475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:28.869475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:28.869475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 287/583] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:28.869475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23f4a8-d850-478d-a7a6-028a64ea681d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:28.887763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:28.922816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:28.948026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62586b8-041d-41a3-a16b-d6e459837006 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:28.972386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23f4a8-d850-478d-a7a6-028a64ea681d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:28.990421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60919aee-adad-44f7-922d-95d90fd1f314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:28.991209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919aee-adad-44f7-922d-95d90fd1f314 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:28.991486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919aee-adad-44f7-922d-95d90fd1f314 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:28.991753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919aee-adad-44f7-922d-95d90fd1f314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.002120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60919aee-adad-44f7-922d-95d90fd1f314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.003587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60919aee-adad-44f7-922d-95d90fd1f314 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.005281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:29.008605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71876ef-7b00-41e0-8b5f-466a42dd1f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:29.009267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71876ef-7b00-41e0-8b5f-466a42dd1f69 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:29.009596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71876ef-7b00-41e0-8b5f-466a42dd1f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:29.010294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71876ef-7b00-41e0-8b5f-466a42dd1f69 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.011032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71876ef-7b00-41e0-8b5f-466a42dd1f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:29.011339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71876ef-7b00-41e0-8b5f-466a42dd1f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.013424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71876ef-7b00-41e0-8b5f-466a42dd1f69 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.015106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-60919aee-adad-44f7-922d-95d90fd1f314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:29.021464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:29.022377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:29.023267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:29.023267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:29.023267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:29.023267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:29.023267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 297/584] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:29.024376 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60919aee-adad-44f7-922d-95d90fd1f314 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:29.037538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 288/585] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:29.037538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71876ef-7b00-41e0-8b5f-466a42dd1f69 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:29.138334 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71876ef-7b00-41e0-8b5f-466a42dd1f69 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:29.150888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60919aee-adad-44f7-922d-95d90fd1f314 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:29.177319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912bb01-213f-4ed3-b3e0-c167b232d89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:29.177990 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912bb01-213f-4ed3-b3e0-c167b232d89b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:29.178293 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912bb01-213f-4ed3-b3e0-c167b232d89b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:29.178571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912bb01-213f-4ed3-b3e0-c167b232d89b None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.179298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912bb01-213f-4ed3-b3e0-c167b232d89b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:29.179605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912bb01-213f-4ed3-b3e0-c167b232d89b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.180957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912bb01-213f-4ed3-b3e0-c167b232d89b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.187117 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48370fb-66ac-4060-bc6b-0f6a43a62de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:29.187980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48370fb-66ac-4060-bc6b-0f6a43a62de0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:29.188871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48370fb-66ac-4060-bc6b-0f6a43a62de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:29.189211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48370fb-66ac-4060-bc6b-0f6a43a62de0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.197405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 289/586] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:29.197405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912bb01-213f-4ed3-b3e0-c167b232d89b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:29.198944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48370fb-66ac-4060-bc6b-0f6a43a62de0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.200652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48370fb-66ac-4060-bc6b-0f6a43a62de0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-f48370fb-66ac-4060-bc6b-0f6a43a62de0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:29.215466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:29.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:29.217277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:29.217277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:29.217277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:29.217277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:29.217277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:29.217277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:29.217277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:29.217277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:29.217277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 298/587] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:29.217780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48370fb-66ac-4060-bc6b-0f6a43a62de0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:29.262571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:29.273990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:29.311749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912bb01-213f-4ed3-b3e0-c167b232d89b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:29.318118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48370fb-66ac-4060-bc6b-0f6a43a62de0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:29.348503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20644b31-3ec8-412b-8178-c9392f0d49ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:29.349163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644b31-3ec8-412b-8178-c9392f0d49ee None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:29.349452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644b31-3ec8-412b-8178-c9392f0d49ee None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:29.349729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644b31-3ec8-412b-8178-c9392f0d49ee None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.350484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20644b31-3ec8-412b-8178-c9392f0d49ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:29.350791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20644b31-3ec8-412b-8178-c9392f0d49ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.352147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20644b31-3ec8-412b-8178-c9392f0d49ee None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.353816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813974-a951-463c-9b96-725b1acd1c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:29.354633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813974-a951-463c-9b96-725b1acd1c70 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:29.354917 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813974-a951-463c-9b96-725b1acd1c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:29.355192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813974-a951-463c-9b96-725b1acd1c70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.361990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a813974-a951-463c-9b96-725b1acd1c70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.363447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a813974-a951-463c-9b96-725b1acd1c70 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.364032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 290/588] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:29.364815 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20644b31-3ec8-412b-8178-c9392f0d49ee None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-6a813974-a951-463c-9b96-725b1acd1c70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:29.382824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:29.383716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:29.384677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:29.384677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:29.384677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:29.384677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:29.384677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:29.384677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:29.384677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:29.384677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:29.384677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 299/589] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:29.385162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813974-a951-463c-9b96-725b1acd1c70 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:29.480492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20644b31-3ec8-412b-8178-c9392f0d49ee None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:29.487276 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813974-a951-463c-9b96-725b1acd1c70 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:29.495580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:29.503205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:29.519657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181dbe1-11a3-4994-bd10-0ace9dc9bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:29.521470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181dbe1-11a3-4994-bd10-0ace9dc9bb6a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:29.521470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181dbe1-11a3-4994-bd10-0ace9dc9bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:29.521470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181dbe1-11a3-4994-bd10-0ace9dc9bb6a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.523813 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dfa4a-e866-415c-8d2e-835b94f3d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:29.524472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dfa4a-e866-415c-8d2e-835b94f3d4bb None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:29.524774 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dfa4a-e866-415c-8d2e-835b94f3d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:29.525035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dfa4a-e866-415c-8d2e-835b94f3d4bb None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.525822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dfa4a-e866-415c-8d2e-835b94f3d4bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:29.526132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dfa4a-e866-415c-8d2e-835b94f3d4bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.527645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dfa4a-e866-415c-8d2e-835b94f3d4bb None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.529101 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181dbe1-11a3-4994-bd10-0ace9dc9bb6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.530535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181dbe1-11a3-4994-bd10-0ace9dc9bb6a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.544103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 300/590] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:29.544103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dfa4a-e866-415c-8d2e-835b94f3d4bb None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-8181dbe1-11a3-4994-bd10-0ace9dc9bb6a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:29.546162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:29.547102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:29.548551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:29.548551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:29.548551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:29.548551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:29.548551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:29.548551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:29.548551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:29.548551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:29.548551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 06:28:29.548551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:29.548551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 291/591] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:29.549733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181dbe1-11a3-4994-bd10-0ace9dc9bb6a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:29.677075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dfa4a-e866-415c-8d2e-835b94f3d4bb None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:29.677512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181dbe1-11a3-4994-bd10-0ace9dc9bb6a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:29.711888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd9102-ec1a-4100-aa02-78b16938ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:29.712116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4471f51-498f-4611-bb06-3815b5b6af51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:29.712732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4471f51-498f-4611-bb06-3815b5b6af51 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:29.712858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd9102-ec1a-4100-aa02-78b16938ef4b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:29.713038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4471f51-498f-4611-bb06-3815b5b6af51 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:29.713136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd9102-ec1a-4100-aa02-78b16938ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:29.713288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4471f51-498f-4611-bb06-3815b5b6af51 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.713389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd9102-ec1a-4100-aa02-78b16938ef4b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.714070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4471f51-498f-4611-bb06-3815b5b6af51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:29.714412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4471f51-498f-4611-bb06-3815b5b6af51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.715833 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4471f51-498f-4611-bb06-3815b5b6af51 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.721289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd9102-ec1a-4100-aa02-78b16938ef4b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.722798 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd9102-ec1a-4100-aa02-78b16938ef4b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.732495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 292/592] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:29.732495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4471f51-498f-4611-bb06-3815b5b6af51 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-fdfd9102-ec1a-4100-aa02-78b16938ef4b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:29.742043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:29.743034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:29.743976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:29.743976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:29.743976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:29.743976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:29.743976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:29.743976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:29.743976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:29.743976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:29.743976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 06:28:29.743976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:29.743976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 301/593] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:29.744568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd9102-ec1a-4100-aa02-78b16938ef4b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:29.770505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:29.786639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:29.845631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4471f51-498f-4611-bb06-3815b5b6af51 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:29.865037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd9102-ec1a-4100-aa02-78b16938ef4b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:29.883327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e073a1-6cf2-4cbb-a940-615ee7efdcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:29.883993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e073a1-6cf2-4cbb-a940-615ee7efdcee None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:29.884278 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e073a1-6cf2-4cbb-a940-615ee7efdcee None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:29.884554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e073a1-6cf2-4cbb-a940-615ee7efdcee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.885396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e073a1-6cf2-4cbb-a940-615ee7efdcee None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=2130fd9eb8464e95a4fb24083c36427a) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:29.886135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e073a1-6cf2-4cbb-a940-615ee7efdcee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.887850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e073a1-6cf2-4cbb-a940-615ee7efdcee None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.906279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 293/594] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:29 2022] GET /identity/v3/role_assignments?user.id=2130fd9eb8464e95a4fb24083c36427a&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:29.906279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e073a1-6cf2-4cbb-a940-615ee7efdcee None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:29.912318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b97e36-7a51-49d1-b2a7-d17d89e39847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:29.913009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97e36-7a51-49d1-b2a7-d17d89e39847 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:29.913290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97e36-7a51-49d1-b2a7-d17d89e39847 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:29.913560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97e36-7a51-49d1-b2a7-d17d89e39847 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:29.914451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b97e36-7a51-49d1-b2a7-d17d89e39847 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:29.914760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b97e36-7a51-49d1-b2a7-d17d89e39847 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:29.916248 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b97e36-7a51-49d1-b2a7-d17d89e39847 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:29.941694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 302/595] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jun 8 06:28:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:29.941694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b97e36-7a51-49d1-b2a7-d17d89e39847 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:30.042860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:30.054165 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b97e36-7a51-49d1-b2a7-d17d89e39847 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:30.068678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:30.074863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e073a1-6cf2-4cbb-a940-615ee7efdcee None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:30.093552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da07d48-877f-4706-a11a-60006124113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:30.094255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da07d48-877f-4706-a11a-60006124113b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:30.095195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da07d48-877f-4706-a11a-60006124113b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:30.095490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da07d48-877f-4706-a11a-60006124113b None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:30.096406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da07d48-877f-4706-a11a-60006124113b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:30.096716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da07d48-877f-4706-a11a-60006124113b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:30.098174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da07d48-877f-4706-a11a-60006124113b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:30.122311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 303/596] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Jun 8 06:28:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:30.123575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da07d48-877f-4706-a11a-60006124113b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:30.129599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af588f92-8f21-4594-88db-6035d635ebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:30.130650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af588f92-8f21-4594-88db-6035d635ebd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:30.130931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af588f92-8f21-4594-88db-6035d635ebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:30.131203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af588f92-8f21-4594-88db-6035d635ebd9 None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/8c060a0a42824aa589135ea357165268/roles/be311caafffd48cfa80fbe10e110493c` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:30.154699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af588f92-8f21-4594-88db-6035d635ebd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=8c060a0a42824aa589135ea357165268, role_id=be311caafffd48cfa80fbe10e110493c)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:30.156761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af588f92-8f21-4594-88db-6035d635ebd9 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:30.231620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da07d48-877f-4706-a11a-60006124113b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:30.263826 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bddad-cbf9-4857-8a31-43e21b693165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:30.264611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bddad-cbf9-4857-8a31-43e21b693165 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:30.264888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bddad-cbf9-4857-8a31-43e21b693165 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:30.265157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bddad-cbf9-4857-8a31-43e21b693165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:30.282721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 294/597] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:28:29 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/8c060a0a42824aa589135ea357165268/roles/be311caafffd48cfa80fbe10e110493c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:30.282721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af588f92-8f21-4594-88db-6035d635ebd9 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:30.284963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bddad-cbf9-4857-8a31-43e21b693165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:30.286488 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bddad-cbf9-4857-8a31-43e21b693165 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-aa9bddad-cbf9-4857-8a31-43e21b693165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:30.310897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:30.311849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:30.317869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:30.317869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:30.317869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:30.317869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:30.317869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 304/598] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:30.317869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279fc8-3cfc-4005-bfa1-8c4c921ead55 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:30.317869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279fc8-3cfc-4005-bfa1-8c4c921ead55 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:30.317869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279fc8-3cfc-4005-bfa1-8c4c921ead55 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:30.317869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 305/599] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:30.318403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279fc8-3cfc-4005-bfa1-8c4c921ead55 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:30.321730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:30.414961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af588f92-8f21-4594-88db-6035d635ebd9 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:30.460745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19ca6c-c067-49ed-bb9f-7ab358607815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:30.461773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19ca6c-c067-49ed-bb9f-7ab358607815 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:30.462124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19ca6c-c067-49ed-bb9f-7ab358607815 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:30.462491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19ca6c-c067-49ed-bb9f-7ab358607815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:30.462921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279fc8-3cfc-4005-bfa1-8c4c921ead55 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:30.485224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19ca6c-c067-49ed-bb9f-7ab358607815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:30.487214 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19ca6c-c067-49ed-bb9f-7ab358607815 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:30.497385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3b19ca6c-c067-49ed-bb9f-7ab358607815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:30.507339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:30.508226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:30.509112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:30.509112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:30.509112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:30.509112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:30.512398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 295/600] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:30.512624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18819ae8-ce86-4ace-bc34-7a79477b3ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:30.513429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819ae8-ce86-4ace-bc34-7a79477b3ffe None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:30.513706 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819ae8-ce86-4ace-bc34-7a79477b3ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:30.513813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2335e-04ba-42cf-87ea-52d4da8cee7d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:30.513978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819ae8-ce86-4ace-bc34-7a79477b3ffe None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:30.514078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2335e-04ba-42cf-87ea-52d4da8cee7d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:30.515703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2335e-04ba-42cf-87ea-52d4da8cee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:30.515822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18819ae8-ce86-4ace-bc34-7a79477b3ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:30.515822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18819ae8-ce86-4ace-bc34-7a79477b3ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:30.517020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18819ae8-ce86-4ace-bc34-7a79477b3ffe None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:30.530725 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 306/601] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:30.531410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18819ae8-ce86-4ace-bc34-7a79477b3ffe None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:30.533427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5db2335e-04ba-42cf-87ea-52d4da8cee7d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:30.538134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5db2335e-04ba-42cf-87ea-52d4da8cee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:30.609331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 296/602] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:30.609724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:30.610633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2335e-04ba-42cf-87ea-52d4da8cee7d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:30.667402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18819ae8-ce86-4ace-bc34-7a79477b3ffe None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:30.715313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34670e2e-564d-4d99-afe6-97646b3b0b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:30.716497 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34670e2e-564d-4d99-afe6-97646b3b0b45 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:30.717180 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34670e2e-564d-4d99-afe6-97646b3b0b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:30.718024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34670e2e-564d-4d99-afe6-97646b3b0b45 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:30.719198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34670e2e-564d-4d99-afe6-97646b3b0b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:30.719727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34670e2e-564d-4d99-afe6-97646b3b0b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:30.720741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2335e-04ba-42cf-87ea-52d4da8cee7d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:30.721791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34670e2e-564d-4d99-afe6-97646b3b0b45 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:30.739458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 307/603] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:30.740600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34670e2e-564d-4d99-afe6-97646b3b0b45 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:30.757812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:30.765592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16c805-c404-4d39-86bd-48466c4806f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:30.767778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c805-c404-4d39-86bd-48466c4806f4 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:30.768223 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c805-c404-4d39-86bd-48466c4806f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:30.768903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c805-c404-4d39-86bd-48466c4806f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:30.779053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16c805-c404-4d39-86bd-48466c4806f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:30.782880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16c805-c404-4d39-86bd-48466c4806f4 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-2e16c805-c404-4d39-86bd-48466c4806f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:30.804985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:30.806077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:30.807344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:30.807344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:30.807344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:30.807344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:30.807344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:30.807344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:30.807344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:30.807344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:30.810259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 297/604] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:30.812015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16c805-c404-4d39-86bd-48466c4806f4 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:30.860168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34670e2e-564d-4d99-afe6-97646b3b0b45 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:30.888771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:30.901617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daaa87-f4b7-42ef-ba90-8812d0628288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:30.902369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daaa87-f4b7-42ef-ba90-8812d0628288 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:30.902815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daaa87-f4b7-42ef-ba90-8812d0628288 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:30.903182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daaa87-f4b7-42ef-ba90-8812d0628288 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:30.914371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daaa87-f4b7-42ef-ba90-8812d0628288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-08daaa87-f4b7-42ef-ba90-8812d0628288 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:30.923449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:30.924420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:30.925435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 308/605] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:30.926320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daaa87-f4b7-42ef-ba90-8812d0628288 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:30.937928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16c805-c404-4d39-86bd-48466c4806f4 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:30.973144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22609e-102b-4da5-84bb-21ffbe54240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:30.974403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22609e-102b-4da5-84bb-21ffbe54240e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:30.974873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22609e-102b-4da5-84bb-21ffbe54240e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:30.975355 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22609e-102b-4da5-84bb-21ffbe54240e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:30.982542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22609e-102b-4da5-84bb-21ffbe54240e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:30.984210 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22609e-102b-4da5-84bb-21ffbe54240e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-0f22609e-102b-4da5-84bb-21ffbe54240e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:30.999426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:31.000335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:31.001775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:31.001775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:31.001775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:31.001775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:31.001775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:31.001775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:31.001775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:31.001775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:31.004263 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 298/606] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:31.005331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22609e-102b-4da5-84bb-21ffbe54240e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:31.034883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daaa87-f4b7-42ef-ba90-8812d0628288 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:31.058509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:31.072625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f39655-00ba-4cbf-a038-ac5e3c4a75ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:31.078397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39655-00ba-4cbf-a038-ac5e3c4a75ce None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:31.078397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39655-00ba-4cbf-a038-ac5e3c4a75ce None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:31.078397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39655-00ba-4cbf-a038-ac5e3c4a75ce None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:31.078397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f39655-00ba-4cbf-a038-ac5e3c4a75ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:31.078397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f39655-00ba-4cbf-a038-ac5e3c4a75ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:31.078397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f39655-00ba-4cbf-a038-ac5e3c4a75ce None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:31.089933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 309/607] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:31.090894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f39655-00ba-4cbf-a038-ac5e3c4a75ce None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:31.114109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22609e-102b-4da5-84bb-21ffbe54240e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:31.144392 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:31.152089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff679cc-4d8c-4a6d-8de9-16276bf1a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:31.154494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff679cc-4d8c-4a6d-8de9-16276bf1a95c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:31.154494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff679cc-4d8c-4a6d-8de9-16276bf1a95c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:31.154494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff679cc-4d8c-4a6d-8de9-16276bf1a95c None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:31.154880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff679cc-4d8c-4a6d-8de9-16276bf1a95c None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:31.155364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff679cc-4d8c-4a6d-8de9-16276bf1a95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:31.156904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff679cc-4d8c-4a6d-8de9-16276bf1a95c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:31.166187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 299/608] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:31.167406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff679cc-4d8c-4a6d-8de9-16276bf1a95c None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:31.208882 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f39655-00ba-4cbf-a038-ac5e3c4a75ce None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:31.246580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395177ab-44a9-4092-98f2-cf77bb74cb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:31.247240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395177ab-44a9-4092-98f2-cf77bb74cb8e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:31.247524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395177ab-44a9-4092-98f2-cf77bb74cb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:31.247801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395177ab-44a9-4092-98f2-cf77bb74cb8e None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:31.248595 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395177ab-44a9-4092-98f2-cf77bb74cb8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:31.248903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395177ab-44a9-4092-98f2-cf77bb74cb8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:31.250564 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395177ab-44a9-4092-98f2-cf77bb74cb8e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:31.264377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 310/609] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:31.265188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395177ab-44a9-4092-98f2-cf77bb74cb8e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:31.274737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff679cc-4d8c-4a6d-8de9-16276bf1a95c None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:31.288672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:31.310791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca342b-2502-47a7-abdf-b376d920a228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:31.312008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca342b-2502-47a7-abdf-b376d920a228 None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:31.312684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca342b-2502-47a7-abdf-b376d920a228 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:31.313187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca342b-2502-47a7-abdf-b376d920a228 None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/5498a6912a08408d9ea30920faceee7a/roles/be311caafffd48cfa80fbe10e110493c` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:31.329049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca342b-2502-47a7-abdf-b376d920a228 None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=5498a6912a08408d9ea30920faceee7a, role_id=be311caafffd48cfa80fbe10e110493c)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:31.330836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca342b-2502-47a7-abdf-b376d920a228 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:31.374580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395177ab-44a9-4092-98f2-cf77bb74cb8e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:31.376288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:31.408539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e89705-7671-4da6-b7d7-cbbe7285f2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:31.409333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e89705-7671-4da6-b7d7-cbbe7285f2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:31.409618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e89705-7671-4da6-b7d7-cbbe7285f2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:31.409892 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e89705-7671-4da6-b7d7-cbbe7285f2f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:31.423252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e89705-7671-4da6-b7d7-cbbe7285f2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:31.424972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e89705-7671-4da6-b7d7-cbbe7285f2f9 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:31.435020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 300/610] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:28:31 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/5498a6912a08408d9ea30920faceee7a/roles/be311caafffd48cfa80fbe10e110493c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:31.436420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca342b-2502-47a7-abdf-b376d920a228 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-10e89705-7671-4da6-b7d7-cbbe7285f2f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:31.472972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:31.473990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:31.474949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:31.474949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:31.474949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:31.474949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:31.479658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 311/611] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:31.484182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e89705-7671-4da6-b7d7-cbbe7285f2f9 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:31.643500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e89705-7671-4da6-b7d7-cbbe7285f2f9 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:31.681838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973dcc8-920d-4a5e-84b7-824eece76880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:31.682903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973dcc8-920d-4a5e-84b7-824eece76880 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:31.683374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973dcc8-920d-4a5e-84b7-824eece76880 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:31.683830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973dcc8-920d-4a5e-84b7-824eece76880 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:31.684429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca342b-2502-47a7-abdf-b376d920a228 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:31.684961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973dcc8-920d-4a5e-84b7-824eece76880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:31.685535 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973dcc8-920d-4a5e-84b7-824eece76880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:31.687135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973dcc8-920d-4a5e-84b7-824eece76880 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:31.701707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 312/612] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:31.707067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973dcc8-920d-4a5e-84b7-824eece76880 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:31.726598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:31.727387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa91747-cfe8-4180-b01a-da8dda56066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:31.728941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa91747-cfe8-4180-b01a-da8dda56066a None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:31.729422 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa91747-cfe8-4180-b01a-da8dda56066a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:31.729885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa91747-cfe8-4180-b01a-da8dda56066a None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/11838a2908884cc79df912b3b2199564/roles/be311caafffd48cfa80fbe10e110493c` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:31.746953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa91747-cfe8-4180-b01a-da8dda56066a None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=11838a2908884cc79df912b3b2199564, role_id=be311caafffd48cfa80fbe10e110493c)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:31.748696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa91747-cfe8-4180-b01a-da8dda56066a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:31.809715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 301/613] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:28:31 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/11838a2908884cc79df912b3b2199564/roles/be311caafffd48cfa80fbe10e110493c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:31.840299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973dcc8-920d-4a5e-84b7-824eece76880 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:31.881070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728864a5-0ff0-48a0-829d-268067a396a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:31.882227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728864a5-0ff0-48a0-829d-268067a396a0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:31.882783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728864a5-0ff0-48a0-829d-268067a396a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:31.883288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728864a5-0ff0-48a0-829d-268067a396a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:31.892052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728864a5-0ff0-48a0-829d-268067a396a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:31.893883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728864a5-0ff0-48a0-829d-268067a396a0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-728864a5-0ff0-48a0-829d-268067a396a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:31.912135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:31.913137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:31.914097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:31.914097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:31.914097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:31.914097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:31.914097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:31.914097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:31.914097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:31.914097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:31.914097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:31.914097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:31.916773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 313/614] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jun 8 06:28:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:31.921945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa91747-cfe8-4180-b01a-da8dda56066a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:31.950720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:32.072441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa91747-cfe8-4180-b01a-da8dda56066a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:32.130314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cdacc-eb6b-4c6a-98d1-c3e427b00cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:32.131410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cdacc-eb6b-4c6a-98d1-c3e427b00cab None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:32.131920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cdacc-eb6b-4c6a-98d1-c3e427b00cab None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:32.132398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cdacc-eb6b-4c6a-98d1-c3e427b00cab None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:32.133500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cdacc-eb6b-4c6a-98d1-c3e427b00cab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:32.134024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cdacc-eb6b-4c6a-98d1-c3e427b00cab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:32.135737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cdacc-eb6b-4c6a-98d1-c3e427b00cab None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:32.166857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 302/615] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jun 8 06:28:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:32.174270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728864a5-0ff0-48a0-829d-268067a396a0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:32.274985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:32.301865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728864a5-0ff0-48a0-829d-268067a396a0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:32.338527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7389c3d-a17b-401e-9f5a-0db5f6e84fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:32.339191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7389c3d-a17b-401e-9f5a-0db5f6e84fbf None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:32.339478 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7389c3d-a17b-401e-9f5a-0db5f6e84fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:32.339758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7389c3d-a17b-401e-9f5a-0db5f6e84fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:32.380507 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7738-bda5-47a2-b5ce-31f96ba7755c None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:32.380787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7738-bda5-47a2-b5ce-31f96ba7755c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:32.381063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7738-bda5-47a2-b5ce-31f96ba7755c None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:32.382603 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 303/616] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:32.392188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a474867-5b36-4633-9c41-f81f632fd3cc None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:32.392471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a474867-5b36-4633-9c41-f81f632fd3cc None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:32.392742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a474867-5b36-4633-9c41-f81f632fd3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:32.417201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7389c3d-a17b-401e-9f5a-0db5f6e84fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:32.418879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7389c3d-a17b-401e-9f5a-0db5f6e84fbf None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:32.423292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-1a474867-5b36-4633-9c41-f81f632fd3cc None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:32.424490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1a474867-5b36-4633-9c41-f81f632fd3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:32.497395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:32.526839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 314/617] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:32.533233 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7389c3d-a17b-401e-9f5a-0db5f6e84fbf None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:32.574848 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:32.583710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 304/618] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:32.651319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a474867-5b36-4633-9c41-f81f632fd3cc None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:32.664900 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7389c3d-a17b-401e-9f5a-0db5f6e84fbf None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:32.699886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4584a63-c0b4-4ebe-9261-ddaced6d38ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:32.700596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4584a63-c0b4-4ebe-9261-ddaced6d38ad None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:32.700874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4584a63-c0b4-4ebe-9261-ddaced6d38ad None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:32.701141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4584a63-c0b4-4ebe-9261-ddaced6d38ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:32.712144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4584a63-c0b4-4ebe-9261-ddaced6d38ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:32.713591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4584a63-c0b4-4ebe-9261-ddaced6d38ad None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-a4584a63-c0b4-4ebe-9261-ddaced6d38ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:32.734316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:32.735400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:32.736919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:32.736919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:32.736919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:32.736919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:32.736919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 315/619] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:32.741151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4584a63-c0b4-4ebe-9261-ddaced6d38ad None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:32.769663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:32.846226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4584a63-c0b4-4ebe-9261-ddaced6d38ad None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:32.881136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c130b8-e813-4d1f-b4e7-04e1f275fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:32.882185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c130b8-e813-4d1f-b4e7-04e1f275fea4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:32.882697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c130b8-e813-4d1f-b4e7-04e1f275fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:32.883164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c130b8-e813-4d1f-b4e7-04e1f275fea4 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:32.884097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c130b8-e813-4d1f-b4e7-04e1f275fea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:32.884600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c130b8-e813-4d1f-b4e7-04e1f275fea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:32.886184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c130b8-e813-4d1f-b4e7-04e1f275fea4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:32.899645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 316/620] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:32.905299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aec35-ab90-43ca-aa92-34a5d642e4f9 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:32.905418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a474867-5b36-4633-9c41-f81f632fd3cc None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:32.906287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aec35-ab90-43ca-aa92-34a5d642e4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:32.906800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aec35-ab90-43ca-aa92-34a5d642e4f9 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:32.908572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 317/621] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:32.909544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aec35-ab90-43ca-aa92-34a5d642e4f9 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:32.951391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326affc-0f6c-4904-ba65-6930f0d6b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:32.952119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326affc-0f6c-4904-ba65-6930f0d6b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:32.952403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326affc-0f6c-4904-ba65-6930f0d6b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:32.952680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326affc-0f6c-4904-ba65-6930f0d6b6d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:32.967829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326affc-0f6c-4904-ba65-6930f0d6b6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-4326affc-0f6c-4904-ba65-6930f0d6b6d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:32.979346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:32.980280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:32.981084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:32.981719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 305/622] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:32.986258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e789-474d-4f4e-a6e9-7fafa2dc4bc6 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:32.986258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e789-474d-4f4e-a6e9-7fafa2dc4bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:32.986258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e789-474d-4f4e-a6e9-7fafa2dc4bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:33.005876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:33.006894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-68b9e789-474d-4f4e-a6e9-7fafa2dc4bc6 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:33.008096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-68b9e789-474d-4f4e-a6e9-7fafa2dc4bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:33.025519 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aec35-ab90-43ca-aa92-34a5d642e4f9 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:33.073080 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6346d-c968-4a51-aad6-9f900e76ddc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:33.073986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6346d-c968-4a51-aad6-9f900e76ddc1 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:33.074619 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6346d-c968-4a51-aad6-9f900e76ddc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:33.075495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6346d-c968-4a51-aad6-9f900e76ddc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:33.077961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:33.086879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6346d-c968-4a51-aad6-9f900e76ddc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:33.088517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6346d-c968-4a51-aad6-9f900e76ddc1 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:33.094566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 306/623] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:33.095449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9e789-474d-4f4e-a6e9-7fafa2dc4bc6 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-aaa6346d-c968-4a51-aad6-9f900e76ddc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:33.104358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:33.105448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:33.106430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:33.106430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:33.106430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:33.106430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:33.106430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:33.106430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:33.106430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:33.106430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:33.108469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 318/624] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:33.115308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6346d-c968-4a51-aad6-9f900e76ddc1 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:33.233763 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6346d-c968-4a51-aad6-9f900e76ddc1 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:33.247613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9e789-474d-4f4e-a6e9-7fafa2dc4bc6 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:33.269723 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc344ca6-7fec-4c04-9693-def4f767e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:33.270414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc344ca6-7fec-4c04-9693-def4f767e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:33.270698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc344ca6-7fec-4c04-9693-def4f767e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:33.270971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc344ca6-7fec-4c04-9693-def4f767e5b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:33.271761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc344ca6-7fec-4c04-9693-def4f767e5b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:33.272067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc344ca6-7fec-4c04-9693-def4f767e5b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:33.273483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc344ca6-7fec-4c04-9693-def4f767e5b9 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:33.286273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 319/625] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:33.287101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc344ca6-7fec-4c04-9693-def4f767e5b9 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:33.294160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6e88b-bafa-48b7-84da-2c1ca23f6f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:33.295145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6e88b-bafa-48b7-84da-2c1ca23f6f50 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:33.295984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:33.296452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6e88b-bafa-48b7-84da-2c1ca23f6f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:33.296908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6e88b-bafa-48b7-84da-2c1ca23f6f50 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:33.299050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6e88b-bafa-48b7-84da-2c1ca23f6f50 None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:33.299688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6e88b-bafa-48b7-84da-2c1ca23f6f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:33.301838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6e88b-bafa-48b7-84da-2c1ca23f6f50 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:33.313157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 307/626] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:33.314974 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6e88b-bafa-48b7-84da-2c1ca23f6f50 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:33.383864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:33.394514 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc344ca6-7fec-4c04-9693-def4f767e5b9 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:33.440267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6e88b-bafa-48b7-84da-2c1ca23f6f50 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:33.441024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eb9f0-be57-4c6b-ac9c-7c3fa2878f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:33.442477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eb9f0-be57-4c6b-ac9c-7c3fa2878f0f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:33.444036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eb9f0-be57-4c6b-ac9c-7c3fa2878f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:33.444556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eb9f0-be57-4c6b-ac9c-7c3fa2878f0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:33.459302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eb9f0-be57-4c6b-ac9c-7c3fa2878f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-ef1eb9f0-be57-4c6b-ac9c-7c3fa2878f0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:33.467244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:33.468189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:33.469004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:33.473563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 320/627] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:33.474207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eb9f0-be57-4c6b-ac9c-7c3fa2878f0f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:33.487732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a20b9-9bce-4f65-9f04-de2f6001dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:33.488700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a20b9-9bce-4f65-9f04-de2f6001dffd None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:33.489591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a20b9-9bce-4f65-9f04-de2f6001dffd None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:33.490079 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a20b9-9bce-4f65-9f04-de2f6001dffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:33.491927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a20b9-9bce-4f65-9f04-de2f6001dffd None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=b8661ef27af34bbea11e215831d50843) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:33.492448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a20b9-9bce-4f65-9f04-de2f6001dffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:33.494849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a20b9-9bce-4f65-9f04-de2f6001dffd None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:33.510288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 308/628] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:33 2022] GET /identity/v3/role_assignments?user.id=b8661ef27af34bbea11e215831d50843&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:33.510288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a20b9-9bce-4f65-9f04-de2f6001dffd None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:33.605527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:33.646266 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eb9f0-be57-4c6b-ac9c-7c3fa2878f0f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:33.687532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877d4f6-6b60-4edd-a5e3-18a7236f85c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:33.688386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877d4f6-6b60-4edd-a5e3-18a7236f85c0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:33.689160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877d4f6-6b60-4edd-a5e3-18a7236f85c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:33.689434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877d4f6-6b60-4edd-a5e3-18a7236f85c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:33.702425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877d4f6-6b60-4edd-a5e3-18a7236f85c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:33.703950 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877d4f6-6b60-4edd-a5e3-18a7236f85c0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:33.725663 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a20b9-9bce-4f65-9f04-de2f6001dffd None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-4877d4f6-6b60-4edd-a5e3-18a7236f85c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:33.751480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:33.752388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:33.753703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:33.753703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:33.753703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:33.753703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:33.753703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 321/629] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:33.758960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:33.759674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877d4f6-6b60-4edd-a5e3-18a7236f85c0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:33.773329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39689520-bc4d-4073-8e36-6c944df73fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:33.774011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39689520-bc4d-4073-8e36-6c944df73fee None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:33.774322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39689520-bc4d-4073-8e36-6c944df73fee None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:33.774604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39689520-bc4d-4073-8e36-6c944df73fee None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:33.775364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39689520-bc4d-4073-8e36-6c944df73fee None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:33.775672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39689520-bc4d-4073-8e36-6c944df73fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:33.777046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39689520-bc4d-4073-8e36-6c944df73fee None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:33.791751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 309/630] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:33.796403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39689520-bc4d-4073-8e36-6c944df73fee None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:33.896548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877d4f6-6b60-4edd-a5e3-18a7236f85c0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:33.915082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39689520-bc4d-4073-8e36-6c944df73fee None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:33.922850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:33.941987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c50a5-3c2a-4711-9284-bf0ffa03df10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:33.944225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c50a5-3c2a-4711-9284-bf0ffa03df10 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:33.944514 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c50a5-3c2a-4711-9284-bf0ffa03df10 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:33.944791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c50a5-3c2a-4711-9284-bf0ffa03df10 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:33.946369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c50a5-3c2a-4711-9284-bf0ffa03df10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:33.946369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c50a5-3c2a-4711-9284-bf0ffa03df10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:33.947458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c50a5-3c2a-4711-9284-bf0ffa03df10 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:33.957967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad4c10-3588-49be-9be1-ae409e8fbe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:33.959306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4c10-3588-49be-9be1-ae409e8fbe0a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:33.959789 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4c10-3588-49be-9be1-ae409e8fbe0a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:33.960237 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4c10-3588-49be-9be1-ae409e8fbe0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:33.961090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 322/631] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:33.971614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c50a5-3c2a-4711-9284-bf0ffa03df10 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:33.983272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad4c10-3588-49be-9be1-ae409e8fbe0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:33.985473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad4c10-3588-49be-9be1-ae409e8fbe0a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-0fad4c10-3588-49be-9be1-ae409e8fbe0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:34.008310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:34.009187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:34.010081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:34.010081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:34.010081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:34.010081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:34.016154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 310/632] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:34.017424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad4c10-3588-49be-9be1-ae409e8fbe0a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:34.051941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:34.098534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c50a5-3c2a-4711-9284-bf0ffa03df10 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:34.136282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e890033-a5d0-44d7-8343-2708e0dafddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:34.137078 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e890033-a5d0-44d7-8343-2708e0dafddd None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.137363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e890033-a5d0-44d7-8343-2708e0dafddd None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.137640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e890033-a5d0-44d7-8343-2708e0dafddd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.145370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad4c10-3588-49be-9be1-ae409e8fbe0a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:34.146023 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e890033-a5d0-44d7-8343-2708e0dafddd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:34.147555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e890033-a5d0-44d7-8343-2708e0dafddd None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-4e890033-a5d0-44d7-8343-2708e0dafddd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:34.163670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:34.164873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:34.166014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:34.166014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:34.166014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:34.166014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:34.166014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:34.166014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:34.166014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:34.166014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:34.166014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:34.166014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:34.167922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 323/633] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:34.172650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbffa37-7630-4d1c-b087-2c53938c2a05 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.172650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbffa37-7630-4d1c-b087-2c53938c2a05 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.172650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbffa37-7630-4d1c-b087-2c53938c2a05 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.172650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 324/634] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:34.175210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbffa37-7630-4d1c-b087-2c53938c2a05 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:34.195329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3c8d3-feb1-40f4-896b-582a3af846dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:34.196175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c8d3-feb1-40f4-896b-582a3af846dd None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.196464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c8d3-feb1-40f4-896b-582a3af846dd None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.196744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c8d3-feb1-40f4-896b-582a3af846dd None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.197882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3c8d3-feb1-40f4-896b-582a3af846dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:34.198369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3c8d3-feb1-40f4-896b-582a3af846dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:34.200287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3c8d3-feb1-40f4-896b-582a3af846dd None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:34.216782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 311/635] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:34.218400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ea336-d532-4ce5-8930-edeed11bb824 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.218655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ea336-d532-4ce5-8930-edeed11bb824 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.218934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ea336-d532-4ce5-8930-edeed11bb824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.229242 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:34.240131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-f40ea336-d532-4ce5-8930-edeed11bb824 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:34.245889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f40ea336-d532-4ce5-8930-edeed11bb824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:34.294257 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbffa37-7630-4d1c-b087-2c53938c2a05 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:34.322542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 312/636] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:34.325396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ea336-d532-4ce5-8930-edeed11bb824 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:34.341033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9834515-6b13-4b21-8502-160dcf8583d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:34.341731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9834515-6b13-4b21-8502-160dcf8583d8 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.342020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9834515-6b13-4b21-8502-160dcf8583d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.342347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9834515-6b13-4b21-8502-160dcf8583d8 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.343237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9834515-6b13-4b21-8502-160dcf8583d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:34.343614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9834515-6b13-4b21-8502-160dcf8583d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:34.345173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9834515-6b13-4b21-8502-160dcf8583d8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:34.365582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 325/637] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jun 8 06:28:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:34.370254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:34.370538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9834515-6b13-4b21-8502-160dcf8583d8 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:34.477867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ea336-d532-4ce5-8930-edeed11bb824 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:34.508000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9834515-6b13-4b21-8502-160dcf8583d8 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:34.514699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a438925-2d82-4133-9acd-203149153eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:34.515498 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a438925-2d82-4133-9acd-203149153eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.515839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a438925-2d82-4133-9acd-203149153eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.516112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a438925-2d82-4133-9acd-203149153eb8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.524480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a438925-2d82-4133-9acd-203149153eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:34.525908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a438925-2d82-4133-9acd-203149153eb8 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:34.527420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-2a438925-2d82-4133-9acd-203149153eb8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:34.541912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:34.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:34.544140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:34.544140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:34.544140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:34.544140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:34.544140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:34.544140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:34.544140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:34.544140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:34.544140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 06:28:34.544140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:34.547832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 313/638] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:34.548494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a438925-2d82-4133-9acd-203149153eb8 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:34.549980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e8b27-5ef9-485f-98a3-d4c14ae8891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:34.550883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e8b27-5ef9-485f-98a3-d4c14ae8891a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.551461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e8b27-5ef9-485f-98a3-d4c14ae8891a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.551796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e8b27-5ef9-485f-98a3-d4c14ae8891a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.566320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e8b27-5ef9-485f-98a3-d4c14ae8891a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-4a2e8b27-5ef9-485f-98a3-d4c14ae8891a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:34.576916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:34.578099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:34.579757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 326/639] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:34.580549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e8b27-5ef9-485f-98a3-d4c14ae8891a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:34.652083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:34.675879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a438925-2d82-4133-9acd-203149153eb8 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:34.700498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e8b27-5ef9-485f-98a3-d4c14ae8891a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:34.712642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bfaea-0f69-4f1c-8e5d-b216e0885b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:34.713443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bfaea-0f69-4f1c-8e5d-b216e0885b4e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.713728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bfaea-0f69-4f1c-8e5d-b216e0885b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.714004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bfaea-0f69-4f1c-8e5d-b216e0885b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.724578 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bfaea-0f69-4f1c-8e5d-b216e0885b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:34.726012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bfaea-0f69-4f1c-8e5d-b216e0885b4e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:34.736051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045379f-ae57-4542-9ce2-0de6af233692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:34.736991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045379f-ae57-4542-9ce2-0de6af233692 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.737275 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045379f-ae57-4542-9ce2-0de6af233692 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.737549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045379f-ae57-4542-9ce2-0de6af233692 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.738419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045379f-ae57-4542-9ce2-0de6af233692 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:34.738727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045379f-ae57-4542-9ce2-0de6af233692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:34.740130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045379f-ae57-4542-9ce2-0de6af233692 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-cc8bfaea-0f69-4f1c-8e5d-b216e0885b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:34.744391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:34.745306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:34.746197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:34.746197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:34.746197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:34.746197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:34.746197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 314/640] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:34.746949 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bfaea-0f69-4f1c-8e5d-b216e0885b4e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:34.760334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 327/641] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jun 8 06:28:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:34.761950 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90116363-5be6-492b-b616-df618b71b077 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.762516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90116363-5be6-492b-b616-df618b71b077 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.762951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90116363-5be6-492b-b616-df618b71b077 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.764320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 328/642] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:34.767352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90116363-5be6-492b-b616-df618b71b077 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:34.786880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:34.858583 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bfaea-0f69-4f1c-8e5d-b216e0885b4e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:34.889380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90116363-5be6-492b-b616-df618b71b077 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:34.891486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:34.896823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6607f-95ef-48bb-949a-5e555192969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:34.897333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6607f-95ef-48bb-949a-5e555192969b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.897614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6607f-95ef-48bb-949a-5e555192969b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.897887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6607f-95ef-48bb-949a-5e555192969b None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.898664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6607f-95ef-48bb-949a-5e555192969b None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:34.899152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6607f-95ef-48bb-949a-5e555192969b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:34.900573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6607f-95ef-48bb-949a-5e555192969b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:34.913829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 315/643] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:34.913829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6607f-95ef-48bb-949a-5e555192969b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:34.926435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b71af-52a4-40c8-9d19-317744eb9245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:34.927113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b71af-52a4-40c8-9d19-317744eb9245 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.927383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b71af-52a4-40c8-9d19-317744eb9245 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.927653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b71af-52a4-40c8-9d19-317744eb9245 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.928427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b71af-52a4-40c8-9d19-317744eb9245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:34.928759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b71af-52a4-40c8-9d19-317744eb9245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:34.930134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b71af-52a4-40c8-9d19-317744eb9245 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:34.943972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 329/644] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:34.945467 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493082a-3cc5-48d3-b5e2-2116e57761bb None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:34.945752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493082a-3cc5-48d3-b5e2-2116e57761bb None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:34.946025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493082a-3cc5-48d3-b5e2-2116e57761bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:34.969109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e493082a-3cc5-48d3-b5e2-2116e57761bb None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:34.970660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e493082a-3cc5-48d3-b5e2-2116e57761bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:35.023278 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6607f-95ef-48bb-949a-5e555192969b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:35.050283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 330/645] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:35.050283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493082a-3cc5-48d3-b5e2-2116e57761bb None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:35.051866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:35.066061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2dbdc-ba48-4e6a-b876-2e998ca58cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:35.067020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2dbdc-ba48-4e6a-b876-2e998ca58cef None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:35.067468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2dbdc-ba48-4e6a-b876-2e998ca58cef None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:35.068348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2dbdc-ba48-4e6a-b876-2e998ca58cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:35.133083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:35.143451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2dbdc-ba48-4e6a-b876-2e998ca58cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:35.144902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2dbdc-ba48-4e6a-b876-2e998ca58cef None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:35.168414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493082a-3cc5-48d3-b5e2-2116e57761bb None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:35.206581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10db35b-34d3-4c86-9e7b-407d211326f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:35.207377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10db35b-34d3-4c86-9e7b-407d211326f9 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:35.207658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10db35b-34d3-4c86-9e7b-407d211326f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:35.207929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10db35b-34d3-4c86-9e7b-407d211326f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:35.219106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10db35b-34d3-4c86-9e7b-407d211326f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:35.221497 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10db35b-34d3-4c86-9e7b-407d211326f9 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-b10db35b-34d3-4c86-9e7b-407d211326f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:35.240419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:35.241407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:35.243025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:35.243025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:35.243025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:35.243025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:35.243025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 331/646] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:35.243025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10db35b-34d3-4c86-9e7b-407d211326f9 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:35.256091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 316/647] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:35.256091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2dbdc-ba48-4e6a-b876-2e998ca58cef None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:35.303344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:35.347550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10db35b-34d3-4c86-9e7b-407d211326f9 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:35.351563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:35.359078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2dbdc-ba48-4e6a-b876-2e998ca58cef None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:35.382227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57c29e-4635-41d1-a5e7-a39d07dc4fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:35.383193 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c29e-4635-41d1-a5e7-a39d07dc4fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:35.383300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c29e-4635-41d1-a5e7-a39d07dc4fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:35.383564 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c29e-4635-41d1-a5e7-a39d07dc4fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:35.390674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57c29e-4635-41d1-a5e7-a39d07dc4fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:35.392626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57c29e-4635-41d1-a5e7-a39d07dc4fc7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:35.395432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9e30f-bfad-4375-8d03-6ac2ffd019a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:35.396222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9e30f-bfad-4375-8d03-6ac2ffd019a9 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:35.396503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9e30f-bfad-4375-8d03-6ac2ffd019a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:35.396775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9e30f-bfad-4375-8d03-6ac2ffd019a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-8b57c29e-4635-41d1-a5e7-a39d07dc4fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:35.406079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:35.407570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:35.408458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:35.408458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:35.408458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:35.408458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:35.408458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:35.408458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:35.408458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:35.408458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:35.408458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 332/648] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:35.409490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57c29e-4635-41d1-a5e7-a39d07dc4fc7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:35.413374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9e30f-bfad-4375-8d03-6ac2ffd019a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-5ad9e30f-bfad-4375-8d03-6ac2ffd019a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:35.420731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:35.421642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:35.422506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 317/649] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:35.424409 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9e30f-bfad-4375-8d03-6ac2ffd019a9 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:35.517336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57c29e-4635-41d1-a5e7-a39d07dc4fc7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:35.533611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9e30f-bfad-4375-8d03-6ac2ffd019a9 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:35.535517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:35.555441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56df2f-da1e-4371-aa74-65a086dd01db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:35.556145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56df2f-da1e-4371-aa74-65a086dd01db None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:35.556377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56df2f-da1e-4371-aa74-65a086dd01db None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:35.556634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56df2f-da1e-4371-aa74-65a086dd01db None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:35.557409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56df2f-da1e-4371-aa74-65a086dd01db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:35.557714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56df2f-da1e-4371-aa74-65a086dd01db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:35.559096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56df2f-da1e-4371-aa74-65a086dd01db None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:35.570599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237bb74-f0d8-4a59-9e61-fc7296a1de7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:35.571167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 333/650] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:35.571736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237bb74-f0d8-4a59-9e61-fc7296a1de7c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:35.571955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56df2f-da1e-4371-aa74-65a086dd01db None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:35.572488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237bb74-f0d8-4a59-9e61-fc7296a1de7c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:35.572904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237bb74-f0d8-4a59-9e61-fc7296a1de7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:35.585865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237bb74-f0d8-4a59-9e61-fc7296a1de7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:35.587364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237bb74-f0d8-4a59-9e61-fc7296a1de7c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3237bb74-f0d8-4a59-9e61-fc7296a1de7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:35.604646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:35.605543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:35.606452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:35.606452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:35.606452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:35.606452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:35.606452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 318/651] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:35.606719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237bb74-f0d8-4a59-9e61-fc7296a1de7c None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:35.619873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:35.682263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56df2f-da1e-4371-aa74-65a086dd01db None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:35.712650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237bb74-f0d8-4a59-9e61-fc7296a1de7c None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:35.718088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36143681-a5b6-42e5-8d07-f31a4dc8d25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:35.718806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36143681-a5b6-42e5-8d07-f31a4dc8d25b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:35.719089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36143681-a5b6-42e5-8d07-f31a4dc8d25b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:35.719401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36143681-a5b6-42e5-8d07-f31a4dc8d25b None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:35.720192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36143681-a5b6-42e5-8d07-f31a4dc8d25b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:35.720500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36143681-a5b6-42e5-8d07-f31a4dc8d25b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:35.721924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36143681-a5b6-42e5-8d07-f31a4dc8d25b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:35.734304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 334/652] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:35.735424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36143681-a5b6-42e5-8d07-f31a4dc8d25b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:35.753897 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454181-21d4-4ce9-808e-9727811f3331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:35.754591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454181-21d4-4ce9-808e-9727811f3331 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:35.754868 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454181-21d4-4ce9-808e-9727811f3331 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:35.755139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454181-21d4-4ce9-808e-9727811f3331 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:35.755885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06454181-21d4-4ce9-808e-9727811f3331 None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:35.756187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06454181-21d4-4ce9-808e-9727811f3331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:35.757565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06454181-21d4-4ce9-808e-9727811f3331 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:35.766194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 319/653] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:35.767012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454181-21d4-4ce9-808e-9727811f3331 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:35.778633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:35.839466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:35.844068 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36143681-a5b6-42e5-8d07-f31a4dc8d25b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:35.875132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454181-21d4-4ce9-808e-9727811f3331 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:35.883898 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972602d-0e9b-4f2d-a884-c4bf054e92bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:35.884740 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972602d-0e9b-4f2d-a884-c4bf054e92bd None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:35.885024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972602d-0e9b-4f2d-a884-c4bf054e92bd None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:35.885299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972602d-0e9b-4f2d-a884-c4bf054e92bd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:35.894637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972602d-0e9b-4f2d-a884-c4bf054e92bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:35.896105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972602d-0e9b-4f2d-a884-c4bf054e92bd None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-5972602d-0e9b-4f2d-a884-c4bf054e92bd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:35.911169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:35.912350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 335/654] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:35.913447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972602d-0e9b-4f2d-a884-c4bf054e92bd None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:35.922053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0a4c0-a6c6-4332-bb4f-5fa1fde2c18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:35.923853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0a4c0-a6c6-4332-bb4f-5fa1fde2c18d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:35.924322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0a4c0-a6c6-4332-bb4f-5fa1fde2c18d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:35.924739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0a4c0-a6c6-4332-bb4f-5fa1fde2c18d None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:35.926020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0a4c0-a6c6-4332-bb4f-5fa1fde2c18d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:35.926502 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0a4c0-a6c6-4332-bb4f-5fa1fde2c18d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:35.928420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0a4c0-a6c6-4332-bb4f-5fa1fde2c18d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:35.945764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 320/655] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:35.945764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0a4c0-a6c6-4332-bb4f-5fa1fde2c18d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:36.021844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:36.028159 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972602d-0e9b-4f2d-a884-c4bf054e92bd None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:36.044728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0a4c0-a6c6-4332-bb4f-5fa1fde2c18d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:36.062000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d407fcb-5b6d-4be3-80e5-10b551d915ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:36.062934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d407fcb-5b6d-4be3-80e5-10b551d915ca None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:36.063248 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d407fcb-5b6d-4be3-80e5-10b551d915ca None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:36.063529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d407fcb-5b6d-4be3-80e5-10b551d915ca None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/2130fd9eb8464e95a4fb24083c36427a/roles/be311caafffd48cfa80fbe10e110493c` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:36.074102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:36.081230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d407fcb-5b6d-4be3-80e5-10b551d915ca None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=2130fd9eb8464e95a4fb24083c36427a, role_id=be311caafffd48cfa80fbe10e110493c)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:36.082589 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869730fe-d746-4bda-8e33-54eb44a71ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:36.082991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d407fcb-5b6d-4be3-80e5-10b551d915ca None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:36.083388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869730fe-d746-4bda-8e33-54eb44a71ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:36.083670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869730fe-d746-4bda-8e33-54eb44a71ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:36.083944 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869730fe-d746-4bda-8e33-54eb44a71ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:36.094215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869730fe-d746-4bda-8e33-54eb44a71ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:36.096476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869730fe-d746-4bda-8e33-54eb44a71ff8 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-869730fe-d746-4bda-8e33-54eb44a71ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:36.118636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:36.119514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:36.120383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:36.120383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:36.120383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:36.120383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:36.120383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 321/656] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:36.123906 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869730fe-d746-4bda-8e33-54eb44a71ff8 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:36.150383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 336/657] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:28:35 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/2130fd9eb8464e95a4fb24083c36427a/roles/be311caafffd48cfa80fbe10e110493c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:36.151380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d407fcb-5b6d-4be3-80e5-10b551d915ca None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:36.255668 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869730fe-d746-4bda-8e33-54eb44a71ff8 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:36.279331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d407fcb-5b6d-4be3-80e5-10b551d915ca None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:36.293710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf79ea9-34d2-4ae8-be17-b119e2ae8799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:36.294429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf79ea9-34d2-4ae8-be17-b119e2ae8799 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:36.294714 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf79ea9-34d2-4ae8-be17-b119e2ae8799 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:36.294992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf79ea9-34d2-4ae8-be17-b119e2ae8799 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:36.295876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf79ea9-34d2-4ae8-be17-b119e2ae8799 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:36.296189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf79ea9-34d2-4ae8-be17-b119e2ae8799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:36.297695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf79ea9-34d2-4ae8-be17-b119e2ae8799 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:36.320980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 322/658] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jun 8 06:28:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:36.321205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712ba2a-2508-427a-a14c-2fd7561f788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:36.321669 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf79ea9-34d2-4ae8-be17-b119e2ae8799 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:36.321759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ba2a-2508-427a-a14c-2fd7561f788a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:36.321759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ba2a-2508-427a-a14c-2fd7561f788a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:36.321759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ba2a-2508-427a-a14c-2fd7561f788a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:36.330425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712ba2a-2508-427a-a14c-2fd7561f788a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:36.332010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712ba2a-2508-427a-a14c-2fd7561f788a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-9712ba2a-2508-427a-a14c-2fd7561f788a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:36.347297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:36.348453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:36.349502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:36.349502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:36.349502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:36.349502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:36.349502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:36.349502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:36.349502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:36.349502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:36.353289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 337/659] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:36.354711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dd54e-b768-485d-aa78-7e1d221d08fb None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:36.354963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dd54e-b768-485d-aa78-7e1d221d08fb None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:36.355946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dd54e-b768-485d-aa78-7e1d221d08fb None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:36.356712 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 338/660] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:36.357268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dd54e-b768-485d-aa78-7e1d221d08fb None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:36.371019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:36.377557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:36.441863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf79ea9-34d2-4ae8-be17-b119e2ae8799 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:36.471956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dd54e-b768-485d-aa78-7e1d221d08fb None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:36.480610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8edeec-42d7-453f-ace5-92cb4ff916b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:36.481412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8edeec-42d7-453f-ace5-92cb4ff916b6 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:36.481796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8edeec-42d7-453f-ace5-92cb4ff916b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:36.482170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8edeec-42d7-453f-ace5-92cb4ff916b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:36.483021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8edeec-42d7-453f-ace5-92cb4ff916b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:36.483414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8edeec-42d7-453f-ace5-92cb4ff916b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:36.484842 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8edeec-42d7-453f-ace5-92cb4ff916b6 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:36.497799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 323/661] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:36.498764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8edeec-42d7-453f-ace5-92cb4ff916b6 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:36.511348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6754206-d82a-490f-8f89-f710be0ba67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:36.512057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6754206-d82a-490f-8f89-f710be0ba67e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:36.512341 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6754206-d82a-490f-8f89-f710be0ba67e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:36.512615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6754206-d82a-490f-8f89-f710be0ba67e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:36.585250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6754206-d82a-490f-8f89-f710be0ba67e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:36.586731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6754206-d82a-490f-8f89-f710be0ba67e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:36.594407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:36.603482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:36.607299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8edeec-42d7-453f-ace5-92cb4ff916b6 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:36.640861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ce8c7-1603-4a0e-8863-6f6dbad783a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:36.642075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce8c7-1603-4a0e-8863-6f6dbad783a5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:36.642392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce8c7-1603-4a0e-8863-6f6dbad783a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:36.642671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce8c7-1603-4a0e-8863-6f6dbad783a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:36.643643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ce8c7-1603-4a0e-8863-6f6dbad783a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:36.643956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ce8c7-1603-4a0e-8863-6f6dbad783a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:36.645389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ce8c7-1603-4a0e-8863-6f6dbad783a5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:36.659298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 324/662] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:36.660495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284805c-9a98-418a-80e2-a62b0b75d476 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:36.660878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284805c-9a98-418a-80e2-a62b0b75d476 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:36.661294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284805c-9a98-418a-80e2-a62b0b75d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:36.683081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-7284805c-9a98-418a-80e2-a62b0b75d476 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:36.684250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7284805c-9a98-418a-80e2-a62b0b75d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:36.704407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 339/663] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:36.704407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6754206-d82a-490f-8f89-f710be0ba67e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:36.763799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 325/664] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:36.764773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284805c-9a98-418a-80e2-a62b0b75d476 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:36.818692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6754206-d82a-490f-8f89-f710be0ba67e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:36.826302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:36.855823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d8034-1d90-490b-9419-ae84c128e679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:36.856717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8034-1d90-490b-9419-ae84c128e679 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:36.857827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8034-1d90-490b-9419-ae84c128e679 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:36.858099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8034-1d90-490b-9419-ae84c128e679 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:36.861190 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:36.865525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d8034-1d90-490b-9419-ae84c128e679 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:36.866985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d8034-1d90-490b-9419-ae84c128e679 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:36.872968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284805c-9a98-418a-80e2-a62b0b75d476 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-7a8d8034-1d90-490b-9419-ae84c128e679 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:36.882079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:36.883160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 340/665] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:36.884162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d8034-1d90-490b-9419-ae84c128e679 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:36.914987 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7230a-a8e4-44cd-90f8-741537e7a34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:36.915648 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7230a-a8e4-44cd-90f8-741537e7a34c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:36.915981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7230a-a8e4-44cd-90f8-741537e7a34c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:36.916252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7230a-a8e4-44cd-90f8-741537e7a34c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:36.917017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7230a-a8e4-44cd-90f8-741537e7a34c None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=8c060a0a42824aa589135ea357165268) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:36.917327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7230a-a8e4-44cd-90f8-741537e7a34c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:36.918860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7230a-a8e4-44cd-90f8-741537e7a34c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:36.925533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 326/666] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:36 2022] GET /identity/v3/role_assignments?user.id=8c060a0a42824aa589135ea357165268&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:36.926228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7230a-a8e4-44cd-90f8-741537e7a34c None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:37.033974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d8034-1d90-490b-9419-ae84c128e679 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:37.045763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7230a-a8e4-44cd-90f8-741537e7a34c None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:37.077511 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbc09-cb41-4e50-b10c-b9eecac36749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:37.078109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbc09-cb41-4e50-b10c-b9eecac36749 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:37.078429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbc09-cb41-4e50-b10c-b9eecac36749 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:37.078752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbc09-cb41-4e50-b10c-b9eecac36749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:37.091330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acbc09-cb41-4e50-b10c-b9eecac36749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:37.092808 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acbc09-cb41-4e50-b10c-b9eecac36749 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:37.096993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17879a64-9afc-434e-8cd5-a06e1f57942d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:37.098093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17879a64-9afc-434e-8cd5-a06e1f57942d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:37.098600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17879a64-9afc-434e-8cd5-a06e1f57942d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:37.099067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17879a64-9afc-434e-8cd5-a06e1f57942d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-85acbc09-cb41-4e50-b10c-b9eecac36749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:37.111773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:37.112780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:37.113653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:37.113653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:37.113653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:37.113653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:37.113653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 341/667] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:37.114399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbc09-cb41-4e50-b10c-b9eecac36749 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:37.116015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17879a64-9afc-434e-8cd5-a06e1f57942d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-17879a64-9afc-434e-8cd5-a06e1f57942d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:37.126202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:37.127195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:37.128028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:37.130800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 327/668] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:37.132049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17879a64-9afc-434e-8cd5-a06e1f57942d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:37.137199 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:37.150156 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:37.239839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbc09-cb41-4e50-b10c-b9eecac36749 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:37.265643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17879a64-9afc-434e-8cd5-a06e1f57942d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:37.278964 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ae920-d6d8-4f0f-a4ab-0a67b01836e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:37.279646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ae920-d6d8-4f0f-a4ab-0a67b01836e4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:37.279932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ae920-d6d8-4f0f-a4ab-0a67b01836e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:37.280207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ae920-d6d8-4f0f-a4ab-0a67b01836e4 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:37.281046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ae920-d6d8-4f0f-a4ab-0a67b01836e4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:37.281355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ae920-d6d8-4f0f-a4ab-0a67b01836e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:37.283410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ae920-d6d8-4f0f-a4ab-0a67b01836e4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:37.308527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 342/669] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Jun 8 06:28:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:37.309361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ae920-d6d8-4f0f-a4ab-0a67b01836e4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:37.310963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619b107-00f8-4c8d-b15d-9a96c84b6433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:37.311624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b107-00f8-4c8d-b15d-9a96c84b6433 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:37.311904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b107-00f8-4c8d-b15d-9a96c84b6433 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:37.312171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b107-00f8-4c8d-b15d-9a96c84b6433 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:37.313451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619b107-00f8-4c8d-b15d-9a96c84b6433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:37.313755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619b107-00f8-4c8d-b15d-9a96c84b6433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:37.315698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619b107-00f8-4c8d-b15d-9a96c84b6433 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:37.333176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 328/670] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:37.334328 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619b107-00f8-4c8d-b15d-9a96c84b6433 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:37.402413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:37.426563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ae920-d6d8-4f0f-a4ab-0a67b01836e4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:37.428093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:37.464188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0945d1-82da-4a98-a65e-1474b522d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:37.464858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0945d1-82da-4a98-a65e-1474b522d03a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:37.465170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0945d1-82da-4a98-a65e-1474b522d03a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:37.465445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0945d1-82da-4a98-a65e-1474b522d03a None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:37.466191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0945d1-82da-4a98-a65e-1474b522d03a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:37.466538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0945d1-82da-4a98-a65e-1474b522d03a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:37.466945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619b107-00f8-4c8d-b15d-9a96c84b6433 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:37.467902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0945d1-82da-4a98-a65e-1474b522d03a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:37.478177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 343/671] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:37.479184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0945d1-82da-4a98-a65e-1474b522d03a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:37.509683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99de1a3-7f54-4051-9c25-b808238efb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:37.510722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de1a3-7f54-4051-9c25-b808238efb61 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:37.511446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de1a3-7f54-4051-9c25-b808238efb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:37.512129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de1a3-7f54-4051-9c25-b808238efb61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:37.599538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0945d1-82da-4a98-a65e-1474b522d03a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:37.602183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99de1a3-7f54-4051-9c25-b808238efb61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:37.604616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99de1a3-7f54-4051-9c25-b808238efb61 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:37.640929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4caa52-625b-465c-977b-87a575665c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:37.642517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4caa52-625b-465c-977b-87a575665c83 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:37.642800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4caa52-625b-465c-977b-87a575665c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:37.643474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4caa52-625b-465c-977b-87a575665c83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:37.651883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4caa52-625b-465c-977b-87a575665c83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:37.653830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4caa52-625b-465c-977b-87a575665c83 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:37.656175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-6d4caa52-625b-465c-977b-87a575665c83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:37.674335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:37.675451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:37.676505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:37.676505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:37.676505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:37.676505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:37.676505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:37.676505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:37.676505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:37.676505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:37.678156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 344/672] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:37.679574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4caa52-625b-465c-977b-87a575665c83 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:37.695333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:37.728601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 329/673] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:37.729690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99de1a3-7f54-4051-9c25-b808238efb61 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:37.793571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4caa52-625b-465c-977b-87a575665c83 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:37.828386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079a0f8-e0b9-4f3f-bd40-3cf0187857a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:37.829742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a0f8-e0b9-4f3f-bd40-3cf0187857a9 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:37.830032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a0f8-e0b9-4f3f-bd40-3cf0187857a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:37.830333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a0f8-e0b9-4f3f-bd40-3cf0187857a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:37.834917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99de1a3-7f54-4051-9c25-b808238efb61 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:37.840804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079a0f8-e0b9-4f3f-bd40-3cf0187857a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:37.842269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079a0f8-e0b9-4f3f-bd40-3cf0187857a9 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-e079a0f8-e0b9-4f3f-bd40-3cf0187857a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:37.861434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:37.862494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:37.863363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:37.863363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:37.863363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:37.863363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:37.867992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 345/674] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:37.868915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079a0f8-e0b9-4f3f-bd40-3cf0187857a9 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:37.874575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e4833-fc65-4ff6-b3f1-570c3806af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:37.875542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e4833-fc65-4ff6-b3f1-570c3806af38 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:37.875999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e4833-fc65-4ff6-b3f1-570c3806af38 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:37.876443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e4833-fc65-4ff6-b3f1-570c3806af38 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:37.877404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e4833-fc65-4ff6-b3f1-570c3806af38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:37.877883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e4833-fc65-4ff6-b3f1-570c3806af38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:37.879519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e4833-fc65-4ff6-b3f1-570c3806af38 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:37.892827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 330/675] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:37.893922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e4833-fc65-4ff6-b3f1-570c3806af38 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:37.926264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:37.962689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:37.980076 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079a0f8-e0b9-4f3f-bd40-3cf0187857a9 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:38.000187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e4833-fc65-4ff6-b3f1-570c3806af38 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:38.015465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31bfe8-9367-42fb-bd65-27ca69f29679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:38.017172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31bfe8-9367-42fb-bd65-27ca69f29679 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.017457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31bfe8-9367-42fb-bd65-27ca69f29679 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.017729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31bfe8-9367-42fb-bd65-27ca69f29679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:38.030500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31bfe8-9367-42fb-bd65-27ca69f29679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:38.032253 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31bfe8-9367-42fb-bd65-27ca69f29679 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:38.038084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddda04-aa9a-4e6c-ad55-02f484ede825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:38.039074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddda04-aa9a-4e6c-ad55-02f484ede825 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.039551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddda04-aa9a-4e6c-ad55-02f484ede825 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.040044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddda04-aa9a-4e6c-ad55-02f484ede825 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:38.040968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddda04-aa9a-4e6c-ad55-02f484ede825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:38.041466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddda04-aa9a-4e6c-ad55-02f484ede825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:38.043042 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddda04-aa9a-4e6c-ad55-02f484ede825 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-7b31bfe8-9367-42fb-bd65-27ca69f29679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:38.052104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:38.052966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:38.053875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:38.053875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:38.053875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:38.053875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:38.058455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 346/676] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:38.059658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31bfe8-9367-42fb-bd65-27ca69f29679 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:38.061935 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 331/677] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:38.063588 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddda04-aa9a-4e6c-ad55-02f484ede825 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:38.172004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:38.182004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddda04-aa9a-4e6c-ad55-02f484ede825 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:38.213857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31bfe8-9367-42fb-bd65-27ca69f29679 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:38.216395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:38.219308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88194ea4-d07c-4a59-8de5-aa9a078f2c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:38.220071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88194ea4-d07c-4a59-8de5-aa9a078f2c9d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.220417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88194ea4-d07c-4a59-8de5-aa9a078f2c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.220756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88194ea4-d07c-4a59-8de5-aa9a078f2c9d None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:38.221543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88194ea4-d07c-4a59-8de5-aa9a078f2c9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:38.221910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88194ea4-d07c-4a59-8de5-aa9a078f2c9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:38.223390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88194ea4-d07c-4a59-8de5-aa9a078f2c9d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:38.241079 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 332/678] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:38.242491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88194ea4-d07c-4a59-8de5-aa9a078f2c9d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:38.259157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23457da-c154-4eb4-b0c0-57b978a8d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:38.259975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23457da-c154-4eb4-b0c0-57b978a8d309 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.260353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23457da-c154-4eb4-b0c0-57b978a8d309 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.260648 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23457da-c154-4eb4-b0c0-57b978a8d309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:38.261546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23457da-c154-4eb4-b0c0-57b978a8d309 None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=5498a6912a08408d9ea30920faceee7a) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:38.261923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23457da-c154-4eb4-b0c0-57b978a8d309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:38.263663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23457da-c154-4eb4-b0c0-57b978a8d309 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:38.278278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 347/679] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:38 2022] GET /identity/v3/role_assignments?user.id=5498a6912a08408d9ea30920faceee7a&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:38.278278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23457da-c154-4eb4-b0c0-57b978a8d309 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:38.437265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88194ea4-d07c-4a59-8de5-aa9a078f2c9d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:38.468739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23457da-c154-4eb4-b0c0-57b978a8d309 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:38.488788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89bc54-c9c3-47b8-93cb-a0d264588a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:38.489639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89bc54-c9c3-47b8-93cb-a0d264588a2c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.489926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89bc54-c9c3-47b8-93cb-a0d264588a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.490200 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89bc54-c9c3-47b8-93cb-a0d264588a2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:38.498647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89bc54-c9c3-47b8-93cb-a0d264588a2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:38.500815 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89bc54-c9c3-47b8-93cb-a0d264588a2c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:38.507311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b5c27-7cb3-4fd3-ab86-ae9ba737027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:38.508187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b5c27-7cb3-4fd3-ab86-ae9ba737027c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.508467 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b5c27-7cb3-4fd3-ab86-ae9ba737027c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.508740 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b5c27-7cb3-4fd3-ab86-ae9ba737027c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-6b89bc54-c9c3-47b8-93cb-a0d264588a2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:38.515172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:38.517154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:38.518110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:38.518110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:38.518110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:38.518110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:38.518110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:38.518110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:38.518110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:38.518110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:38.518110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:38.518110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:38.518713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b5c27-7cb3-4fd3-ab86-ae9ba737027c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:38.518852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 333/680] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jun 8 06:28:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:38.518852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97369f5d-095f-4949-9fa4-7a6ea2b59ef7 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.518987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b5c27-7cb3-4fd3-ab86-ae9ba737027c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:38.519055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97369f5d-095f-4949-9fa4-7a6ea2b59ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.519552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97369f5d-095f-4949-9fa4-7a6ea2b59ef7 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:38.520796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 334/681] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:38.523206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97369f5d-095f-4949-9fa4-7a6ea2b59ef7 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-b39b5c27-7cb3-4fd3-ab86-ae9ba737027c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:38.535258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:38.543152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:38.544033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:38.544033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:38.544033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:38.544033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:38.544033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:38.544033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:38.544033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:38.544033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:38.544033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 348/682] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:38.544033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db974c2c-3a74-4626-b106-d06e916c3b48 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.544033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db974c2c-3a74-4626-b106-d06e916c3b48 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.544636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db974c2c-3a74-4626-b106-d06e916c3b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:38.545892 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:38.564513 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-db974c2c-3a74-4626-b106-d06e916c3b48 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:38.565707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-db974c2c-3a74-4626-b106-d06e916c3b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:38.591203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:38.647185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 349/683] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:38.648097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db974c2c-3a74-4626-b106-d06e916c3b48 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:38.656795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97369f5d-095f-4949-9fa4-7a6ea2b59ef7 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:38.698848 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a2fa-0727-49b8-9376-e8bc24c9a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:38.699796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a2fa-0727-49b8-9376-e8bc24c9a5ff None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.700079 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a2fa-0727-49b8-9376-e8bc24c9a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.700351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a2fa-0727-49b8-9376-e8bc24c9a5ff None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:38.701198 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2a2fa-0727-49b8-9376-e8bc24c9a5ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:38.701507 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2a2fa-0727-49b8-9376-e8bc24c9a5ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:38.702958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2a2fa-0727-49b8-9376-e8bc24c9a5ff None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:38.722159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 335/684] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jun 8 06:28:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:38.723069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a2fa-0727-49b8-9376-e8bc24c9a5ff None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:38.767867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db974c2c-3a74-4626-b106-d06e916c3b48 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:38.798730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:38.803790 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a37c95-4768-44b9-91cd-9979fbb1e285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:38.804532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a37c95-4768-44b9-91cd-9979fbb1e285 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.804884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a37c95-4768-44b9-91cd-9979fbb1e285 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.805282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a37c95-4768-44b9-91cd-9979fbb1e285 None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:38.806150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a37c95-4768-44b9-91cd-9979fbb1e285 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:38.806553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a37c95-4768-44b9-91cd-9979fbb1e285 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:38.808063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a37c95-4768-44b9-91cd-9979fbb1e285 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:38.825325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 350/685] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:38.826354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a37c95-4768-44b9-91cd-9979fbb1e285 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:38.831044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a2fa-0727-49b8-9376-e8bc24c9a5ff None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:38.845816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:38.879402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd7e5-3707-47b9-858e-821725ee2571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:38.880654 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd7e5-3707-47b9-858e-821725ee2571 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.881090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd7e5-3707-47b9-858e-821725ee2571 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.881788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd7e5-3707-47b9-858e-821725ee2571 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:38.895482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dd7e5-3707-47b9-858e-821725ee2571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-714dd7e5-3707-47b9-858e-821725ee2571 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:38.906187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:38.907927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:38.908983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:38.911869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 336/686] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:38.912826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd7e5-3707-47b9-858e-821725ee2571 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:38.946621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a37c95-4768-44b9-91cd-9979fbb1e285 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:38.995267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289be775-987d-4235-b66a-8e7330919f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:38.996181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289be775-987d-4235-b66a-8e7330919f3f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:38.996613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289be775-987d-4235-b66a-8e7330919f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:38.997044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289be775-987d-4235-b66a-8e7330919f3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:39.039621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd7e5-3707-47b9-858e-821725ee2571 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:39.077341 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289be775-987d-4235-b66a-8e7330919f3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:39.079734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289be775-987d-4235-b66a-8e7330919f3f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:39.082501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:39.089171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcbc3f-9e73-4137-b1b5-1090640b276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:39.089914 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcbc3f-9e73-4137-b1b5-1090640b276d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:39.090283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcbc3f-9e73-4137-b1b5-1090640b276d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:39.090634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcbc3f-9e73-4137-b1b5-1090640b276d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:39.091591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcbc3f-9e73-4137-b1b5-1090640b276d None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=11838a2908884cc79df912b3b2199564) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:39.091992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcbc3f-9e73-4137-b1b5-1090640b276d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:39.093728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcbc3f-9e73-4137-b1b5-1090640b276d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:39.100345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 337/687] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:38 2022] GET /identity/v3/role_assignments?user.id=11838a2908884cc79df912b3b2199564&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:39.107286 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:39.107420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcbc3f-9e73-4137-b1b5-1090640b276d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:39.214053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 351/688] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:39.220621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289be775-987d-4235-b66a-8e7330919f3f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:39.309118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcbc3f-9e73-4137-b1b5-1090640b276d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:39.379045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3606f28-44c0-4157-a4f0-673bfd541646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:39.380159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3606f28-44c0-4157-a4f0-673bfd541646 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:39.380686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3606f28-44c0-4157-a4f0-673bfd541646 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:39.381198 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3606f28-44c0-4157-a4f0-673bfd541646 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:39.382161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3606f28-44c0-4157-a4f0-673bfd541646 None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:39.385530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3606f28-44c0-4157-a4f0-673bfd541646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:39.388686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3606f28-44c0-4157-a4f0-673bfd541646 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:39.396154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 338/689] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:39.397667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6bf6-e3cc-4a7e-8fbf-e69a35c94534 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:39.398158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6bf6-e3cc-4a7e-8fbf-e69a35c94534 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:39.398821 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6bf6-e3cc-4a7e-8fbf-e69a35c94534 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:39.399287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289be775-987d-4235-b66a-8e7330919f3f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:39.401026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 339/690] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:39.402034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c6bf6-e3cc-4a7e-8fbf-e69a35c94534 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:39.419989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:39.441815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72304a38-e9a3-4b9a-abf1-15c1c96a14ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:39.442963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304a38-e9a3-4b9a-abf1-15c1c96a14ce None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:39.442963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304a38-e9a3-4b9a-abf1-15c1c96a14ce None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:39.443216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304a38-e9a3-4b9a-abf1-15c1c96a14ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:39.456999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72304a38-e9a3-4b9a-abf1-15c1c96a14ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:39.458448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72304a38-e9a3-4b9a-abf1-15c1c96a14ce None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:39.468643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-72304a38-e9a3-4b9a-abf1-15c1c96a14ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:39.479170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:39.489422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:39.490501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:39.490501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:39.490501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:39.490501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:39.490501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 352/691] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:39.490501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea1120-6fb3-4f28-b821-fd868b633fe4 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:39.490501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea1120-6fb3-4f28-b821-fd868b633fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:39.490501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea1120-6fb3-4f28-b821-fd868b633fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:39.505011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a9ea1120-6fb3-4f28-b821-fd868b633fe4 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:39.506340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a9ea1120-6fb3-4f28-b821-fd868b633fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:39.523190 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c6bf6-e3cc-4a7e-8fbf-e69a35c94534 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:39.564018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a72abd-c82c-40df-ae7c-45adb41c5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:39.565148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a72abd-c82c-40df-ae7c-45adb41c5ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:39.565574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a72abd-c82c-40df-ae7c-45adb41c5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:39.566012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a72abd-c82c-40df-ae7c-45adb41c5ec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:39.578623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a72abd-c82c-40df-ae7c-45adb41c5ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:39.581083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a72abd-c82c-40df-ae7c-45adb41c5ec1 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:39.590263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 353/692] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:39.590263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea1120-6fb3-4f28-b821-fd868b633fe4 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-51a72abd-c82c-40df-ae7c-45adb41c5ec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:39.612940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:39.613953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:39.614866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:39.614866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:39.614866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:39.614866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:39.622710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 340/693] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:39.628860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a72abd-c82c-40df-ae7c-45adb41c5ec1 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:39.682639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:39.687130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea1120-6fb3-4f28-b821-fd868b633fe4 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:39.725186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd874e7-1ea5-4d1c-bc0d-a9867407d7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:39.725856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd874e7-1ea5-4d1c-bc0d-a9867407d7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:39.726140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd874e7-1ea5-4d1c-bc0d-a9867407d7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:39.726458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd874e7-1ea5-4d1c-bc0d-a9867407d7a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:39.727633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd874e7-1ea5-4d1c-bc0d-a9867407d7a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:39.727633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd874e7-1ea5-4d1c-bc0d-a9867407d7a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:39.728957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd874e7-1ea5-4d1c-bc0d-a9867407d7a4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:39.740287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a72abd-c82c-40df-ae7c-45adb41c5ec1 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:39.745459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 354/694] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:39.745459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd874e7-1ea5-4d1c-bc0d-a9867407d7a4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:39.755938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:39.784844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd08b-78a7-4a13-aa0d-216f005a1f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:39.785537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd08b-78a7-4a13-aa0d-216f005a1f3e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:39.785822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd08b-78a7-4a13-aa0d-216f005a1f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:39.786096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd08b-78a7-4a13-aa0d-216f005a1f3e None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:39.786841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dd08b-78a7-4a13-aa0d-216f005a1f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:39.787147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dd08b-78a7-4a13-aa0d-216f005a1f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:39.788502 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dd08b-78a7-4a13-aa0d-216f005a1f3e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:39.808848 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 341/695] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:39.810013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd08b-78a7-4a13-aa0d-216f005a1f3e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:39.871213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd874e7-1ea5-4d1c-bc0d-a9867407d7a4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:39.911598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa608ee0-53bf-4a64-a4b5-a5d71f8969bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:39.913171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa608ee0-53bf-4a64-a4b5-a5d71f8969bd None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:39.913672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa608ee0-53bf-4a64-a4b5-a5d71f8969bd None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:39.914599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa608ee0-53bf-4a64-a4b5-a5d71f8969bd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:39.915724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa608ee0-53bf-4a64-a4b5-a5d71f8969bd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:39.917558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa608ee0-53bf-4a64-a4b5-a5d71f8969bd None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:39.936887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd08b-78a7-4a13-aa0d-216f005a1f3e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-aa608ee0-53bf-4a64-a4b5-a5d71f8969bd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:39.937237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:39.938812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 06:28:39.939645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:39.940418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 355/696] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Jun 8 06:28:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:39.941160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa608ee0-53bf-4a64-a4b5-a5d71f8969bd None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:39.973935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:39.979797 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c0a3-80c9-484d-9d71-196b286194eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:39.980593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c0a3-80c9-484d-9d71-196b286194eb None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:39.986134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c0a3-80c9-484d-9d71-196b286194eb None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:39.986134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c0a3-80c9-484d-9d71-196b286194eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:39.990450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6c0a3-80c9-484d-9d71-196b286194eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:39.991889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6c0a3-80c9-484d-9d71-196b286194eb None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-27b6c0a3-80c9-484d-9d71-196b286194eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:40.006787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:40.007729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:40.008601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:40.008601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:40.008601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:40.008601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:40.008601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:40.008601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:40.008601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:40.008601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:40.012860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 342/697] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:40.013729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c0a3-80c9-484d-9d71-196b286194eb None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:40.044185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:40.079193 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa608ee0-53bf-4a64-a4b5-a5d71f8969bd None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:40.122652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c0a3-80c9-484d-9d71-196b286194eb None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:40.124443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab2fae-863c-4b85-8d3b-2524d4f7bdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:40.125303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2fae-863c-4b85-8d3b-2524d4f7bdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:40.126208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2fae-863c-4b85-8d3b-2524d4f7bdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:40.126589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2fae-863c-4b85-8d3b-2524d4f7bdb3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:40.135438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab2fae-863c-4b85-8d3b-2524d4f7bdb3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:40.136827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab2fae-863c-4b85-8d3b-2524d4f7bdb3 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-2cab2fae-863c-4b85-8d3b-2524d4f7bdb3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:40.154431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:40.155375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:40.156337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:40.156337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:40.156337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:40.156337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:40.156337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:40.156337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:40.156337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:40.156337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:40.156337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:40.156337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:40.160486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 356/698] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:40.161405 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab2fae-863c-4b85-8d3b-2524d4f7bdb3 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:40.167570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6cf37-571c-47a7-b90b-ad923fa8d5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:40.168469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6cf37-571c-47a7-b90b-ad923fa8d5de None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:40.168921 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6cf37-571c-47a7-b90b-ad923fa8d5de None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:40.169366 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6cf37-571c-47a7-b90b-ad923fa8d5de None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:40.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6cf37-571c-47a7-b90b-ad923fa8d5de None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:40.170739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6cf37-571c-47a7-b90b-ad923fa8d5de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:40.173301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6cf37-571c-47a7-b90b-ad923fa8d5de None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:40.180310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 343/699] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jun 8 06:28:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:40.181282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6cf37-571c-47a7-b90b-ad923fa8d5de None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:40.271851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:40.288663 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:40.290656 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab2fae-863c-4b85-8d3b-2524d4f7bdb3 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:40.300423 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6cf37-571c-47a7-b90b-ad923fa8d5de None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:40.330273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4c58f-b4d2-47f1-8686-ebaa2dcb4842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:40.331390 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4c58f-b4d2-47f1-8686-ebaa2dcb4842 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:40.332155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4c58f-b4d2-47f1-8686-ebaa2dcb4842 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:40.332606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4c58f-b4d2-47f1-8686-ebaa2dcb4842 None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:40.333839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4c58f-b4d2-47f1-8686-ebaa2dcb4842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:40.334515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4c58f-b4d2-47f1-8686-ebaa2dcb4842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:40.337736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4c58f-b4d2-47f1-8686-ebaa2dcb4842 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:40.340883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a7727-bee7-4cbb-bbfd-c5228b416356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:40.341626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a7727-bee7-4cbb-bbfd-c5228b416356 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:40.341981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a7727-bee7-4cbb-bbfd-c5228b416356 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:40.342368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a7727-bee7-4cbb-bbfd-c5228b416356 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:40.343298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a7727-bee7-4cbb-bbfd-c5228b416356 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:40.343687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a7727-bee7-4cbb-bbfd-c5228b416356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:40.345717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a7727-bee7-4cbb-bbfd-c5228b416356 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:40.355269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 357/700] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:40.356334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4c58f-b4d2-47f1-8686-ebaa2dcb4842 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:40.374523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 344/701] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jun 8 06:28:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:40.375485 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a7727-bee7-4cbb-bbfd-c5228b416356 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:40.481538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4c58f-b4d2-47f1-8686-ebaa2dcb4842 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:40.506077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a7727-bee7-4cbb-bbfd-c5228b416356 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:40.522727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d3fcd-0cba-4e14-be00-261b3ccb9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:40.523301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d3fcd-0cba-4e14-be00-261b3ccb9a07 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:40.523583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d3fcd-0cba-4e14-be00-261b3ccb9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:40.523858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d3fcd-0cba-4e14-be00-261b3ccb9a07 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:40.524571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d3fcd-0cba-4e14-be00-261b3ccb9a07 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:40.524876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d3fcd-0cba-4e14-be00-261b3ccb9a07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:40.526255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d3fcd-0cba-4e14-be00-261b3ccb9a07 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:40.533026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 358/702] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jun 8 06:28:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:40.533893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d3fcd-0cba-4e14-be00-261b3ccb9a07 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:40.543754 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:40.557477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f59eb-a815-4a5c-9af9-1524be477616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:40.559186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f59eb-a815-4a5c-9af9-1524be477616 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:40.559484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f59eb-a815-4a5c-9af9-1524be477616 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:40.559766 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f59eb-a815-4a5c-9af9-1524be477616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:40.560620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f59eb-a815-4a5c-9af9-1524be477616 None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=b8661ef27af34bbea11e215831d50843) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:40.560936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f59eb-a815-4a5c-9af9-1524be477616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:40.562438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f59eb-a815-4a5c-9af9-1524be477616 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:40.569202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 345/703] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:40 2022] GET /identity/v3/role_assignments?user.id=b8661ef27af34bbea11e215831d50843&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:40.655071 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d3fcd-0cba-4e14-be00-261b3ccb9a07 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:40.696186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3272d7-3ff2-4310-a70d-907f00372fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:40.697176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3272d7-3ff2-4310-a70d-907f00372fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:40.697658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3272d7-3ff2-4310-a70d-907f00372fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:40.698101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3272d7-3ff2-4310-a70d-907f00372fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:40.813455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3272d7-3ff2-4310-a70d-907f00372fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:40.815306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3272d7-3ff2-4310-a70d-907f00372fb8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:40.825376 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:40.827384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c928c-0bf1-44ae-8bf6-f67cd7807a65 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:40.827680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c928c-0bf1-44ae-8bf6-f67cd7807a65 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:40.827963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c928c-0bf1-44ae-8bf6-f67cd7807a65 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:40.830079 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 346/704] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:40.835396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927d2dd-5dbb-4802-8838-9784634d64ad None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:40.835752 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927d2dd-5dbb-4802-8838-9784634d64ad None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:40.836034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927d2dd-5dbb-4802-8838-9784634d64ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:40.867617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-2927d2dd-5dbb-4802-8838-9784634d64ad None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:40.868834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2927d2dd-5dbb-4802-8838-9784634d64ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:40.880183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:40.941499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 359/705] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 06:28:40.942635 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3272d7-3ff2-4310-a70d-907f00372fb8 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:40.956447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 347/706] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:40.999224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927d2dd-5dbb-4802-8838-9784634d64ad None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:41.070518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3272d7-3ff2-4310-a70d-907f00372fb8 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:41.086264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:41.126067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9908b16-ffb8-4ac1-a8dd-015ad7c73e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:41.128006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9908b16-ffb8-4ac1-a8dd-015ad7c73e60 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:41.128303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9908b16-ffb8-4ac1-a8dd-015ad7c73e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:41.128576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9908b16-ffb8-4ac1-a8dd-015ad7c73e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:41.140118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9908b16-ffb8-4ac1-a8dd-015ad7c73e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:41.142210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9908b16-ffb8-4ac1-a8dd-015ad7c73e60 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:41.152457 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927d2dd-5dbb-4802-8838-9784634d64ad None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-c9908b16-ffb8-4ac1-a8dd-015ad7c73e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:41.162274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:41.163174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:41.164358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:41.164358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:41.164358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:41.164358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:41.164358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 360/707] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:41.175170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9908b16-ffb8-4ac1-a8dd-015ad7c73e60 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:41.202473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39dd3-a1cb-4996-a136-53fbdecbf439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:41.203203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39dd3-a1cb-4996-a136-53fbdecbf439 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:41.204145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39dd3-a1cb-4996-a136-53fbdecbf439 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:41.204430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39dd3-a1cb-4996-a136-53fbdecbf439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:41.224132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf39dd3-a1cb-4996-a136-53fbdecbf439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:41.225590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf39dd3-a1cb-4996-a136-53fbdecbf439 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:41.231593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3bf39dd3-a1cb-4996-a136-53fbdecbf439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:41.253573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:41.254560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:41.255447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:41.255447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:41.255447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:41.255447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:41.267155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 348/708] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:41.272391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39dd3-a1cb-4996-a136-53fbdecbf439 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:41.342222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9908b16-ffb8-4ac1-a8dd-015ad7c73e60 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:41.390228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b913-2e4c-449a-99f3-6804799da004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:41.391559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b913-2e4c-449a-99f3-6804799da004 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:41.391994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b913-2e4c-449a-99f3-6804799da004 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:41.392365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b913-2e4c-449a-99f3-6804799da004 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:41.393142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935b913-2e4c-449a-99f3-6804799da004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:41.393552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935b913-2e4c-449a-99f3-6804799da004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:41.395371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935b913-2e4c-449a-99f3-6804799da004 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:41.411776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 361/709] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:41.413243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b913-2e4c-449a-99f3-6804799da004 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:41.432063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39dd3-a1cb-4996-a136-53fbdecbf439 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:41.438828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:41.530039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b913-2e4c-449a-99f3-6804799da004 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:41.566552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fe758-1853-4408-949a-2f447ffeaaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:41.567602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fe758-1853-4408-949a-2f447ffeaaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:41.567982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fe758-1853-4408-949a-2f447ffeaaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:41.568355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fe758-1853-4408-949a-2f447ffeaaf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:41.576224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fe758-1853-4408-949a-2f447ffeaaf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:41.577802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fe758-1853-4408-949a-2f447ffeaaf7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:41.579142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fedf3-6706-4e4c-a5b7-df1965f74860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:41.579811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fedf3-6706-4e4c-a5b7-df1965f74860 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:41.590216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fedf3-6706-4e4c-a5b7-df1965f74860 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:41.590216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fedf3-6706-4e4c-a5b7-df1965f74860 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:41.590216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fedf3-6706-4e4c-a5b7-df1965f74860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:41.590216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fedf3-6706-4e4c-a5b7-df1965f74860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:41.590216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fedf3-6706-4e4c-a5b7-df1965f74860 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-dc0fe758-1853-4408-949a-2f447ffeaaf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:41.605785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:41.606779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:41.607686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:41.607686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:41.607686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:41.607686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:41.607686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:41.607686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:41.607686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:41.607686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:41.614805 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 349/711] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:41.614968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 362/711] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:41.616148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fedf3-6706-4e4c-a5b7-df1965f74860 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:41.620969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fe758-1853-4408-949a-2f447ffeaaf7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:41.704294 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:41.727069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fe758-1853-4408-949a-2f447ffeaaf7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:41.753850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:41.765968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0538bc6-d49e-463e-8626-a5f910979a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:41.766811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0538bc6-d49e-463e-8626-a5f910979a62 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:41.767591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0538bc6-d49e-463e-8626-a5f910979a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:41.767931 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0538bc6-d49e-463e-8626-a5f910979a62 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:41.768713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0538bc6-d49e-463e-8626-a5f910979a62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:41.770222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0538bc6-d49e-463e-8626-a5f910979a62 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:41.826998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fedf3-6706-4e4c-a5b7-df1965f74860 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:41.858403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 363/712] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:28:41 2022] POST /identity/v3/users => generated 254 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:28:41.860833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddad1a4-bdde-4528-a76c-660c8190f77e None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:41.861035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddad1a4-bdde-4528-a76c-660c8190f77e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:41.861311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddad1a4-bdde-4528-a76c-660c8190f77e None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:41.871873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 364/713] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:41 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:41.873671 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6bbe6-f2f5-4c2d-8694-e0ae962f2014 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:41.875153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6bbe6-f2f5-4c2d-8694-e0ae962f2014 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:41.876231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6bbe6-f2f5-4c2d-8694-e0ae962f2014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:41.877075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d510e6-6588-4e9a-b2ff-a36d38ce396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:41.878842 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d510e6-6588-4e9a-b2ff-a36d38ce396b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:41.880167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d510e6-6588-4e9a-b2ff-a36d38ce396b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:41.881042 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d510e6-6588-4e9a-b2ff-a36d38ce396b None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:41.882081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d510e6-6588-4e9a-b2ff-a36d38ce396b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:41.883193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d510e6-6588-4e9a-b2ff-a36d38ce396b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:41.886028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d510e6-6588-4e9a-b2ff-a36d38ce396b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:41.917250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 350/714] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:41.918844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-38a6bbe6-f2f5-4c2d-8694-e0ae962f2014 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:41.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-38a6bbe6-f2f5-4c2d-8694-e0ae962f2014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:41.923742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d510e6-6588-4e9a-b2ff-a36d38ce396b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:42.050779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 365/715] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:42.084399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6bbe6-f2f5-4c2d-8694-e0ae962f2014 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:42.140478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d510e6-6588-4e9a-b2ff-a36d38ce396b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:42.162167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:42.168458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:42.200637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cde28f-09ec-4a33-a858-184264596f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:42.201276 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cde28f-09ec-4a33-a858-184264596f95 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:42.201381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6bbe6-f2f5-4c2d-8694-e0ae962f2014 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:42.201557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cde28f-09ec-4a33-a858-184264596f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:42.201833 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cde28f-09ec-4a33-a858-184264596f95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:42.202715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cde28f-09ec-4a33-a858-184264596f95 None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=2130fd9eb8464e95a4fb24083c36427a) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:42.203032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cde28f-09ec-4a33-a858-184264596f95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:42.204510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cde28f-09ec-4a33-a858-184264596f95 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:42.216467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 351/716] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:41 2022] GET /identity/v3/role_assignments?user.id=2130fd9eb8464e95a4fb24083c36427a&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:42.248114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3357a3d-bc21-451d-8fae-9fa3d9eeab61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:42.249004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3357a3d-bc21-451d-8fae-9fa3d9eeab61 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:42.249288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3357a3d-bc21-451d-8fae-9fa3d9eeab61 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:42.249561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3357a3d-bc21-451d-8fae-9fa3d9eeab61 None admin] PATH_INFO: `/v3/services/network` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:42.250222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3357a3d-bc21-451d-8fae-9fa3d9eeab61 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:42.252207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3357a3d-bc21-451d-8fae-9fa3d9eeab61 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-d3357a3d-bc21-451d-8fae-9fa3d9eeab61 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:42.271174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:42.272211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:42.273501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 366/717] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:42 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:42.279969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cde28f-09ec-4a33-a858-184264596f95 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:42.435763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cde28f-09ec-4a33-a858-184264596f95 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:42.483717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365456cc-1f19-44de-a22f-c23fee8af2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:42.484392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365456cc-1f19-44de-a22f-c23fee8af2de None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:42.485204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365456cc-1f19-44de-a22f-c23fee8af2de None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:42.485488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365456cc-1f19-44de-a22f-c23fee8af2de None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:42.486225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365456cc-1f19-44de-a22f-c23fee8af2de None admin] RBAC: Adding query filter params (name=network) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:42.486548 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365456cc-1f19-44de-a22f-c23fee8af2de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:42.487928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365456cc-1f19-44de-a22f-c23fee8af2de None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:42.492999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 352/718] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:28:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:42.498289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3357a3d-bc21-451d-8fae-9fa3d9eeab61 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:42.612894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3357a3d-bc21-451d-8fae-9fa3d9eeab61 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:42.639364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:42.647344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0e16f-806d-4239-96e8-8549861b2b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:42.648083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0e16f-806d-4239-96e8-8549861b2b32 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:42.648379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0e16f-806d-4239-96e8-8549861b2b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:42.648661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0e16f-806d-4239-96e8-8549861b2b32 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:42.649383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0e16f-806d-4239-96e8-8549861b2b32 None admin] RBAC: Adding query filter params (type=network) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:42.649688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0e16f-806d-4239-96e8-8549861b2b32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:42.651163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0e16f-806d-4239-96e8-8549861b2b32 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:42.656289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 367/719] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:28:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:43.304214 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9eab-81c5-4251-91e0-4e4f9e2bd3ea None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:43.304768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9eab-81c5-4251-91e0-4e4f9e2bd3ea None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:43.304845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9eab-81c5-4251-91e0-4e4f9e2bd3ea None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:43.306462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 353/720] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:43.311711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a884b81-7d2a-4cfb-8834-100ddf33fd2a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:43.311996 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a884b81-7d2a-4cfb-8834-100ddf33fd2a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:43.312274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a884b81-7d2a-4cfb-8834-100ddf33fd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:43.315192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06238f-7898-4249-8648-30db8f67e86f None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:43.315484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06238f-7898-4249-8648-30db8f67e86f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:43.315764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06238f-7898-4249-8648-30db8f67e86f None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:43.317600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 354/721] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:28:43.323705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243384b9-e9db-46bc-98b9-2bd9989189f5 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:43.323992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243384b9-e9db-46bc-98b9-2bd9989189f5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:43.324523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243384b9-e9db-46bc-98b9-2bd9989189f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:43.338382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-8a884b81-7d2a-4cfb-8834-100ddf33fd2a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:43.339559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8a884b81-7d2a-4cfb-8834-100ddf33fd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:43.342946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-243384b9-e9db-46bc-98b9-2bd9989189f5 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:43.344977 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-243384b9-e9db-46bc-98b9-2bd9989189f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:43.399522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:43.434688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 355/722] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:43.454075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243384b9-e9db-46bc-98b9-2bd9989189f5 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:43.472775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 368/723] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:28:43.499499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a884b81-7d2a-4cfb-8834-100ddf33fd2a None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:43.575561 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243384b9-e9db-46bc-98b9-2bd9989189f5 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:43.614772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1635680-d17e-48ae-94a9-afff2b05d0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:43.615967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1635680-d17e-48ae-94a9-afff2b05d0dc None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:43.616456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1635680-d17e-48ae-94a9-afff2b05d0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:43.616933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1635680-d17e-48ae-94a9-afff2b05d0dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:43.629960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1635680-d17e-48ae-94a9-afff2b05d0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-f1635680-d17e-48ae-94a9-afff2b05d0dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:43.638778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:43.639696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:43.640523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:43.647921 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 356/724] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:43.653905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1635680-d17e-48ae-94a9-afff2b05d0dc None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:43.716826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:43.728936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a884b81-7d2a-4cfb-8834-100ddf33fd2a None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:43.754883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:43.770915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2c971-388f-4724-b105-4efca54bbd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:43.771770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c971-388f-4724-b105-4efca54bbd19 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:43.772200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c971-388f-4724-b105-4efca54bbd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:43.772618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c971-388f-4724-b105-4efca54bbd19 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:43.773520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2c971-388f-4724-b105-4efca54bbd19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:43.775084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2c971-388f-4724-b105-4efca54bbd19 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:43.820202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1635680-d17e-48ae-94a9-afff2b05d0dc None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:43.857903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f322b3-ba4c-493e-8522-369fe5c8e573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:43.858838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f322b3-ba4c-493e-8522-369fe5c8e573 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:43.859364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f322b3-ba4c-493e-8522-369fe5c8e573 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:43.859840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f322b3-ba4c-493e-8522-369fe5c8e573 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:43.860740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f322b3-ba4c-493e-8522-369fe5c8e573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:43.861232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f322b3-ba4c-493e-8522-369fe5c8e573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:43.869000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 369/725] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:28:43 2022] POST /identity/v3/services => generated 251 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:28:43.870152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f322b3-ba4c-493e-8522-369fe5c8e573 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:43.881063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 357/726] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:43.886804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2c971-388f-4724-b105-4efca54bbd19 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:44.036809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2c971-388f-4724-b105-4efca54bbd19 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:44.089387 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ae151-c97c-4c37-b589-fd5bae21d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:44.090510 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae151-c97c-4c37-b589-fd5bae21d0cc None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:44.090940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae151-c97c-4c37-b589-fd5bae21d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:44.091343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae151-c97c-4c37-b589-fd5bae21d0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:44.108663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ae151-c97c-4c37-b589-fd5bae21d0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:44.110428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ae151-c97c-4c37-b589-fd5bae21d0cc None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-da4ae151-c97c-4c37-b589-fd5bae21d0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:44.133890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:44.134887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:44.135782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:44.135782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:44.135782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:44.135782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:44.135782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 370/727] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:44.143629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f322b3-ba4c-493e-8522-369fe5c8e573 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:44.263687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:44.270286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f322b3-ba4c-493e-8522-369fe5c8e573 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:44.315236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24e3f9-c344-4014-97df-fdd6785bd1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:44.315851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24e3f9-c344-4014-97df-fdd6785bd1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:44.316124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24e3f9-c344-4014-97df-fdd6785bd1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:44.316404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24e3f9-c344-4014-97df-fdd6785bd1f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:44.317165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24e3f9-c344-4014-97df-fdd6785bd1f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:44.317473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24e3f9-c344-4014-97df-fdd6785bd1f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:44.318933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24e3f9-c344-4014-97df-fdd6785bd1f6 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:44.335926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 358/728] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:44.341655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ae151-c97c-4c37-b589-fd5bae21d0cc None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:44.400015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:44.478462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ae151-c97c-4c37-b589-fd5bae21d0cc None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:44.527174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8299a-e4a6-4d11-a2d7-25480ae040f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:44.527983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8299a-e4a6-4d11-a2d7-25480ae040f1 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:44.528266 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8299a-e4a6-4d11-a2d7-25480ae040f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:44.528543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8299a-e4a6-4d11-a2d7-25480ae040f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:44.541241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8299a-e4a6-4d11-a2d7-25480ae040f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:44.542752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8299a-e4a6-4d11-a2d7-25480ae040f1 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-d1f8299a-e4a6-4d11-a2d7-25480ae040f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:44.560897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:44.561855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:44.563640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:44.563640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:44.563640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:44.563640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:44.563640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:44.563640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:44.563640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:44.563640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:44.563640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:44.563640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:44.563640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 371/729] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jun 8 06:28:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:44.571604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24e3f9-c344-4014-97df-fdd6785bd1f6 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:44.663017 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60d9e9-620f-47cc-a2dc-2b362de9bbd3 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:44.663299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60d9e9-620f-47cc-a2dc-2b362de9bbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:44.663573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60d9e9-620f-47cc-a2dc-2b362de9bbd3 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:44.665433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 372/730] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:44.670517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852238f4-1043-4c88-b295-4065102624dd None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:44.670814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852238f4-1043-4c88-b295-4065102624dd None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:44.671091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852238f4-1043-4c88-b295-4065102624dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:44.696032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-852238f4-1043-4c88-b295-4065102624dd None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:44.698553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-852238f4-1043-4c88-b295-4065102624dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:44.736608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24e3f9-c344-4014-97df-fdd6785bd1f6 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:44.801500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8412f-5f78-4342-8431-8f33a1d696a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:44.802228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8412f-5f78-4342-8431-8f33a1d696a5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:44.802532 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8412f-5f78-4342-8431-8f33a1d696a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:44.802808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8412f-5f78-4342-8431-8f33a1d696a5 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:44.803657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8412f-5f78-4342-8431-8f33a1d696a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:44.803964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8412f-5f78-4342-8431-8f33a1d696a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:44.805390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8412f-5f78-4342-8431-8f33a1d696a5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:44.828672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 373/731] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 06:28:44.840690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 359/732] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jun 8 06:28:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:44.846803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852238f4-1043-4c88-b295-4065102624dd None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:44.868462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8412f-5f78-4342-8431-8f33a1d696a5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:44.876976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:44.903418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:45.003404 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852238f4-1043-4c88-b295-4065102624dd None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:45.062328 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8412f-5f78-4342-8431-8f33a1d696a5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:45.074143 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ccc58-3ff6-43d3-ac26-7651f2761c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:45.075229 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ccc58-3ff6-43d3-ac26-7651f2761c23 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.075520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ccc58-3ff6-43d3-ac26-7651f2761c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.075796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ccc58-3ff6-43d3-ac26-7651f2761c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.092573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ccc58-3ff6-43d3-ac26-7651f2761c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:45.094090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ccc58-3ff6-43d3-ac26-7651f2761c23 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-1f4ccc58-3ff6-43d3-ac26-7651f2761c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:45.123204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:45.124154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:45.125034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:45.125034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:45.125034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:45.125034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:45.125034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 374/733] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:45.131476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ccc58-3ff6-43d3-ac26-7651f2761c23 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:45.134133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea451e-ccc2-4bdf-b6e4-b4bf05b57115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:45.134996 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea451e-ccc2-4bdf-b6e4-b4bf05b57115 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.135278 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea451e-ccc2-4bdf-b6e4-b4bf05b57115 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.135554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea451e-ccc2-4bdf-b6e4-b4bf05b57115 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.159231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea451e-ccc2-4bdf-b6e4-b4bf05b57115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-25ea451e-ccc2-4bdf-b6e4-b4bf05b57115 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:45.170256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:45.171162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:45.171988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:45.178759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 360/734] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:45.182615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea451e-ccc2-4bdf-b6e4-b4bf05b57115 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:45.262602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:45.305719 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ccc58-3ff6-43d3-ac26-7651f2761c23 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:45.317896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:45.362889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea451e-ccc2-4bdf-b6e4-b4bf05b57115 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:45.364736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e98ec-0d5e-4725-968b-06296cee0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:45.365409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e98ec-0d5e-4725-968b-06296cee0836 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.365691 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e98ec-0d5e-4725-968b-06296cee0836 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.365969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e98ec-0d5e-4725-968b-06296cee0836 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.366728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e98ec-0d5e-4725-968b-06296cee0836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:45.367038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e98ec-0d5e-4725-968b-06296cee0836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:45.368416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e98ec-0d5e-4725-968b-06296cee0836 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:45.390567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 375/735] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:45.396441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e98ec-0d5e-4725-968b-06296cee0836 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:45.425970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73509d-934b-47dd-9084-5847d1069f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:45.426675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73509d-934b-47dd-9084-5847d1069f46 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.426958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73509d-934b-47dd-9084-5847d1069f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.427783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73509d-934b-47dd-9084-5847d1069f46 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.428544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73509d-934b-47dd-9084-5847d1069f46 None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:45.429126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73509d-934b-47dd-9084-5847d1069f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:45.430799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73509d-934b-47dd-9084-5847d1069f46 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:45.443770 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 361/736] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:45.445075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219e5a3-f4b6-4f1e-9fe0-ee1cc1b7c9f9 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.445367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219e5a3-f4b6-4f1e-9fe0-ee1cc1b7c9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.445646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219e5a3-f4b6-4f1e-9fe0-ee1cc1b7c9f9 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.454346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 362/737] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:45.455716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219e5a3-f4b6-4f1e-9fe0-ee1cc1b7c9f9 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:45.527000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e98ec-0d5e-4725-968b-06296cee0836 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:45.556757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:45.561625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26c4f7-33df-450c-b359-650b033f657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:45.562460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26c4f7-33df-450c-b359-650b033f657c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.562767 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26c4f7-33df-450c-b359-650b033f657c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.563045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26c4f7-33df-450c-b359-650b033f657c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.569841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26c4f7-33df-450c-b359-650b033f657c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:45.571319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26c4f7-33df-450c-b359-650b033f657c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:45.575743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219e5a3-f4b6-4f1e-9fe0-ee1cc1b7c9f9 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-ee26c4f7-33df-450c-b359-650b033f657c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:45.586637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:45.587741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:45.588637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:45.588637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:45.588637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:45.588637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:45.588637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:45.588637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:45.588637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:45.588637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:45.592581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 376/738] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:45.593758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991aa0-84d3-4787-a5b9-69900f4faaa8 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.594639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991aa0-84d3-4787-a5b9-69900f4faaa8 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.594924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991aa0-84d3-4787-a5b9-69900f4faaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.611781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-25991aa0-84d3-4787-a5b9-69900f4faaa8 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:45.613019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-25991aa0-84d3-4787-a5b9-69900f4faaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:45.614733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba61250-31c1-4aac-a760-9bbe05fce5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:45.615636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba61250-31c1-4aac-a760-9bbe05fce5ab None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.616032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba61250-31c1-4aac-a760-9bbe05fce5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.616310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba61250-31c1-4aac-a760-9bbe05fce5ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.619097 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:45.628213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba61250-31c1-4aac-a760-9bbe05fce5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:45.629905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba61250-31c1-4aac-a760-9bbe05fce5ab None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-7ba61250-31c1-4aac-a760-9bbe05fce5ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:45.647931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:45.648841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:45.649715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:45.649715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:45.649715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:45.649715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:45.653877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 363/739] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:45.655187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627086a5-703e-40d6-99bf-1c7914400309 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.655581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627086a5-703e-40d6-99bf-1c7914400309 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.655864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627086a5-703e-40d6-99bf-1c7914400309 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.661727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 364/740] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:45.662350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627086a5-703e-40d6-99bf-1c7914400309 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:45.686288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 377/741] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:45.686288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991aa0-84d3-4787-a5b9-69900f4faaa8 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:45.784698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627086a5-703e-40d6-99bf-1c7914400309 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:45.786640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991aa0-84d3-4787-a5b9-69900f4faaa8 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:45.811592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:45.820379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe07ec-2770-47f2-8b34-a0eeeecb350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:45.821032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe07ec-2770-47f2-8b34-a0eeeecb350a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.821309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe07ec-2770-47f2-8b34-a0eeeecb350a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.821582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe07ec-2770-47f2-8b34-a0eeeecb350a None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.823641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe07ec-2770-47f2-8b34-a0eeeecb350a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:45.823641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe07ec-2770-47f2-8b34-a0eeeecb350a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:45.824070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360f3dc-d750-47a9-af08-fee479b65ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:45.824551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe07ec-2770-47f2-8b34-a0eeeecb350a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:45.825036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f3dc-d750-47a9-af08-fee479b65ccb None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.825323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f3dc-d750-47a9-af08-fee479b65ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.825655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f3dc-d750-47a9-af08-fee479b65ccb None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.826718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360f3dc-d750-47a9-af08-fee479b65ccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:45.827482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360f3dc-d750-47a9-af08-fee479b65ccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:45.828938 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360f3dc-d750-47a9-af08-fee479b65ccb None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:45.837035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 365/742] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:45.838043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d36fa-07b4-45c1-87c6-36357d57b77c None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:45.838503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d36fa-07b4-45c1-87c6-36357d57b77c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:45.838728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d36fa-07b4-45c1-87c6-36357d57b77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:45.853182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 378/743] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:45.854311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360f3dc-d750-47a9-af08-fee479b65ccb None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:45.857191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-856d36fa-07b4-45c1-87c6-36357d57b77c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:45.859084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-856d36fa-07b4-45c1-87c6-36357d57b77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:45.904531 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:45.934295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 366/744] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 06:28:45.934295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d36fa-07b4-45c1-87c6-36357d57b77c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:45.980949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360f3dc-d750-47a9-af08-fee479b65ccb None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:46.016785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3b751-86e7-4f9a-925b-75914cbf19c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:46.017501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b751-86e7-4f9a-925b-75914cbf19c2 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:46.017742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b751-86e7-4f9a-925b-75914cbf19c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:46.018011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b751-86e7-4f9a-925b-75914cbf19c2 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:46.018767 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3b751-86e7-4f9a-925b-75914cbf19c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:46.020131 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3b751-86e7-4f9a-925b-75914cbf19c2 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:46.039292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d36fa-07b4-45c1-87c6-36357d57b77c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:46.072011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419e7f7-19b4-4f4b-a520-21248f55feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:46.072901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e7f7-19b4-4f4b-a520-21248f55feef None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:46.073178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e7f7-19b4-4f4b-a520-21248f55feef None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:46.073447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e7f7-19b4-4f4b-a520-21248f55feef None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/b8661ef27af34bbea11e215831d50843/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:46.075711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419e7f7-19b4-4f4b-a520-21248f55feef None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=b8661ef27af34bbea11e215831d50843, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:46.077198 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419e7f7-19b4-4f4b-a520-21248f55feef None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:46.091630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 379/745] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:28:45 2022] POST /identity/v3/services => generated 240 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:28:46.092395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3b751-86e7-4f9a-925b-75914cbf19c2 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:46.141644 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 367/746] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:28:45 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/b8661ef27af34bbea11e215831d50843/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:46.142761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419e7f7-19b4-4f4b-a520-21248f55feef None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:46.167096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:46.234192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:46.252800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3b751-86e7-4f9a-925b-75914cbf19c2 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:46.301147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014514-6529-444d-beac-e71784f4a027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:46.302513 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014514-6529-444d-beac-e71784f4a027 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:46.303059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014514-6529-444d-beac-e71784f4a027 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:46.303612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014514-6529-444d-beac-e71784f4a027 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:46.315256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44014514-6529-444d-beac-e71784f4a027 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:46.317560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44014514-6529-444d-beac-e71784f4a027 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-44014514-6529-444d-beac-e71784f4a027 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:46.338799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:46.339801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:46.340819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:46.340819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:46.340819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:46.340819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:46.340819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:46.340819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:46.340819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:46.340819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:46.340819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:28:46.340819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:46.344911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 380/747] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jun 8 06:28:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:46.350780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014514-6529-444d-beac-e71784f4a027 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:46.355734 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419e7f7-19b4-4f4b-a520-21248f55feef None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:46.405074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542afde-eb03-4546-b39e-ee7ae65595e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:46.406305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542afde-eb03-4546-b39e-ee7ae65595e3 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:46.406980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542afde-eb03-4546-b39e-ee7ae65595e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:46.407481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542afde-eb03-4546-b39e-ee7ae65595e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:46.422111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542afde-eb03-4546-b39e-ee7ae65595e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-8542afde-eb03-4546-b39e-ee7ae65595e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:46.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:46.431971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:46.432928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:46.435307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 368/748] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:46.444607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542afde-eb03-4546-b39e-ee7ae65595e3 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:46.475541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:46.481074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014514-6529-444d-beac-e71784f4a027 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:46.543055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a36882-4a03-4bb2-8519-16a1c227d2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:46.544136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36882-4a03-4bb2-8519-16a1c227d2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:46.544617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36882-4a03-4bb2-8519-16a1c227d2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:46.545103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36882-4a03-4bb2-8519-16a1c227d2c9 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:46.546145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a36882-4a03-4bb2-8519-16a1c227d2c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:46.546672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a36882-4a03-4bb2-8519-16a1c227d2c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:46.548412 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a36882-4a03-4bb2-8519-16a1c227d2c9 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:46.577698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:46.577698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542afde-eb03-4546-b39e-ee7ae65595e3 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:46.586109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 381/749] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jun 8 06:28:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:46.593066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a36882-4a03-4bb2-8519-16a1c227d2c9 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:46.609649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f5518-2fcb-43f1-b40f-97f6d6b03c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:46.610388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f5518-2fcb-43f1-b40f-97f6d6b03c08 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:46.610675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f5518-2fcb-43f1-b40f-97f6d6b03c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:46.610952 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f5518-2fcb-43f1-b40f-97f6d6b03c08 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:46.611814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f5518-2fcb-43f1-b40f-97f6d6b03c08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:46.612125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f5518-2fcb-43f1-b40f-97f6d6b03c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:46.613648 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f5518-2fcb-43f1-b40f-97f6d6b03c08 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:46.623585 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 369/750] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:46.629392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f5518-2fcb-43f1-b40f-97f6d6b03c08 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:46.731162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a36882-4a03-4bb2-8519-16a1c227d2c9 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:46.746488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f5518-2fcb-43f1-b40f-97f6d6b03c08 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:46.768976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fb540-b079-4664-bbe9-5c4a0d1cd072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:46.769684 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fb540-b079-4664-bbe9-5c4a0d1cd072 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:46.769971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fb540-b079-4664-bbe9-5c4a0d1cd072 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:46.770263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fb540-b079-4664-bbe9-5c4a0d1cd072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:46.784944 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99bdf3-cf09-4250-a31b-6c0eedfcd6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:46.785735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99bdf3-cf09-4250-a31b-6c0eedfcd6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:46.786015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99bdf3-cf09-4250-a31b-6c0eedfcd6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:46.786312 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99bdf3-cf09-4250-a31b-6c0eedfcd6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:46.795850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:46.798941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99bdf3-cf09-4250-a31b-6c0eedfcd6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:46.800441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99bdf3-cf09-4250-a31b-6c0eedfcd6b3 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-ea99bdf3-cf09-4250-a31b-6c0eedfcd6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:46.820357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:46.821279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:46.822172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:46.822172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:46.822172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:46.822172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:46.822172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 370/751] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:46.826278 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce66e7f-3be1-413e-8727-0b379682592d None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:46.826278 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce66e7f-3be1-413e-8727-0b379682592d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:46.826278 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce66e7f-3be1-413e-8727-0b379682592d None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:46.829926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 371/752] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:46.831166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01bd1a-89dd-42f7-a406-98079f9eaa59 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:46.831460 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01bd1a-89dd-42f7-a406-98079f9eaa59 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:46.831739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01bd1a-89dd-42f7-a406-98079f9eaa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:46.849262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fb540-b079-4664-bbe9-5c4a0d1cd072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:46.849918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-fc01bd1a-89dd-42f7-a406-98079f9eaa59 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:46.850791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fb540-b079-4664-bbe9-5c4a0d1cd072 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:46.850978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-fc01bd1a-89dd-42f7-a406-98079f9eaa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:46.859023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:46.942667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 372/753] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:28:46.943666 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01bd1a-89dd-42f7-a406-98079f9eaa59 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:46.975681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 382/754] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 06:28:46.983304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fb540-b079-4664-bbe9-5c4a0d1cd072 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:47.057340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:47.094647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01bd1a-89dd-42f7-a406-98079f9eaa59 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:47.102833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fb540-b079-4664-bbe9-5c4a0d1cd072 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:47.145126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0a818-61c0-491c-b619-66e4ab8e1f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:47.145946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0a818-61c0-491c-b619-66e4ab8e1f0f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:47.146253 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0a818-61c0-491c-b619-66e4ab8e1f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:47.146534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0a818-61c0-491c-b619-66e4ab8e1f0f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:47.147200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0a818-61c0-491c-b619-66e4ab8e1f0f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:47.147439 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90957b-1619-410c-a873-f73524986051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:47.148337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90957b-1619-410c-a873-f73524986051 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:47.148571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0a818-61c0-491c-b619-66e4ab8e1f0f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:47.149033 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90957b-1619-410c-a873-f73524986051 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:47.149509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90957b-1619-410c-a873-f73524986051 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:47.150830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90957b-1619-410c-a873-f73524986051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:47.151780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90957b-1619-410c-a873-f73524986051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:47.153653 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90957b-1619-410c-a873-f73524986051 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-69f0a818-61c0-491c-b619-66e4ab8e1f0f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:47.161833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:47.162802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:47.167022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 383/755] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Jun 8 06:28:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:47.167959 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0a818-61c0-491c-b619-66e4ab8e1f0f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:47.175116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 373/756] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:47.179442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90957b-1619-410c-a873-f73524986051 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:47.182311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:47.291465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0a818-61c0-491c-b619-66e4ab8e1f0f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:47.294444 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90957b-1619-410c-a873-f73524986051 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:47.316490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:47.332542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd36cb-aed8-446d-a5e5-5a6858381eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:47.333799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd36cb-aed8-446d-a5e5-5a6858381eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:47.334066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd36cb-aed8-446d-a5e5-5a6858381eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:47.334363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4c675-615e-4d99-9c6a-93f5945c26d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:47.334810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd36cb-aed8-446d-a5e5-5a6858381eb2 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:47.335166 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4c675-615e-4d99-9c6a-93f5945c26d9 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:47.335445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4c675-615e-4d99-9c6a-93f5945c26d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:47.335722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4c675-615e-4d99-9c6a-93f5945c26d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:47.336550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd36cb-aed8-446d-a5e5-5a6858381eb2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:47.337052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd36cb-aed8-446d-a5e5-5a6858381eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:47.338631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd36cb-aed8-446d-a5e5-5a6858381eb2 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:47.348474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4c675-615e-4d99-9c6a-93f5945c26d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:47.349088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 374/757] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jun 8 06:28:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:47.349319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4c675-615e-4d99-9c6a-93f5945c26d9 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:47.350530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd36cb-aed8-446d-a5e5-5a6858381eb2 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-22b4c675-615e-4d99-9c6a-93f5945c26d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:47.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:47.371923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:47.373201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:47.373201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:47.373201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:47.373201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:47.376934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 384/758] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:47.377765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4c675-615e-4d99-9c6a-93f5945c26d9 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:47.429905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:47.470661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd36cb-aed8-446d-a5e5-5a6858381eb2 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:47.506365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4c675-615e-4d99-9c6a-93f5945c26d9 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:47.507743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa301fb3-f753-4731-80cf-e80bd8576055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:47.509133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa301fb3-f753-4731-80cf-e80bd8576055 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:47.509610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa301fb3-f753-4731-80cf-e80bd8576055 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:47.510063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa301fb3-f753-4731-80cf-e80bd8576055 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:47.520376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa301fb3-f753-4731-80cf-e80bd8576055 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:47.522197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa301fb3-f753-4731-80cf-e80bd8576055 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:47.546810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898365d-0280-4f4a-ac9c-1fd5af745c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:47.547447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898365d-0280-4f4a-ac9c-1fd5af745c16 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:47.547733 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898365d-0280-4f4a-ac9c-1fd5af745c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:47.548015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898365d-0280-4f4a-ac9c-1fd5af745c16 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:47.548754 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898365d-0280-4f4a-ac9c-1fd5af745c16 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:47.549061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898365d-0280-4f4a-ac9c-1fd5af745c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-aa301fb3-f753-4731-80cf-e80bd8576055 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:47.549534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:47.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:47.554954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:47.554954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:47.554954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:47.554954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:47.554954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:47.554954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:47.554954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:47.554954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:47.554954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:47.554954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:47.555486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898365d-0280-4f4a-ac9c-1fd5af745c16 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:47.556732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 375/759] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:47.557638 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa301fb3-f753-4731-80cf-e80bd8576055 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:47.598633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 385/760] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jun 8 06:28:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:47.599585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898365d-0280-4f4a-ac9c-1fd5af745c16 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:47.646727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:47.671752 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa301fb3-f753-4731-80cf-e80bd8576055 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:47.705131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:47.716725 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35192cf7-c6f3-41e3-b18d-611f2db529e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:47.717390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35192cf7-c6f3-41e3-b18d-611f2db529e5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:47.717792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35192cf7-c6f3-41e3-b18d-611f2db529e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:47.718212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35192cf7-c6f3-41e3-b18d-611f2db529e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:47.719833 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35192cf7-c6f3-41e3-b18d-611f2db529e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:47.720103 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35192cf7-c6f3-41e3-b18d-611f2db529e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:47.721906 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35192cf7-c6f3-41e3-b18d-611f2db529e5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:47.730230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898365d-0280-4f4a-ac9c-1fd5af745c16 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:47.738315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 376/761] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:47.739426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35192cf7-c6f3-41e3-b18d-611f2db529e5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:47.769188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927103b-a18a-4822-913d-e43d3827f0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:47.770115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927103b-a18a-4822-913d-e43d3827f0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:47.770564 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927103b-a18a-4822-913d-e43d3827f0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:47.771077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927103b-a18a-4822-913d-e43d3827f0e5 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:47.772177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927103b-a18a-4822-913d-e43d3827f0e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:47.772629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927103b-a18a-4822-913d-e43d3827f0e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:47.774361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927103b-a18a-4822-913d-e43d3827f0e5 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:47.797740 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 386/762] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jun 8 06:28:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:47.799010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927103b-a18a-4822-913d-e43d3827f0e5 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:47.856598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35192cf7-c6f3-41e3-b18d-611f2db529e5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:47.893441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc007b51-0b1b-4427-8fd3-abb7f398c284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:47.894454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc007b51-0b1b-4427-8fd3-abb7f398c284 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:47.894958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc007b51-0b1b-4427-8fd3-abb7f398c284 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:47.895408 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc007b51-0b1b-4427-8fd3-abb7f398c284 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:47.896481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc007b51-0b1b-4427-8fd3-abb7f398c284 None admin] RBAC: Adding query filter params (interface=public, service_id=9a4290fa57bd4b30b7ea5f7ee376f3b7, region_id=RegionOne) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:47.896994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc007b51-0b1b-4427-8fd3-abb7f398c284 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:47.898600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc007b51-0b1b-4427-8fd3-abb7f398c284 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:47.912619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 377/763] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jun 8 06:28:47 2022] GET /identity/v3/endpoints?service_id=9a4290fa57bd4b30b7ea5f7ee376f3b7&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:47.913426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:47.914353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc007b51-0b1b-4427-8fd3-abb7f398c284 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:47.921639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927103b-a18a-4822-913d-e43d3827f0e5 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:47.970813 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b1585-e2fc-4a8e-b3fe-8b511e5c5d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:47.971989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:47.972225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b1585-e2fc-4a8e-b3fe-8b511e5c5d96 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:47.972822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b1585-e2fc-4a8e-b3fe-8b511e5c5d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:47.973080 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b1585-e2fc-4a8e-b3fe-8b511e5c5d96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:47.981890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b1585-e2fc-4a8e-b3fe-8b511e5c5d96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:47.984174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b1585-e2fc-4a8e-b3fe-8b511e5c5d96 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-4f5b1585-e2fc-4a8e-b3fe-8b511e5c5d96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:48.002137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:48.003270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:48.004462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:48.004462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:48.004462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:48.004462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:48.004462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:48.004462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:48.004462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:48.004462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:48.004462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 387/764] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:48.004954 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b1585-e2fc-4a8e-b3fe-8b511e5c5d96 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:48.032956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc007b51-0b1b-4427-8fd3-abb7f398c284 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:48.072366 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed24c3d-7e80-4296-b157-18201c9eaf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:48.073404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed24c3d-7e80-4296-b157-18201c9eaf0e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:48.073839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed24c3d-7e80-4296-b157-18201c9eaf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:48.074564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed24c3d-7e80-4296-b157-18201c9eaf0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:48.126395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b1585-e2fc-4a8e-b3fe-8b511e5c5d96 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:48.154725 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed24c3d-7e80-4296-b157-18201c9eaf0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:48.156547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed24c3d-7e80-4296-b157-18201c9eaf0e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:48.167692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a64196-5bac-4857-b1dd-c4057e0c7643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:48.168361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a64196-5bac-4857-b1dd-c4057e0c7643 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:48.168639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a64196-5bac-4857-b1dd-c4057e0c7643 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:48.168907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a64196-5bac-4857-b1dd-c4057e0c7643 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:48.169902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a64196-5bac-4857-b1dd-c4057e0c7643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:48.171575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a64196-5bac-4857-b1dd-c4057e0c7643 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:48.186393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 388/765] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jun 8 06:28:48 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:48.188449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a64196-5bac-4857-b1dd-c4057e0c7643 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:48.219197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:48.230756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:48.287491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 378/766] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:28:48.296229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed24c3d-7e80-4296-b157-18201c9eaf0e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:48.426485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a64196-5bac-4857-b1dd-c4057e0c7643 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:48.469749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed24c3d-7e80-4296-b157-18201c9eaf0e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:48.477366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af4eeb-3777-4446-ad74-802c8aefb899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:48.478029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af4eeb-3777-4446-ad74-802c8aefb899 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:48.478334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af4eeb-3777-4446-ad74-802c8aefb899 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:48.478611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af4eeb-3777-4446-ad74-802c8aefb899 None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:48.479395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af4eeb-3777-4446-ad74-802c8aefb899 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:48.479714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af4eeb-3777-4446-ad74-802c8aefb899 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:48.481117 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af4eeb-3777-4446-ad74-802c8aefb899 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:48.494780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 389/767] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:48.500989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af4eeb-3777-4446-ad74-802c8aefb899 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:48.514886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2834-668a-41d3-bc79-2ba4b3bd33bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:48.516113 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2834-668a-41d3-bc79-2ba4b3bd33bc None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:48.516578 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2834-668a-41d3-bc79-2ba4b3bd33bc None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:48.517158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2834-668a-41d3-bc79-2ba4b3bd33bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:48.530094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d2834-668a-41d3-bc79-2ba4b3bd33bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:48.532543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d2834-668a-41d3-bc79-2ba4b3bd33bc None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-6a1d2834-668a-41d3-bc79-2ba4b3bd33bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:48.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:48.554522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:48.555384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:48.555384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:48.555384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:48.555384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:48.561751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 379/768] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:48.563620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2834-668a-41d3-bc79-2ba4b3bd33bc None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:48.567443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:48.597049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:48.628250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af4eeb-3777-4446-ad74-802c8aefb899 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:48.672524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39938e94-34b0-4a3a-a0fd-ddaa9cc2929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:48.673580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938e94-34b0-4a3a-a0fd-ddaa9cc2929e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:48.674059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938e94-34b0-4a3a-a0fd-ddaa9cc2929e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:48.674549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938e94-34b0-4a3a-a0fd-ddaa9cc2929e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:48.675583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39938e94-34b0-4a3a-a0fd-ddaa9cc2929e None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=e9f15c6bec2c4ed99834b2edf1e59947) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:48.676126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39938e94-34b0-4a3a-a0fd-ddaa9cc2929e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:48.677779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39938e94-34b0-4a3a-a0fd-ddaa9cc2929e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:48.684016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 390/769] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:48 2022] GET /identity/v3/role_assignments?user.id=e9f15c6bec2c4ed99834b2edf1e59947&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:48.685640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703291-b2d3-45c1-b749-ab977f35bc2f None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:48.686132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703291-b2d3-45c1-b749-ab977f35bc2f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:48.686279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2834-668a-41d3-bc79-2ba4b3bd33bc None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:48.686775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703291-b2d3-45c1-b749-ab977f35bc2f None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:48.688694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 391/770] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:48.700379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035177d9-fca7-450e-b1be-503062ca614a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:48.701009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035177d9-fca7-450e-b1be-503062ca614a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:48.701483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035177d9-fca7-450e-b1be-503062ca614a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:48.731670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0c512-f5c5-4065-8e87-334901195ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:48.732359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0c512-f5c5-4065-8e87-334901195ccc None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:48.732627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0c512-f5c5-4065-8e87-334901195ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:48.732903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0c512-f5c5-4065-8e87-334901195ccc None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:48.733732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0c512-f5c5-4065-8e87-334901195ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:48.734047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0c512-f5c5-4065-8e87-334901195ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:48.736051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0c512-f5c5-4065-8e87-334901195ccc None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:48.739347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-035177d9-fca7-450e-b1be-503062ca614a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:48.740574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-035177d9-fca7-450e-b1be-503062ca614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:48.749737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 380/771] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:48.751313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84843d40-9917-4828-863d-75914e4437ef None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:48.751605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84843d40-9917-4828-863d-75914e4437ef None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:48.751881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84843d40-9917-4828-863d-75914e4437ef None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:48.757292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 381/772] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:48.757292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84843d40-9917-4828-863d-75914e4437ef None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:48.833311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:48.840067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 392/773] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:28:48.841707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323456e-3657-4194-9ce4-2741e2e62232 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:48.841994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323456e-3657-4194-9ce4-2741e2e62232 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:48.842295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323456e-3657-4194-9ce4-2741e2e62232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:48.864823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-2323456e-3657-4194-9ce4-2741e2e62232 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:48.866625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2323456e-3657-4194-9ce4-2741e2e62232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:48.887930 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84843d40-9917-4828-863d-75914e4437ef None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:48.939347 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713f47c-a796-43e6-b446-88806029807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:48.940232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713f47c-a796-43e6-b446-88806029807b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:48.940511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713f47c-a796-43e6-b446-88806029807b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:48.940783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713f47c-a796-43e6-b446-88806029807b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:48.950013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713f47c-a796-43e6-b446-88806029807b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:48.951715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713f47c-a796-43e6-b446-88806029807b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:48.966484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 393/774] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-c713f47c-a796-43e6-b446-88806029807b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:48.967604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:48.968454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:48.970032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:48.970032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:48.970032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:48.970032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:48.970032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:48.970032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:48.970032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:48.970032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:48.970926 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323456e-3657-4194-9ce4-2741e2e62232 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:48.973388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:48.974329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 382/775] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:48.982367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713f47c-a796-43e6-b446-88806029807b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:49.108072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323456e-3657-4194-9ce4-2741e2e62232 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:49.113353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713f47c-a796-43e6-b446-88806029807b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:49.138255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:49.153870 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e503b42-8ecd-4677-afbd-2a3da3eadc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:49.155022 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cd12b-55d7-424a-8831-687490647666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:49.155177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e503b42-8ecd-4677-afbd-2a3da3eadc57 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:49.155610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e503b42-8ecd-4677-afbd-2a3da3eadc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:49.155955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd12b-55d7-424a-8831-687490647666 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:49.156185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e503b42-8ecd-4677-afbd-2a3da3eadc57 None admin] PATH_INFO: `/v3/services/network` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:49.156983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd12b-55d7-424a-8831-687490647666 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:49.157318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd12b-55d7-424a-8831-687490647666 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:49.157943 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e503b42-8ecd-4677-afbd-2a3da3eadc57 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:49.158361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cd12b-55d7-424a-8831-687490647666 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:49.158767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cd12b-55d7-424a-8831-687490647666 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:49.159796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e503b42-8ecd-4677-afbd-2a3da3eadc57 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:49.160389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cd12b-55d7-424a-8831-687490647666 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:49.173688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 383/776] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:49.174928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cd12b-55d7-424a-8831-687490647666 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-0e503b42-8ecd-4677-afbd-2a3da3eadc57 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:49.179747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:49.182217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:49.183097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 394/777] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:48 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:49.185133 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e503b42-8ecd-4677-afbd-2a3da3eadc57 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:49.262334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:49.286944 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cd12b-55d7-424a-8831-687490647666 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:49.306319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e503b42-8ecd-4677-afbd-2a3da3eadc57 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:49.322118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb15382-456c-4bba-8db6-704249742ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:49.323053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb15382-456c-4bba-8db6-704249742ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:49.323434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb15382-456c-4bba-8db6-704249742ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:49.323808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb15382-456c-4bba-8db6-704249742ee9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:49.335318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb15382-456c-4bba-8db6-704249742ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-9cb15382-456c-4bba-8db6-704249742ee9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:49.343349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:49.344482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:49.345563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:49.347706 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d44fd-2171-491d-b086-9465e3d350f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:49.348584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d44fd-2171-491d-b086-9465e3d350f4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:49.348992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d44fd-2171-491d-b086-9465e3d350f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:49.349408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d44fd-2171-491d-b086-9465e3d350f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:49.350401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d44fd-2171-491d-b086-9465e3d350f4 None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=2130fd9eb8464e95a4fb24083c36427a) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:49.350838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d44fd-2171-491d-b086-9465e3d350f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:49.352388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 384/778] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:49.353026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d44fd-2171-491d-b086-9465e3d350f4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:49.353416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb15382-456c-4bba-8db6-704249742ee9 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:49.364470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 395/779] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:49 2022] GET /identity/v3/role_assignments?user.id=2130fd9eb8464e95a4fb24083c36427a&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:49.365738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d44fd-2171-491d-b086-9465e3d350f4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:49.408747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:49.504249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb15382-456c-4bba-8db6-704249742ee9 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:49.543098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d44fd-2171-491d-b086-9465e3d350f4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:49.576035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:49.583485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148af045-3035-4d54-abb7-50e1adc7c786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:49.583673 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae5597-bd5e-4b31-a064-0ce9628d0b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:49.584185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae5597-bd5e-4b31-a064-0ce9628d0b74 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:49.589018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae5597-bd5e-4b31-a064-0ce9628d0b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:49.589157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af045-3035-4d54-abb7-50e1adc7c786 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:49.589241 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae5597-bd5e-4b31-a064-0ce9628d0b74 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:49.589313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af045-3035-4d54-abb7-50e1adc7c786 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:49.589313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af045-3035-4d54-abb7-50e1adc7c786 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:49.589449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae5597-bd5e-4b31-a064-0ce9628d0b74 None admin] RBAC: Adding query filter params (name=network) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:49.589449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae5597-bd5e-4b31-a064-0ce9628d0b74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:49.589582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148af045-3035-4d54-abb7-50e1adc7c786 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:49.589582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148af045-3035-4d54-abb7-50e1adc7c786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:49.589582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148af045-3035-4d54-abb7-50e1adc7c786 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:49.591500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae5597-bd5e-4b31-a064-0ce9628d0b74 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:49.600649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 396/780] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:49.606722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 385/781] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:28:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:49.611463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148af045-3035-4d54-abb7-50e1adc7c786 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:49.613052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae5597-bd5e-4b31-a064-0ce9628d0b74 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:49.761158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae5597-bd5e-4b31-a064-0ce9628d0b74 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:49.770018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:49.798934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148af045-3035-4d54-abb7-50e1adc7c786 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:49.800231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e3980-3598-4d2b-9ea3-8d1fab334957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:49.802458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3980-3598-4d2b-9ea3-8d1fab334957 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:49.802947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3980-3598-4d2b-9ea3-8d1fab334957 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:49.803439 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3980-3598-4d2b-9ea3-8d1fab334957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:49.817318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e3980-3598-4d2b-9ea3-8d1fab334957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:49.819100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e3980-3598-4d2b-9ea3-8d1fab334957 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-c42e3980-3598-4d2b-9ea3-8d1fab334957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:49.839780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:49.840703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:49.841565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:49.841565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:49.841565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:49.841565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:49.844414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 386/782] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:49.853278 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e3980-3598-4d2b-9ea3-8d1fab334957 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:49.875841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd417f7-92fc-4f5f-9961-2892a493d872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:49.876700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd417f7-92fc-4f5f-9961-2892a493d872 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:49.876901 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd417f7-92fc-4f5f-9961-2892a493d872 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:49.877173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd417f7-92fc-4f5f-9961-2892a493d872 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:49.877902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd417f7-92fc-4f5f-9961-2892a493d872 None admin] RBAC: Adding query filter params (type=network) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:49.878210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd417f7-92fc-4f5f-9961-2892a493d872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:49.879612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd417f7-92fc-4f5f-9961-2892a493d872 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:49.892865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 397/783] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:28:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:49.898690 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd417f7-92fc-4f5f-9961-2892a493d872 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:49.988157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e3980-3598-4d2b-9ea3-8d1fab334957 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:50.026148 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:50.069115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14ef63-dcd3-42a3-aa82-025bf98df6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:50.069748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ef63-dcd3-42a3-aa82-025bf98df6ae None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:50.069987 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ef63-dcd3-42a3-aa82-025bf98df6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:50.070296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ef63-dcd3-42a3-aa82-025bf98df6ae None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:50.071055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14ef63-dcd3-42a3-aa82-025bf98df6ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:50.071528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14ef63-dcd3-42a3-aa82-025bf98df6ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:50.072712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14ef63-dcd3-42a3-aa82-025bf98df6ae None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:50.080871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd417f7-92fc-4f5f-9961-2892a493d872 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:50.108567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 387/784] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:50.115184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14ef63-dcd3-42a3-aa82-025bf98df6ae None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:50.119191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dbfcf-8f06-4750-b66a-16fa64226cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:50.120125 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbfcf-8f06-4750-b66a-16fa64226cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:50.120780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbfcf-8f06-4750-b66a-16fa64226cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:50.121268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbfcf-8f06-4750-b66a-16fa64226cf0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:50.122284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dbfcf-8f06-4750-b66a-16fa64226cf0 None admin] RBAC: Adding query filter params (interface=public, service_id=ddc0393f6f3741e78fdd6ddaf8a60a7a, region_id=RegionOne) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:50.122793 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dbfcf-8f06-4750-b66a-16fa64226cf0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:50.124365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dbfcf-8f06-4750-b66a-16fa64226cf0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:50.133674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 398/785] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jun 8 06:28:49 2022] GET /identity/v3/endpoints?service_id=ddc0393f6f3741e78fdd6ddaf8a60a7a&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:50.141943 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dbfcf-8f06-4750-b66a-16fa64226cf0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:50.174673 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:50.286947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14ef63-dcd3-42a3-aa82-025bf98df6ae None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:50.333445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dbfcf-8f06-4750-b66a-16fa64226cf0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:50.349739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c41df-71bf-46c9-9a48-06fe1a066cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:50.350797 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c41df-71bf-46c9-9a48-06fe1a066cca None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:50.351227 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c41df-71bf-46c9-9a48-06fe1a066cca None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:50.351653 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c41df-71bf-46c9-9a48-06fe1a066cca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:50.363526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c41df-71bf-46c9-9a48-06fe1a066cca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:50.365986 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c41df-71bf-46c9-9a48-06fe1a066cca None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:50.374624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-768c41df-71bf-46c9-9a48-06fe1a066cca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:50.392655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:50.393652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:50.394679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:50.394679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:50.394679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:50.394679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:50.394679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:50.394679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:50.394679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:50.394679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:50.394679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:28:50.394679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:50.397214 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 388/786] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jun 8 06:28:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:50.402803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c41df-71bf-46c9-9a48-06fe1a066cca None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:50.403837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b285424-abb5-4de9-8ac3-b31801fda505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:50.405083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b285424-abb5-4de9-8ac3-b31801fda505 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:50.412290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b285424-abb5-4de9-8ac3-b31801fda505 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:50.412864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b285424-abb5-4de9-8ac3-b31801fda505 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:50.413777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b285424-abb5-4de9-8ac3-b31801fda505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:50.415405 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b285424-abb5-4de9-8ac3-b31801fda505 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:50.427593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 399/787] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jun 8 06:28:50 2022] GET /identity/v3/services => generated 772 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:50.506664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:50.530974 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c41df-71bf-46c9-9a48-06fe1a066cca None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:50.577049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0188a-2ed0-4a31-919e-da9d331aad02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:50.578765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0188a-2ed0-4a31-919e-da9d331aad02 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:50.579255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0188a-2ed0-4a31-919e-da9d331aad02 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:50.579736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0188a-2ed0-4a31-919e-da9d331aad02 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:50.580810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0188a-2ed0-4a31-919e-da9d331aad02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:50.581319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0188a-2ed0-4a31-919e-da9d331aad02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:50.582989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0188a-2ed0-4a31-919e-da9d331aad02 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:50.608414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 389/788] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jun 8 06:28:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:50.613991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b285424-abb5-4de9-8ac3-b31801fda505 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:50.744735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b285424-abb5-4de9-8ac3-b31801fda505 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:50.779007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4969bf2-72ee-4372-aa2e-5332014df644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:50.779658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969bf2-72ee-4372-aa2e-5332014df644 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:50.779938 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969bf2-72ee-4372-aa2e-5332014df644 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:50.780212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969bf2-72ee-4372-aa2e-5332014df644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:50.835046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:50.852251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4969bf2-72ee-4372-aa2e-5332014df644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:50.853742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4969bf2-72ee-4372-aa2e-5332014df644 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:50.966093 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 400/789] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:28:50.975350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0188a-2ed0-4a31-919e-da9d331aad02 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:51.020043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced285bc-825f-4395-9c2a-53f903013038 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.020043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced285bc-825f-4395-9c2a-53f903013038 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.020043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced285bc-825f-4395-9c2a-53f903013038 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.020043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 401/790] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:51.024298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0bd5-c8a3-41f9-afd5-3d0bbcba7d3e None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.024589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0bd5-c8a3-41f9-afd5-3d0bbcba7d3e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.024870 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0bd5-c8a3-41f9-afd5-3d0bbcba7d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.042673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-065c0bd5-c8a3-41f9-afd5-3d0bbcba7d3e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:51.050391 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-065c0bd5-c8a3-41f9-afd5-3d0bbcba7d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:51.149501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0188a-2ed0-4a31-919e-da9d331aad02 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:51.158575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 402/791] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:28:51.201908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a724ac-8387-46ff-9b81-71ad9f5ea736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:51.202743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a724ac-8387-46ff-9b81-71ad9f5ea736 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.203054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a724ac-8387-46ff-9b81-71ad9f5ea736 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.203327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a724ac-8387-46ff-9b81-71ad9f5ea736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.205966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c0bd5-c8a3-41f9-afd5-3d0bbcba7d3e None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:51.206352 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:51.221166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a724ac-8387-46ff-9b81-71ad9f5ea736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:51.221166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a724ac-8387-46ff-9b81-71ad9f5ea736 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:51.227529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-b7a724ac-8387-46ff-9b81-71ad9f5ea736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:51.256215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:51.257165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:51.258358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:51.258358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:51.258358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:51.258358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:51.258358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 390/792] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:51.265368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7698f-9a47-4248-946d-69c2fb4c11fd None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.265700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7698f-9a47-4248-946d-69c2fb4c11fd None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.265980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7698f-9a47-4248-946d-69c2fb4c11fd None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.267667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 391/793] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:51.268304 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7698f-9a47-4248-946d-69c2fb4c11fd None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:51.331440 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c0bd5-c8a3-41f9-afd5-3d0bbcba7d3e None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:51.368821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104b9f9-ca4e-42da-a0df-56f6c29d6589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:51.370126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b9f9-ca4e-42da-a0df-56f6c29d6589 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.370640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b9f9-ca4e-42da-a0df-56f6c29d6589 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.371127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b9f9-ca4e-42da-a0df-56f6c29d6589 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.372093 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104b9f9-ca4e-42da-a0df-56f6c29d6589 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:51.373697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104b9f9-ca4e-42da-a0df-56f6c29d6589 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:51.379875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7698f-9a47-4248-946d-69c2fb4c11fd None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-5104b9f9-ca4e-42da-a0df-56f6c29d6589 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:51.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:51.388956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 06:28:51.389777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:51.392489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 403/794] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Jun 8 06:28:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:51.393933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bffe7-0ea5-4703-b6aa-ca83a2037a75 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.394453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bffe7-0ea5-4703-b6aa-ca83a2037a75 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.394943 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bffe7-0ea5-4703-b6aa-ca83a2037a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.411923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-3c8bffe7-0ea5-4703-b6aa-ca83a2037a75 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:51.413436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3c8bffe7-0ea5-4703-b6aa-ca83a2037a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:51.422596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd89d2-e278-444e-99a7-728afa2be0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:51.423300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd89d2-e278-444e-99a7-728afa2be0ab None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.423686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd89d2-e278-444e-99a7-728afa2be0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.424109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd89d2-e278-444e-99a7-728afa2be0ab None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.425248 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd89d2-e278-444e-99a7-728afa2be0ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:51.425508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd89d2-e278-444e-99a7-728afa2be0ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:51.427163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd89d2-e278-444e-99a7-728afa2be0ab None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:51.445316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 392/795] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:51.445316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd89d2-e278-444e-99a7-728afa2be0ab None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:51.498640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 404/796] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:28:51.499810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bffe7-0ea5-4703-b6aa-ca83a2037a75 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:51.513370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:51.518259 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:51.576923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd89d2-e278-444e-99a7-728afa2be0ab None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:51.620387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b96534-2cdb-4529-803f-868fed82b49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:51.621441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b96534-2cdb-4529-803f-868fed82b49d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.621999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b96534-2cdb-4529-803f-868fed82b49d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.622532 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b96534-2cdb-4529-803f-868fed82b49d None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.623846 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b96534-2cdb-4529-803f-868fed82b49d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:51.624401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b96534-2cdb-4529-803f-868fed82b49d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:51.625981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b96534-2cdb-4529-803f-868fed82b49d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:51.626098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bffe7-0ea5-4703-b6aa-ca83a2037a75 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:51.632185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 393/797] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jun 8 06:28:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:51.633230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b96534-2cdb-4529-803f-868fed82b49d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:51.671373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ea731-6f07-4e10-b6aa-9ee55299d871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:51.673236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ea731-6f07-4e10-b6aa-9ee55299d871 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.673694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ea731-6f07-4e10-b6aa-9ee55299d871 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.674116 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ea731-6f07-4e10-b6aa-9ee55299d871 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.683738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ea731-6f07-4e10-b6aa-9ee55299d871 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:51.685620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ea731-6f07-4e10-b6aa-9ee55299d871 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-3c3ea731-6f07-4e10-b6aa-9ee55299d871 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:51.702299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:51.703572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:51.704617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:51.704617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:51.704617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:51.704617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:51.704617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:51.704617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:51.704617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:51.704617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:51.711768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 405/798] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:51.713727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ea731-6f07-4e10-b6aa-9ee55299d871 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:51.749573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b96534-2cdb-4529-803f-868fed82b49d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:51.763206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:51.785746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441ba7b-f6a3-4d50-80cc-108d0217022e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:51.786686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441ba7b-f6a3-4d50-80cc-108d0217022e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.786951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441ba7b-f6a3-4d50-80cc-108d0217022e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.787230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441ba7b-f6a3-4d50-80cc-108d0217022e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.788464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:51.799916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441ba7b-f6a3-4d50-80cc-108d0217022e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-c441ba7b-f6a3-4d50-80cc-108d0217022e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:51.807814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:51.810070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:51.811107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:51.812028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 394/799] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:51.812992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441ba7b-f6a3-4d50-80cc-108d0217022e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:51.827561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ea731-6f07-4e10-b6aa-9ee55299d871 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:51.864879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49dab2-c0ca-4979-ba62-efb170b960fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:51.865778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49dab2-c0ca-4979-ba62-efb170b960fe None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.866170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49dab2-c0ca-4979-ba62-efb170b960fe None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.866572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49dab2-c0ca-4979-ba62-efb170b960fe None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.867488 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49dab2-c0ca-4979-ba62-efb170b960fe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:51.867902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49dab2-c0ca-4979-ba62-efb170b960fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:51.869478 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49dab2-c0ca-4979-ba62-efb170b960fe None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:51.875364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 406/800] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jun 8 06:28:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:51.876365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49dab2-c0ca-4979-ba62-efb170b960fe None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:51.922632 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441ba7b-f6a3-4d50-80cc-108d0217022e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:51.959962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa44775-b183-4355-bd97-933e9c3ed9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:51.961007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa44775-b183-4355-bd97-933e9c3ed9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:51.961473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa44775-b183-4355-bd97-933e9c3ed9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:51.961975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa44775-b183-4355-bd97-933e9c3ed9f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:51.962981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa44775-b183-4355-bd97-933e9c3ed9f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:51.963471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa44775-b183-4355-bd97-933e9c3ed9f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:51.965208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa44775-b183-4355-bd97-933e9c3ed9f7 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:51.984093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 395/801] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:51.985207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49dab2-c0ca-4979-ba62-efb170b960fe None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:51.985465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa44775-b183-4355-bd97-933e9c3ed9f7 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:52.017066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:52.020468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:52.022573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd618b-2c4c-4bef-ab16-0a54abab2022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:52.023268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd618b-2c4c-4bef-ab16-0a54abab2022 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:52.023550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd618b-2c4c-4bef-ab16-0a54abab2022 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:52.023827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd618b-2c4c-4bef-ab16-0a54abab2022 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:52.024596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd618b-2c4c-4bef-ab16-0a54abab2022 None admin] RBAC: Adding query filter params (name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:52.024906 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd618b-2c4c-4bef-ab16-0a54abab2022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:52.026338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd618b-2c4c-4bef-ab16-0a54abab2022 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:52.037085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 407/802] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:52.037935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd618b-2c4c-4bef-ab16-0a54abab2022 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:52.097044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa44775-b183-4355-bd97-933e9c3ed9f7 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:52.138264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408211e7-94a6-4efe-a5f5-7fcd62e30675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:52.138620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408211e7-94a6-4efe-a5f5-7fcd62e30675 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:52.138867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408211e7-94a6-4efe-a5f5-7fcd62e30675 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:52.142288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408211e7-94a6-4efe-a5f5-7fcd62e30675 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:52.142288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408211e7-94a6-4efe-a5f5-7fcd62e30675 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:52.142288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408211e7-94a6-4efe-a5f5-7fcd62e30675 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:52.157210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd618b-2c4c-4bef-ab16-0a54abab2022 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:52.190667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653a1a8-7204-4b26-9361-533ff5a8e8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:52.191317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653a1a8-7204-4b26-9361-533ff5a8e8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:52.191638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653a1a8-7204-4b26-9361-533ff5a8e8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:52.191894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653a1a8-7204-4b26-9361-533ff5a8e8c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:52.192716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653a1a8-7204-4b26-9361-533ff5a8e8c2 None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=b8661ef27af34bbea11e215831d50843) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:52.193025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653a1a8-7204-4b26-9361-533ff5a8e8c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:52.194489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653a1a8-7204-4b26-9361-533ff5a8e8c2 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:52.200743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 408/803] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:52 2022] GET /identity/v3/role_assignments?user.id=b8661ef27af34bbea11e215831d50843&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:52.201873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc1e2-43c4-4db5-972d-0c2961b38044 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:52.202199 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc1e2-43c4-4db5-972d-0c2961b38044 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:52.202477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc1e2-43c4-4db5-972d-0c2961b38044 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:52.206293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 409/804] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:52.206293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dc1e2-43c4-4db5-972d-0c2961b38044 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:52.234760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 396/805] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jun 8 06:28:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:28:52.236641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75381efe-df96-4a4e-9f49-fb47a0e93233 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:52.237161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75381efe-df96-4a4e-9f49-fb47a0e93233 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:52.237635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75381efe-df96-4a4e-9f49-fb47a0e93233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:52.283525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-75381efe-df96-4a4e-9f49-fb47a0e93233 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:52.285071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-75381efe-df96-4a4e-9f49-fb47a0e93233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:52.291526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:52.371765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dc1e2-43c4-4db5-972d-0c2961b38044 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:52.456025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ff332-13f9-4d6c-b4d5-27d534302179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:52.457436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ff332-13f9-4d6c-b4d5-27d534302179 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:52.457944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ff332-13f9-4d6c-b4d5-27d534302179 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:52.458444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ff332-13f9-4d6c-b4d5-27d534302179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:52.459184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 397/806] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:28:52.477182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ff332-13f9-4d6c-b4d5-27d534302179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:52.479006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ff332-13f9-4d6c-b4d5-27d534302179 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:52.491680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75381efe-df96-4a4e-9f49-fb47a0e93233 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-9d5ff332-13f9-4d6c-b4d5-27d534302179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:52.497860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:52.498758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:52.499645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:52.499645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:52.499645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:52.499645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:52.502817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 410/807] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:52.508775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ff332-13f9-4d6c-b4d5-27d534302179 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:52.518057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:52.637363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75381efe-df96-4a4e-9f49-fb47a0e93233 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:52.664312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ff332-13f9-4d6c-b4d5-27d534302179 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:52.673446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:52.689905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3509625-0958-415e-8f1d-13c118cd438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:52.692600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3509625-0958-415e-8f1d-13c118cd438e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:52.692600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3509625-0958-415e-8f1d-13c118cd438e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:52.692600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3509625-0958-415e-8f1d-13c118cd438e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:52.717357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3509625-0958-415e-8f1d-13c118cd438e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:52.720283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6983d54-75eb-4935-81ed-f4d754cc9e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:52.721009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6983d54-75eb-4935-81ed-f4d754cc9e7d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:52.721298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6983d54-75eb-4935-81ed-f4d754cc9e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:52.721573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6983d54-75eb-4935-81ed-f4d754cc9e7d None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:52.722334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6983d54-75eb-4935-81ed-f4d754cc9e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:52.722644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6983d54-75eb-4935-81ed-f4d754cc9e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:52.724024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6983d54-75eb-4935-81ed-f4d754cc9e7d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-b3509625-0958-415e-8f1d-13c118cd438e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:52.735481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:52.736477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:52.737720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:52.738581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 411/808] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:52.740413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 398/809] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:52.742429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6983d54-75eb-4935-81ed-f4d754cc9e7d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:52.746920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3509625-0958-415e-8f1d-13c118cd438e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:52.828332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:52.859864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3509625-0958-415e-8f1d-13c118cd438e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:52.882207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6983d54-75eb-4935-81ed-f4d754cc9e7d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:52.928595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78612995-71ad-401b-92a5-9614b86cbcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:52.929196 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612995-71ad-401b-92a5-9614b86cbcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:52.929471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612995-71ad-401b-92a5-9614b86cbcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:52.929746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612995-71ad-401b-92a5-9614b86cbcb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:52.930518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78612995-71ad-401b-92a5-9614b86cbcb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:52.930824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78612995-71ad-401b-92a5-9614b86cbcb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:52.932198 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78612995-71ad-401b-92a5-9614b86cbcb6 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:52.944566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 399/810] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:52.952129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78612995-71ad-401b-92a5-9614b86cbcb6 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:52.964950 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bbda0-6d8d-461c-9a1b-2ae15684a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:52.965780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bbda0-6d8d-461c-9a1b-2ae15684a72a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:52.966063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bbda0-6d8d-461c-9a1b-2ae15684a72a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:52.966365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bbda0-6d8d-461c-9a1b-2ae15684a72a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:52.978645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bbda0-6d8d-461c-9a1b-2ae15684a72a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:52.981798 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bbda0-6d8d-461c-9a1b-2ae15684a72a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-f60bbda0-6d8d-461c-9a1b-2ae15684a72a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:53.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:53.003502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:53.005067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:53.005067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:53.005067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:53.005067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:53.005067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:53.005067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:53.005067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:53.005067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:53.005067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:28:53.005067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:53.005067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 412/811] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jun 8 06:28:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:53.009994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bbda0-6d8d-461c-9a1b-2ae15684a72a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:53.050613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:53.165566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78612995-71ad-401b-92a5-9614b86cbcb6 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:53.200434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bbda0-6d8d-461c-9a1b-2ae15684a72a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:53.240360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d07ca0-be2d-4d2b-a419-389c144d133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:53.241161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d07ca0-be2d-4d2b-a419-389c144d133d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:53.241440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d07ca0-be2d-4d2b-a419-389c144d133d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:53.241712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d07ca0-be2d-4d2b-a419-389c144d133d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:53.256580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:53.259275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d07ca0-be2d-4d2b-a419-389c144d133d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:53.260737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d07ca0-be2d-4d2b-a419-389c144d133d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:53.261247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c18ee-41ba-43dc-97e8-8a071598b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:53.262212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c18ee-41ba-43dc-97e8-8a071598b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:53.262721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c18ee-41ba-43dc-97e8-8a071598b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:53.263187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c18ee-41ba-43dc-97e8-8a071598b6d1 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:53.264293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c18ee-41ba-43dc-97e8-8a071598b6d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:53.264835 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c18ee-41ba-43dc-97e8-8a071598b6d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:53.272636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c18ee-41ba-43dc-97e8-8a071598b6d1 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-62d07ca0-be2d-4d2b-a419-389c144d133d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:53.281684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:53.282584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:53.283466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:53.283466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:53.283466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:53.283466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:53.283466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 400/812] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:53.285253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b56edc-9b0d-493b-be7d-454283ba7a5e None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:53.285539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b56edc-9b0d-493b-be7d-454283ba7a5e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:53.285817 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b56edc-9b0d-493b-be7d-454283ba7a5e None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:53.291837 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 401/813] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:53.291837 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b56edc-9b0d-493b-be7d-454283ba7a5e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:53.292056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 413/814] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jun 8 06:28:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:53.296598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f068-b426-47a0-8bac-c06578a36d6d None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:53.296598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f068-b426-47a0-8bac-c06578a36d6d None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:53.296598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f068-b426-47a0-8bac-c06578a36d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:53.312035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-44c0f068-b426-47a0-8bac-c06578a36d6d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:53.313274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-44c0f068-b426-47a0-8bac-c06578a36d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:53.391130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 414/815] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:28:53.392544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0f068-b426-47a0-8bac-c06578a36d6d None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:53.412915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:53.417485 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b56edc-9b0d-493b-be7d-454283ba7a5e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:53.454176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0709664-ca8d-4aaf-8700-8f3a1df10d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:53.454788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0709664-ca8d-4aaf-8700-8f3a1df10d8e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:53.455127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0709664-ca8d-4aaf-8700-8f3a1df10d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:53.455570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0709664-ca8d-4aaf-8700-8f3a1df10d8e None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:53.457143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0709664-ca8d-4aaf-8700-8f3a1df10d8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:53.457454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0709664-ca8d-4aaf-8700-8f3a1df10d8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:53.458958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0709664-ca8d-4aaf-8700-8f3a1df10d8e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:53.477426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 402/816] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:53.478419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0709664-ca8d-4aaf-8700-8f3a1df10d8e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:53.517746 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0f068-b426-47a0-8bac-c06578a36d6d None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:53.536184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:53.561505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691018-c2bf-4fe2-9c86-d7ec54993dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:53.562430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691018-c2bf-4fe2-9c86-d7ec54993dee None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:53.562722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691018-c2bf-4fe2-9c86-d7ec54993dee None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:53.563002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691018-c2bf-4fe2-9c86-d7ec54993dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:53.573584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691018-c2bf-4fe2-9c86-d7ec54993dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:53.575357 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691018-c2bf-4fe2-9c86-d7ec54993dee None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:53.590598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0709664-ca8d-4aaf-8700-8f3a1df10d8e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-ca691018-c2bf-4fe2-9c86-d7ec54993dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:53.594588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:53.595436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:53.596299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:53.596299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:53.596299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:53.596299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:53.596299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 415/817] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:53.596963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691018-c2bf-4fe2-9c86-d7ec54993dee None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:53.639727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cf24a-3e36-4b10-a944-9fa7bd8fa2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:53.641124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cf24a-3e36-4b10-a944-9fa7bd8fa2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:53.641406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cf24a-3e36-4b10-a944-9fa7bd8fa2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:53.641682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cf24a-3e36-4b10-a944-9fa7bd8fa2a2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:53.642389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cf24a-3e36-4b10-a944-9fa7bd8fa2a2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:53.644587 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cf24a-3e36-4b10-a944-9fa7bd8fa2a2 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-768cf24a-3e36-4b10-a944-9fa7bd8fa2a2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:53.664995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:53.667158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:53.668519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 403/818] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:53 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:53.670332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cf24a-3e36-4b10-a944-9fa7bd8fa2a2 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:53.694591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:53.742484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691018-c2bf-4fe2-9c86-d7ec54993dee None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:53.785382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a0cde-55f5-496f-b572-b2971a26db89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:53.786665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a0cde-55f5-496f-b572-b2971a26db89 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:53.787252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a0cde-55f5-496f-b572-b2971a26db89 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:53.787539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a0cde-55f5-496f-b572-b2971a26db89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:53.789010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cf24a-3e36-4b10-a944-9fa7bd8fa2a2 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:53.796328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a0cde-55f5-496f-b572-b2971a26db89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:53.798492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a0cde-55f5-496f-b572-b2971a26db89 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:53.806719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-e42a0cde-55f5-496f-b572-b2971a26db89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:53.819883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:53.822839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 416/819] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:53.823847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a0cde-55f5-496f-b572-b2971a26db89 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:53.829481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd3f70-e263-406c-b427-1a742c0c1ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:53.830306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd3f70-e263-406c-b427-1a742c0c1ddd None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:53.830687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd3f70-e263-406c-b427-1a742c0c1ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:53.831055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd3f70-e263-406c-b427-1a742c0c1ddd None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:53.831883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd3f70-e263-406c-b427-1a742c0c1ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:53.832300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd3f70-e263-406c-b427-1a742c0c1ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:53.833780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd3f70-e263-406c-b427-1a742c0c1ddd None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:53.847177 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 404/820] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:53.848168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd3f70-e263-406c-b427-1a742c0c1ddd None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:53.963576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd3f70-e263-406c-b427-1a742c0c1ddd None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:53.964364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a0cde-55f5-496f-b572-b2971a26db89 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:53.993479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:54.002777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ea85-d163-49de-a5e1-f1f568f490e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:54.019346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ea85-d163-49de-a5e1-f1f568f490e8 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.019346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ea85-d163-49de-a5e1-f1f568f490e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.019346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ea85-d163-49de-a5e1-f1f568f490e8 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.019346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051ea85-d163-49de-a5e1-f1f568f490e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:54.019346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051ea85-d163-49de-a5e1-f1f568f490e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:54.019346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051ea85-d163-49de-a5e1-f1f568f490e8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:54.020149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1cca9-cc77-4a92-a48c-35d8b82d753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:54.020149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1cca9-cc77-4a92-a48c-35d8b82d753d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.020149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1cca9-cc77-4a92-a48c-35d8b82d753d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.020149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1cca9-cc77-4a92-a48c-35d8b82d753d None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.020651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1cca9-cc77-4a92-a48c-35d8b82d753d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:54.020651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1cca9-cc77-4a92-a48c-35d8b82d753d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:54.020651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1cca9-cc77-4a92-a48c-35d8b82d753d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:54.020968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 417/821] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:28:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:54.020968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ea85-d163-49de-a5e1-f1f568f490e8 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:54.034852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 405/822] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jun 8 06:28:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:54.036822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1cca9-cc77-4a92-a48c-35d8b82d753d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:54.084834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:54.144652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ea85-d163-49de-a5e1-f1f568f490e8 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:54.160936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1cca9-cc77-4a92-a48c-35d8b82d753d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:54.188645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1df54a-aea1-4f89-87fd-db5d489c8073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:54.189704 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df54a-aea1-4f89-87fd-db5d489c8073 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.189991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df54a-aea1-4f89-87fd-db5d489c8073 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.190561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df54a-aea1-4f89-87fd-db5d489c8073 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.199053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f5bac-5157-4839-8e70-7dd164396f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:54.199450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1df54a-aea1-4f89-87fd-db5d489c8073 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:54.200161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f5bac-5157-4839-8e70-7dd164396f8b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.200539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f5bac-5157-4839-8e70-7dd164396f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.200840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1df54a-aea1-4f89-87fd-db5d489c8073 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:54.201290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f5bac-5157-4839-8e70-7dd164396f8b None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.201770 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f5bac-5157-4839-8e70-7dd164396f8b None admin] RBAC: Adding query filter params (type=network) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:54.202194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f5bac-5157-4839-8e70-7dd164396f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:54.203709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f5bac-5157-4839-8e70-7dd164396f8b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:54.214828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 406/823] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:28:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:54.215793 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f5bac-5157-4839-8e70-7dd164396f8b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-6c1df54a-aea1-4f89-87fd-db5d489c8073 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:54.216598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:54.218300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:54.220041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:54.220041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:54.220041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:54.220041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:54.220041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:54.220041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:54.220041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:54.220041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:54.226260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 418/824] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:54.226260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1df54a-aea1-4f89-87fd-db5d489c8073 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:54.288456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:54.341992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1df54a-aea1-4f89-87fd-db5d489c8073 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:54.346632 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:54.351428 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f5bac-5157-4839-8e70-7dd164396f8b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:54.381074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d9715-02d6-43f7-923d-fdbd155faf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:54.381764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d9715-02d6-43f7-923d-fdbd155faf84 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.382043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d9715-02d6-43f7-923d-fdbd155faf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.382344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d9715-02d6-43f7-923d-fdbd155faf84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.383188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d9715-02d6-43f7-923d-fdbd155faf84 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:54.384649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d9715-02d6-43f7-923d-fdbd155faf84 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:54.397302 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a33b2-cb40-49d4-83cc-a104adc82e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:54.398495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a33b2-cb40-49d4-83cc-a104adc82e5e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.398981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a33b2-cb40-49d4-83cc-a104adc82e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.399524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a33b2-cb40-49d4-83cc-a104adc82e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.411218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a33b2-cb40-49d4-83cc-a104adc82e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:54.412979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a33b2-cb40-49d4-83cc-a104adc82e5e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-2a7a33b2-cb40-49d4-83cc-a104adc82e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:54.431236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:54.432308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:54.433365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:54.433365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:54.433365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:54.433365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:54.435322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 407/825] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:54.436255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a33b2-cb40-49d4-83cc-a104adc82e5e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:54.455245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 419/826] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jun 8 06:28:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:28:54.462439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d9715-02d6-43f7-923d-fdbd155faf84 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:54.560039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a33b2-cb40-49d4-83cc-a104adc82e5e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:54.625237 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae82a4-aa45-4e77-bc3c-f4e3cff075cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:54.626189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae82a4-aa45-4e77-bc3c-f4e3cff075cf None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.626777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae82a4-aa45-4e77-bc3c-f4e3cff075cf None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.630765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae82a4-aa45-4e77-bc3c-f4e3cff075cf None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.632002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae82a4-aa45-4e77-bc3c-f4e3cff075cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:54.632469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae82a4-aa45-4e77-bc3c-f4e3cff075cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:54.634307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae82a4-aa45-4e77-bc3c-f4e3cff075cf None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:54.660130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d9715-02d6-43f7-923d-fdbd155faf84 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:54.665031 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 408/827] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:54.673394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae82a4-aa45-4e77-bc3c-f4e3cff075cf None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:54.687126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:54.702673 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:54.760408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead06da-68cf-4af7-8f83-8ec877f2994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:54.761086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead06da-68cf-4af7-8f83-8ec877f2994a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.761373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead06da-68cf-4af7-8f83-8ec877f2994a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.761653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead06da-68cf-4af7-8f83-8ec877f2994a None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.762427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead06da-68cf-4af7-8f83-8ec877f2994a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:54.762740 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead06da-68cf-4af7-8f83-8ec877f2994a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:54.764193 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead06da-68cf-4af7-8f83-8ec877f2994a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:54.779324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 420/828] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:54.786203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead06da-68cf-4af7-8f83-8ec877f2994a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:54.825320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae82a4-aa45-4e77-bc3c-f4e3cff075cf None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:54.872515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004841f1-e7b9-429c-b075-d73483f87eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:54.873546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004841f1-e7b9-429c-b075-d73483f87eee None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.873984 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004841f1-e7b9-429c-b075-d73483f87eee None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.874295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004841f1-e7b9-429c-b075-d73483f87eee None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/e9f15c6bec2c4ed99834b2edf1e59947/roles/be311caafffd48cfa80fbe10e110493c` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.894044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004841f1-e7b9-429c-b075-d73483f87eee None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=e9f15c6bec2c4ed99834b2edf1e59947, role_id=be311caafffd48cfa80fbe10e110493c)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:54.895554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004841f1-e7b9-429c-b075-d73483f87eee None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:54.925938 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead06da-68cf-4af7-8f83-8ec877f2994a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:54.959460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d7cdb-2557-4c21-a09d-d87f075639e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:54.960402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7cdb-2557-4c21-a09d-d87f075639e5 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.960686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7cdb-2557-4c21-a09d-d87f075639e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.960948 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7cdb-2557-4c21-a09d-d87f075639e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.967784 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d7cdb-2557-4c21-a09d-d87f075639e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:54.967938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 409/829] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:28:54 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/e9f15c6bec2c4ed99834b2edf1e59947/roles/be311caafffd48cfa80fbe10e110493c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:54.969805 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d7cdb-2557-4c21-a09d-d87f075639e5 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:54.969919 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b971-6c35-4931-b755-346416344bc1 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.970208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b971-6c35-4931-b755-346416344bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.970462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b971-6c35-4931-b755-346416344bc1 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.974216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 410/830] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:54.974216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235f8b4-dfe4-4c6d-92a9-ea9dcd4a4f6f None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.974536 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235f8b4-dfe4-4c6d-92a9-ea9dcd4a4f6f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.975265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235f8b4-dfe4-4c6d-92a9-ea9dcd4a4f6f None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.978287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 411/831] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:54.978287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa90ce-f2c4-4dbc-8777-a4b95268fa28 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.978544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa90ce-f2c4-4dbc-8777-a4b95268fa28 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:54.978772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa90ce-f2c4-4dbc-8777-a4b95268fa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-fb0d7cdb-2557-4c21-a09d-d87f075639e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:54.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:54.996623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:54.998824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:54.998824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:54.998824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:54.998824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:54.998824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:54.998824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:54.998824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:54.998824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:54.998824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 421/832] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:54.998824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0b2a7-395d-44ec-b710-5607e61ce8fc None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:54.998824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0b2a7-395d-44ec-b710-5607e61ce8fc None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:55.000306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0b2a7-395d-44ec-b710-5607e61ce8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:55.010517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-40fa90ce-f2c4-4dbc-8777-a4b95268fa28 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:55.011963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-40fa90ce-f2c4-4dbc-8777-a4b95268fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:55.024491 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-15b0b2a7-395d-44ec-b710-5607e61ce8fc None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:55.026209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-15b0b2a7-395d-44ec-b710-5607e61ce8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:55.052607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:55.077323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:55.102296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 412/833] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:28:55.102296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa90ce-f2c4-4dbc-8777-a4b95268fa28 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:55.126792 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 422/834] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:28:55.128051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0b2a7-395d-44ec-b710-5607e61ce8fc None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:55.234579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa90ce-f2c4-4dbc-8777-a4b95268fa28 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:55.251213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0b2a7-395d-44ec-b710-5607e61ce8fc None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:55.272904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a939a-2ee4-45c5-bbbf-ab44c0442210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:55.273665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a939a-2ee4-45c5-bbbf-ab44c0442210 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:55.274020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a939a-2ee4-45c5-bbbf-ab44c0442210 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:55.274396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a939a-2ee4-45c5-bbbf-ab44c0442210 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:55.275267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a939a-2ee4-45c5-bbbf-ab44c0442210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:55.275650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a939a-2ee4-45c5-bbbf-ab44c0442210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:55.277178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a939a-2ee4-45c5-bbbf-ab44c0442210 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:55.295326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 413/835] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:55.295326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a939a-2ee4-45c5-bbbf-ab44c0442210 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:55.296464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d1188-7746-4c2a-a24a-ac8b8acc8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:55.297363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d1188-7746-4c2a-a24a-ac8b8acc8c3a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:55.297710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d1188-7746-4c2a-a24a-ac8b8acc8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:55.298061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d1188-7746-4c2a-a24a-ac8b8acc8c3a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:55.298819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d1188-7746-4c2a-a24a-ac8b8acc8c3a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:55.300266 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d1188-7746-4c2a-a24a-ac8b8acc8c3a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-503d1188-7746-4c2a-a24a-ac8b8acc8c3a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:55.315820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:55.316985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:55.319036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 423/836] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Jun 8 06:28:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:55.319887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d1188-7746-4c2a-a24a-ac8b8acc8c3a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:55.346257 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:55.357259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:55.425812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a939a-2ee4-45c5-bbbf-ab44c0442210 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:55.438617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d1188-7746-4c2a-a24a-ac8b8acc8c3a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:55.465067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01ab55-0d42-4c31-878b-047d6eea91c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:55.465880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01ab55-0d42-4c31-878b-047d6eea91c5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:55.466164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01ab55-0d42-4c31-878b-047d6eea91c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:55.466474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01ab55-0d42-4c31-878b-047d6eea91c5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:55.468279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01ab55-0d42-4c31-878b-047d6eea91c5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:55.469721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01ab55-0d42-4c31-878b-047d6eea91c5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:55.477663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d3023-06db-44d7-b5a3-0d2b1ee34fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:55.478594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d3023-06db-44d7-b5a3-0d2b1ee34fbe None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:55.478879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d3023-06db-44d7-b5a3-0d2b1ee34fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:55.479151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d3023-06db-44d7-b5a3-0d2b1ee34fbe None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/2130fd9eb8464e95a4fb24083c36427a/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:55.481209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d3023-06db-44d7-b5a3-0d2b1ee34fbe None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=2130fd9eb8464e95a4fb24083c36427a, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-1c01ab55-0d42-4c31-878b-047d6eea91c5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:55.481942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:55.482895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 06:28:55.483736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:55.485236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d3023-06db-44d7-b5a3-0d2b1ee34fbe None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:55.488055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 414/837] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:28:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:55.490113 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01ab55-0d42-4c31-878b-047d6eea91c5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:55.549156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 424/838] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:28:55 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/2130fd9eb8464e95a4fb24083c36427a/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:28:55.550032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d3023-06db-44d7-b5a3-0d2b1ee34fbe None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:55.622623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01ab55-0d42-4c31-878b-047d6eea91c5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:55.638642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:55.672238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:55.680774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ac58a-3ffa-4955-9718-5055114b766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:55.681471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ac58a-3ffa-4955-9718-5055114b766c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:55.681797 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ac58a-3ffa-4955-9718-5055114b766c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:55.682076 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ac58a-3ffa-4955-9718-5055114b766c None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:55.682838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ac58a-3ffa-4955-9718-5055114b766c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:55.683745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ac58a-3ffa-4955-9718-5055114b766c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:55.688409 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ac58a-3ffa-4955-9718-5055114b766c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:55.694400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 415/839] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jun 8 06:28:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:55.698952 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ac58a-3ffa-4955-9718-5055114b766c None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:55.702105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d3023-06db-44d7-b5a3-0d2b1ee34fbe None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:55.747397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb990451-3312-40df-a1b3-d0464c4d1b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:55.748438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb990451-3312-40df-a1b3-d0464c4d1b06 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:55.748900 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb990451-3312-40df-a1b3-d0464c4d1b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:55.749350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb990451-3312-40df-a1b3-d0464c4d1b06 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:55.750873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb990451-3312-40df-a1b3-d0464c4d1b06 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:55.751370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb990451-3312-40df-a1b3-d0464c4d1b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:55.752988 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb990451-3312-40df-a1b3-d0464c4d1b06 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:55.759039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 425/840] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:28:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:55.764368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb990451-3312-40df-a1b3-d0464c4d1b06 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:55.844140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ac58a-3ffa-4955-9718-5055114b766c None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:55.877449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb990451-3312-40df-a1b3-d0464c4d1b06 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:55.881627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e8539-8b60-4327-86c5-b149ea417116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:55.882326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8539-8b60-4327-86c5-b149ea417116 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:55.882616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8539-8b60-4327-86c5-b149ea417116 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:55.882896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8539-8b60-4327-86c5-b149ea417116 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:55.883610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e8539-8b60-4327-86c5-b149ea417116 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:55.883917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e8539-8b60-4327-86c5-b149ea417116 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:55.885527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e8539-8b60-4327-86c5-b149ea417116 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:55.891344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 416/841] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jun 8 06:28:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:55.920428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092d70b-428c-4b83-9efd-28dc547d3dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:55.921284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092d70b-428c-4b83-9efd-28dc547d3dfb None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:55.921705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092d70b-428c-4b83-9efd-28dc547d3dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:55.922102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092d70b-428c-4b83-9efd-28dc547d3dfb None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:55.922935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092d70b-428c-4b83-9efd-28dc547d3dfb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:55.923315 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092d70b-428c-4b83-9efd-28dc547d3dfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:55.924880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092d70b-428c-4b83-9efd-28dc547d3dfb None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:55.931044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 426/842] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:28:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:57.284650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193dfb3-ed8a-453f-8cfd-05f491557668 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:57.285158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193dfb3-ed8a-453f-8cfd-05f491557668 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:57.285265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193dfb3-ed8a-453f-8cfd-05f491557668 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:57.286874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 417/843] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:57.291962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9b2e-74a6-4fe3-ab54-ee8436523585 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:57.292354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9b2e-74a6-4fe3-ab54-ee8436523585 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:57.292516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9b2e-74a6-4fe3-ab54-ee8436523585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:57.309970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-033b9b2e-74a6-4fe3-ab54-ee8436523585 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:57.311182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-033b9b2e-74a6-4fe3-ab54-ee8436523585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:57.313945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:57.380578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 427/844] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:28:57.403553 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193dfb3-ed8a-453f-8cfd-05f491557668 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:57.446605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:57.510515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193dfb3-ed8a-453f-8cfd-05f491557668 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:57.545368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53284092-66e2-4b77-a86f-28cb39c6b9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:57.546175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284092-66e2-4b77-a86f-28cb39c6b9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:57.546529 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284092-66e2-4b77-a86f-28cb39c6b9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:57.547476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284092-66e2-4b77-a86f-28cb39c6b9d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:57.559345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53284092-66e2-4b77-a86f-28cb39c6b9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-53284092-66e2-4b77-a86f-28cb39c6b9d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:57.567368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:57.569478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:57.570595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 418/845] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:57.575352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b9b2e-74a6-4fe3-ab54-ee8436523585 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:57.680028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b9b2e-74a6-4fe3-ab54-ee8436523585 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:57.715044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34cd89-2f2e-4011-b89d-6f6b785fe095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:57.715734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34cd89-2f2e-4011-b89d-6f6b785fe095 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:57.716020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34cd89-2f2e-4011-b89d-6f6b785fe095 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:57.716299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34cd89-2f2e-4011-b89d-6f6b785fe095 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:57.717061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34cd89-2f2e-4011-b89d-6f6b785fe095 None admin] RBAC: Adding query filter params (name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:57.717371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34cd89-2f2e-4011-b89d-6f6b785fe095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:57.719365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34cd89-2f2e-4011-b89d-6f6b785fe095 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:57.724899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:57.728767 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 428/846] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:28:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:57.734966 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53284092-66e2-4b77-a86f-28cb39c6b9d4 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:57.842125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53284092-66e2-4b77-a86f-28cb39c6b9d4 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:57.850458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:57.880566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95388d39-f9b0-4c6e-aefc-4d80872c512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:57.881769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95388d39-f9b0-4c6e-aefc-4d80872c512c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:57.882290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95388d39-f9b0-4c6e-aefc-4d80872c512c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:57.882816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95388d39-f9b0-4c6e-aefc-4d80872c512c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:57.896318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95388d39-f9b0-4c6e-aefc-4d80872c512c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:57.898193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95388d39-f9b0-4c6e-aefc-4d80872c512c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:57.909302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658eb99-3eb7-4820-8300-2f4928030f8b None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:57.909616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658eb99-3eb7-4820-8300-2f4928030f8b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:57.909849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658eb99-3eb7-4820-8300-2f4928030f8b None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:57.915398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 429/847] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:57.916804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8256de-98ba-4121-9231-7da5ff512a78 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:57.917097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8256de-98ba-4121-9231-7da5ff512a78 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:57.917380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8256de-98ba-4121-9231-7da5ff512a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-95388d39-f9b0-4c6e-aefc-4d80872c512c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:57.920269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:57.921135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:57.922104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:57.922104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:57.922104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:57.922104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:57.923698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 419/848] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:57.929176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95388d39-f9b0-4c6e-aefc-4d80872c512c None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:57.936465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-bd8256de-98ba-4121-9231-7da5ff512a78 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:57.937631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-bd8256de-98ba-4121-9231-7da5ff512a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:58.030384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 430/849] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:28:58.046606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95388d39-f9b0-4c6e-aefc-4d80872c512c None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:58.057105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8256de-98ba-4121-9231-7da5ff512a78 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:58.086414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa304aa-ecf9-4fa4-afc5-613f6b65157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:58.087447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa304aa-ecf9-4fa4-afc5-613f6b65157a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.087956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa304aa-ecf9-4fa4-afc5-613f6b65157a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.088546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa304aa-ecf9-4fa4-afc5-613f6b65157a None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.089585 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa304aa-ecf9-4fa4-afc5-613f6b65157a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:58.090106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa304aa-ecf9-4fa4-afc5-613f6b65157a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:58.091705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa304aa-ecf9-4fa4-afc5-613f6b65157a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:58.106120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 420/850] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:58.111137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa304aa-ecf9-4fa4-afc5-613f6b65157a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:58.124615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:58.178652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8256de-98ba-4121-9231-7da5ff512a78 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:58.210383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:58.216396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a2e20-799d-4c29-91c0-f87c1ea041da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:58.217422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a2e20-799d-4c29-91c0-f87c1ea041da None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.217810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a2e20-799d-4c29-91c0-f87c1ea041da None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.218186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a2e20-799d-4c29-91c0-f87c1ea041da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.224060 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa304aa-ecf9-4fa4-afc5-613f6b65157a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:58.229836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a2e20-799d-4c29-91c0-f87c1ea041da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-342a2e20-799d-4c29-91c0-f87c1ea041da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:28:58.237630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:58.238791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:58.239610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 431/851] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:58.240303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240314a-b2ca-422d-ae82-ec4079db78ca None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.240915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240314a-b2ca-422d-ae82-ec4079db78ca None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.240915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240314a-b2ca-422d-ae82-ec4079db78ca None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.246317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 432/852] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:58.246317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240314a-b2ca-422d-ae82-ec4079db78ca None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:58.269334 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113a939-0b24-42e5-bf71-951d6bf5e529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:58.270270 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113a939-0b24-42e5-bf71-951d6bf5e529 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.270540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113a939-0b24-42e5-bf71-951d6bf5e529 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.270819 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113a939-0b24-42e5-bf71-951d6bf5e529 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.278655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113a939-0b24-42e5-bf71-951d6bf5e529 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:58.280826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113a939-0b24-42e5-bf71-951d6bf5e529 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3113a939-0b24-42e5-bf71-951d6bf5e529 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:58.301297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:58.302804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:58.303724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:58.303724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:58.303724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:58.303724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:58.303724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:58.303724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:58.303724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:58.303724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:58.303724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:28:58.303724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:58.306385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 421/853] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jun 8 06:28:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:28:58.307927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c81fb4-1a0d-46fd-9de6-a7abb63a7136 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.308327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c81fb4-1a0d-46fd-9de6-a7abb63a7136 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.308615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c81fb4-1a0d-46fd-9de6-a7abb63a7136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.326026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c8c81fb4-1a0d-46fd-9de6-a7abb63a7136 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:58.327254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c8c81fb4-1a0d-46fd-9de6-a7abb63a7136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:58.357328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240314a-b2ca-422d-ae82-ec4079db78ca None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:58.389717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:58.390003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe1704-ebc9-4074-b757-a640acad7832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:58.391282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe1704-ebc9-4074-b757-a640acad7832 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.391564 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe1704-ebc9-4074-b757-a640acad7832 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.391843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe1704-ebc9-4074-b757-a640acad7832 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.392590 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe1704-ebc9-4074-b757-a640acad7832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:58.392902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe1704-ebc9-4074-b757-a640acad7832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:58.394310 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe1704-ebc9-4074-b757-a640acad7832 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:58.395120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 422/854] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:28:58.395918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c81fb4-1a0d-46fd-9de6-a7abb63a7136 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:58.410447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 433/855] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:28:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:28:58.410447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544d85-dc23-4680-a5c7-030be6afcfac None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.410447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544d85-dc23-4680-a5c7-030be6afcfac None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.410447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544d85-dc23-4680-a5c7-030be6afcfac None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.410447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 434/856] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:28:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:28:58.413862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb544d85-dc23-4680-a5c7-030be6afcfac None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:58.467188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:58.500051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c81fb4-1a0d-46fd-9de6-a7abb63a7136 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:58.513605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb544d85-dc23-4680-a5c7-030be6afcfac None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:58.533643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3e963-1c63-47f4-8939-3bf4156e0f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:58.534340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e963-1c63-47f4-8939-3bf4156e0f01 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.534630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e963-1c63-47f4-8939-3bf4156e0f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.534906 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e963-1c63-47f4-8939-3bf4156e0f01 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.535737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3e963-1c63-47f4-8939-3bf4156e0f01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:58.536041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3e963-1c63-47f4-8939-3bf4156e0f01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:58.537469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3e963-1c63-47f4-8939-3bf4156e0f01 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:58.547018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392a707-7b78-4af2-88d3-efabdbd92a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:58.547820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a707-7b78-4af2-88d3-efabdbd92a51 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.548098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a707-7b78-4af2-88d3-efabdbd92a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.548370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a707-7b78-4af2-88d3-efabdbd92a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.554634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 423/857] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jun 8 06:28:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:58.555825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e1acc-f4f3-4a40-8d6e-c7fd14b3421e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.556115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e1acc-f4f3-4a40-8d6e-c7fd14b3421e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.556392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e1acc-f4f3-4a40-8d6e-c7fd14b3421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.563430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392a707-7b78-4af2-88d3-efabdbd92a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:58.564856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392a707-7b78-4af2-88d3-efabdbd92a51 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:58.572455 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-e68e1acc-f4f3-4a40-8d6e-c7fd14b3421e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:28:58.573692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e68e1acc-f4f3-4a40-8d6e-c7fd14b3421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-4392a707-7b78-4af2-88d3-efabdbd92a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:58.582839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:58.583716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:58.584626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:58.584626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:58.584626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:58.584626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:58.584626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 435/858] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:58.585125 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392a707-7b78-4af2-88d3-efabdbd92a51 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:58.627078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:58.640130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 424/859] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:28:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:28:58.641519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e1acc-f4f3-4a40-8d6e-c7fd14b3421e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:58.684865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392a707-7b78-4af2-88d3-efabdbd92a51 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:58.687740 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:58.718650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d26be2-3c72-40dd-84df-ab8cc2efaa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:58.719420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26be2-3c72-40dd-84df-ab8cc2efaa31 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.719932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26be2-3c72-40dd-84df-ab8cc2efaa31 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.720473 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26be2-3c72-40dd-84df-ab8cc2efaa31 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.721188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d26be2-3c72-40dd-84df-ab8cc2efaa31 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:58.722576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d26be2-3c72-40dd-84df-ab8cc2efaa31 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:58.739529 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e1acc-f4f3-4a40-8d6e-c7fd14b3421e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:58.772129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312a110-c9d9-403f-874e-e89a66dca465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:58.772769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a110-c9d9-403f-874e-e89a66dca465 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.773047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a110-c9d9-403f-874e-e89a66dca465 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.773316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a110-c9d9-403f-874e-e89a66dca465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.795642 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 436/860] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:28:58 2022] POST /identity/v3/services => generated 269 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:28:58.796940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d26be2-3c72-40dd-84df-ab8cc2efaa31 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:58.832151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:58.845940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312a110-c9d9-403f-874e-e89a66dca465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:58.847542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312a110-c9d9-403f-874e-e89a66dca465 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:58.927324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d26be2-3c72-40dd-84df-ab8cc2efaa31 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:58.964736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72af88-0772-4bb6-8be7-48ce42eb4667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:58.964736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72af88-0772-4bb6-8be7-48ce42eb4667 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:58.964736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72af88-0772-4bb6-8be7-48ce42eb4667 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:58.964736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72af88-0772-4bb6-8be7-48ce42eb4667 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:58.965291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72af88-0772-4bb6-8be7-48ce42eb4667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:58.965530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72af88-0772-4bb6-8be7-48ce42eb4667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:58.965900 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 425/861] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:28:58.966953 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72af88-0772-4bb6-8be7-48ce42eb4667 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:58.967240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312a110-c9d9-403f-874e-e89a66dca465 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:58.979361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 437/862] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:58.980137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72af88-0772-4bb6-8be7-48ce42eb4667 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:59.009713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:59.074556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:59.086743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312a110-c9d9-403f-874e-e89a66dca465 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:59.098696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72af88-0772-4bb6-8be7-48ce42eb4667 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:59.122406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71fe48-9b52-4970-82b6-b1690125bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:59.123073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71fe48-9b52-4970-82b6-b1690125bf56 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:59.123352 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71fe48-9b52-4970-82b6-b1690125bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:59.123624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71fe48-9b52-4970-82b6-b1690125bf56 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:59.124337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71fe48-9b52-4970-82b6-b1690125bf56 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:59.125743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71fe48-9b52-4970-82b6-b1690125bf56 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:59.141159 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830ecff-d08e-4f2f-af79-59438d573357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:59.141956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830ecff-d08e-4f2f-af79-59438d573357 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:59.142258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830ecff-d08e-4f2f-af79-59438d573357 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:59.142545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830ecff-d08e-4f2f-af79-59438d573357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:59.153444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830ecff-d08e-4f2f-af79-59438d573357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:59.154951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830ecff-d08e-4f2f-af79-59438d573357 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-1830ecff-d08e-4f2f-af79-59438d573357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:28:59.173100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:59.174157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:59.175611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:28:59.175611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:28:59.175611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:28:59.175611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:59.175611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 438/863] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:59.175611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830ecff-d08e-4f2f-af79-59438d573357 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:59.196494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 426/864] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:28:58 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:28:59.197702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71fe48-9b52-4970-82b6-b1690125bf56 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:59.281329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:59.325799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830ecff-d08e-4f2f-af79-59438d573357 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:59.347677 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71fe48-9b52-4970-82b6-b1690125bf56 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:59.364718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cea68-7d15-47b9-a33b-8306fbe50166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:59.365545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cea68-7d15-47b9-a33b-8306fbe50166 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:59.365826 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cea68-7d15-47b9-a33b-8306fbe50166 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:59.366101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cea68-7d15-47b9-a33b-8306fbe50166 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:59.374873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cea68-7d15-47b9-a33b-8306fbe50166 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:59.376371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cea68-7d15-47b9-a33b-8306fbe50166 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:59.392251 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e906c-09d2-4728-be3c-35084ae148f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-9c4cea68-7d15-47b9-a33b-8306fbe50166 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:28:59.392500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:59.393525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:59.394567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:59.394567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:59.394567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:28:59.394567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:28:59.394567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:28:59.394567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:28:59.394567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:28:59.394567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:28:59.394567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 06:28:59.394567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:28:59.396609 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e906c-09d2-4728-be3c-35084ae148f7 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:59.397130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e906c-09d2-4728-be3c-35084ae148f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:59.397610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e906c-09d2-4728-be3c-35084ae148f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:59.398559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 439/865] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:28:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:59.398967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e906c-09d2-4728-be3c-35084ae148f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:59.399499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cea68-7d15-47b9-a33b-8306fbe50166 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:59.399614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e906c-09d2-4728-be3c-35084ae148f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:59.401430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e906c-09d2-4728-be3c-35084ae148f7 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:59.415893 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 427/866] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:59.421191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e906c-09d2-4728-be3c-35084ae148f7 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:59.425468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:59.516220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cea68-7d15-47b9-a33b-8306fbe50166 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:59.542209 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e906c-09d2-4728-be3c-35084ae148f7 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:59.547477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:59.552909 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bd7c2-ed20-4dcf-9983-1d012f9e4864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:59.553842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bd7c2-ed20-4dcf-9983-1d012f9e4864 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:59.554435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bd7c2-ed20-4dcf-9983-1d012f9e4864 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:59.554948 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bd7c2-ed20-4dcf-9983-1d012f9e4864 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:59.556045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bd7c2-ed20-4dcf-9983-1d012f9e4864 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:59.556561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bd7c2-ed20-4dcf-9983-1d012f9e4864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:59.558224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bd7c2-ed20-4dcf-9983-1d012f9e4864 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:59.577476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 440/867] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jun 8 06:28:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:59.584012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bd7c2-ed20-4dcf-9983-1d012f9e4864 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:59.584491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf15ae-56d9-4c47-921d-61a0d3810807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:59.585486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf15ae-56d9-4c47-921d-61a0d3810807 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:59.585768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf15ae-56d9-4c47-921d-61a0d3810807 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:59.586044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf15ae-56d9-4c47-921d-61a0d3810807 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:59.594892 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf15ae-56d9-4c47-921d-61a0d3810807 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:59.596444 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf15ae-56d9-4c47-921d-61a0d3810807 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-e2cf15ae-56d9-4c47-921d-61a0d3810807 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:28:59.611391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:28:59.612303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:28:59.613199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:28:59.613199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:28:59.613199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:28:59.613199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:28:59.613199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:28:59.613199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:28:59.613199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:28:59.613199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:28:59.617611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 428/868] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:28:59.618656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf15ae-56d9-4c47-921d-61a0d3810807 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:59.687488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:59.695788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bd7c2-ed20-4dcf-9983-1d012f9e4864 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:59.730493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf15ae-56d9-4c47-921d-61a0d3810807 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:59.735125 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cea62-317c-44da-9b53-8d7dc68e7dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:59.736020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cea62-317c-44da-9b53-8d7dc68e7dfa None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:59.736508 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cea62-317c-44da-9b53-8d7dc68e7dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:59.736982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cea62-317c-44da-9b53-8d7dc68e7dfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:59.768154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b2a9e-64e7-4e46-989d-3ed1e9ddfbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:59.768951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2a9e-64e7-4e46-989d-3ed1e9ddfbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:59.769191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2a9e-64e7-4e46-989d-3ed1e9ddfbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:59.769471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2a9e-64e7-4e46-989d-3ed1e9ddfbc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:59.770488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b2a9e-64e7-4e46-989d-3ed1e9ddfbc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:59.770684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b2a9e-64e7-4e46-989d-3ed1e9ddfbc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:59.772174 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b2a9e-64e7-4e46-989d-3ed1e9ddfbc8 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:59.791205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 429/869] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:28:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:28:59.796778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b2a9e-64e7-4e46-989d-3ed1e9ddfbc8 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:59.799773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:59.809500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cea62-317c-44da-9b53-8d7dc68e7dfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:59.811226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cea62-317c-44da-9b53-8d7dc68e7dfa None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:59.908927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b2a9e-64e7-4e46-989d-3ed1e9ddfbc8 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:28:59.912699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 441/870] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:28:59 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 06:28:59.918231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cea62-317c-44da-9b53-8d7dc68e7dfa None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:28:59.935384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:28:59.947833 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efbad5-2af6-431a-95bb-63652e9b3829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:28:59.953339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efbad5-2af6-431a-95bb-63652e9b3829 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:28:59.953339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efbad5-2af6-431a-95bb-63652e9b3829 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:28:59.953339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efbad5-2af6-431a-95bb-63652e9b3829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:28:59.953339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efbad5-2af6-431a-95bb-63652e9b3829 None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=e9f15c6bec2c4ed99834b2edf1e59947) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:28:59.953339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efbad5-2af6-431a-95bb-63652e9b3829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:28:59.953776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efbad5-2af6-431a-95bb-63652e9b3829 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:28:59.962388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 430/871] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:28:59 2022] GET /identity/v3/role_assignments?user.id=e9f15c6bec2c4ed99834b2edf1e59947&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:00.026746 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:00.037621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cea62-317c-44da-9b53-8d7dc68e7dfa None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:00.077012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe84461-b468-44c2-8705-35f9fd632a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:00.080268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe84461-b468-44c2-8705-35f9fd632a6f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:00.080588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe84461-b468-44c2-8705-35f9fd632a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:00.080860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe84461-b468-44c2-8705-35f9fd632a6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:00.092895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe84461-b468-44c2-8705-35f9fd632a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:00.094433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe84461-b468-44c2-8705-35f9fd632a6f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-abe84461-b468-44c2-8705-35f9fd632a6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:00.113534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:00.114532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:00.115441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:00.115441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:00.115441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:00.115441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:00.115441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 442/872] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:00.120835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efbad5-2af6-431a-95bb-63652e9b3829 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:00.233569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efbad5-2af6-431a-95bb-63652e9b3829 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:00.268595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b4a12-68b0-4b26-ab93-65651d63b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:00.269258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b4a12-68b0-4b26-ab93-65651d63b38d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:00.269547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b4a12-68b0-4b26-ab93-65651d63b38d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:00.269824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b4a12-68b0-4b26-ab93-65651d63b38d None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:00.270579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b4a12-68b0-4b26-ab93-65651d63b38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:00.270885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b4a12-68b0-4b26-ab93-65651d63b38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:00.272249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b4a12-68b0-4b26-ab93-65651d63b38d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:00.285526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 431/873] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:00.290979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe84461-b468-44c2-8705-35f9fd632a6f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:00.399780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe84461-b468-44c2-8705-35f9fd632a6f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:00.438839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f8754-7c51-4f96-bfc2-406ab8de9bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:00.439685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f8754-7c51-4f96-bfc2-406ab8de9bcd None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:00.439970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f8754-7c51-4f96-bfc2-406ab8de9bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:00.440245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f8754-7c51-4f96-bfc2-406ab8de9bcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:00.447433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f8754-7c51-4f96-bfc2-406ab8de9bcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:00.448870 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f8754-7c51-4f96-bfc2-406ab8de9bcd None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-464f8754-7c51-4f96-bfc2-406ab8de9bcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:29:00.463442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:00.464396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:00.465351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:29:00.465351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:29:00.465351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:29:00.465351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:29:00.465351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:29:00.465351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:29:00.465351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:00.465351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:00.465351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 443/874] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:00.472064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b4a12-68b0-4b26-ab93-65651d63b38d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:00.526007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:00.582416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b4a12-68b0-4b26-ab93-65651d63b38d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:00.618343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f4869-faf7-48d6-b5b0-13519888555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:00.619333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4869-faf7-48d6-b5b0-13519888555d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:00.619783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4869-faf7-48d6-b5b0-13519888555d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:00.620213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4869-faf7-48d6-b5b0-13519888555d None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:00.621173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f4869-faf7-48d6-b5b0-13519888555d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:00.621632 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f4869-faf7-48d6-b5b0-13519888555d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:00.623223 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f4869-faf7-48d6-b5b0-13519888555d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:00.636108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 432/875] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:00.642357 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f8754-7c51-4f96-bfc2-406ab8de9bcd None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:00.648991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:00.753437 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f8754-7c51-4f96-bfc2-406ab8de9bcd None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:00.788366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd464af1-7e0b-4634-95e4-f7cd6bd75270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:00.789024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd464af1-7e0b-4634-95e4-f7cd6bd75270 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:00.789307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd464af1-7e0b-4634-95e4-f7cd6bd75270 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:00.789585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd464af1-7e0b-4634-95e4-f7cd6bd75270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:00.790451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd464af1-7e0b-4634-95e4-f7cd6bd75270 None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=2130fd9eb8464e95a4fb24083c36427a) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:00.790765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd464af1-7e0b-4634-95e4-f7cd6bd75270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:00.792208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd464af1-7e0b-4634-95e4-f7cd6bd75270 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:00.800009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 444/876] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:29:00 2022] GET /identity/v3/role_assignments?user.id=2130fd9eb8464e95a4fb24083c36427a&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:01.149974 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfe6bf-b993-4ef5-9c33-204ce3a4e055 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:01.150274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfe6bf-b993-4ef5-9c33-204ce3a4e055 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:01.150554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfe6bf-b993-4ef5-9c33-204ce3a4e055 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:01.152048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 433/877] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:01.157526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b673-5993-4ced-a86a-2eea75c0c3d8 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:01.158056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b673-5993-4ced-a86a-2eea75c0c3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:01.158563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b673-5993-4ced-a86a-2eea75c0c3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:01.176452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-09d0b673-5993-4ced-a86a-2eea75c0c3d8 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:01.177971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-09d0b673-5993-4ced-a86a-2eea75c0c3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:01.245968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:01.255475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 445/878] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:01.278297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfe6bf-b993-4ef5-9c33-204ce3a4e055 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:01.387607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfe6bf-b993-4ef5-9c33-204ce3a4e055 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:01.397208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:01.423284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881721cb-91ba-4985-a797-38b0fae56bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:01.424104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881721cb-91ba-4985-a797-38b0fae56bcb None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:01.424421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881721cb-91ba-4985-a797-38b0fae56bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:01.424698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881721cb-91ba-4985-a797-38b0fae56bcb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:01.425349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881721cb-91ba-4985-a797-38b0fae56bcb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:01.426737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881721cb-91ba-4985-a797-38b0fae56bcb None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-881721cb-91ba-4985-a797-38b0fae56bcb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:01.439913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:01.440894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:01.441786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 434/879] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Jun 8 06:29:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:01.447168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0b673-5993-4ced-a86a-2eea75c0c3d8 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:01.556346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0b673-5993-4ced-a86a-2eea75c0c3d8 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:01.572085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f2d00-98c0-427d-bcdd-76dbd8344971 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:01.572582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f2d00-98c0-427d-bcdd-76dbd8344971 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:01.572657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f2d00-98c0-427d-bcdd-76dbd8344971 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:01.575662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 435/880] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:01.579686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808215-3f34-40c5-80df-02f3666c8379 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:01.579984 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808215-3f34-40c5-80df-02f3666c8379 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:01.580262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808215-3f34-40c5-80df-02f3666c8379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:01.592484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aab61c-0763-4b6e-956f-362a44df968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:01.593659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aab61c-0763-4b6e-956f-362a44df968e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:01.593955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aab61c-0763-4b6e-956f-362a44df968e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:01.594228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aab61c-0763-4b6e-956f-362a44df968e None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:01.594965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aab61c-0763-4b6e-956f-362a44df968e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:01.595270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aab61c-0763-4b6e-956f-362a44df968e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:01.596634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aab61c-0763-4b6e-956f-362a44df968e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:01.597765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-fa808215-3f34-40c5-80df-02f3666c8379 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:01.599058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-fa808215-3f34-40c5-80df-02f3666c8379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:01.610268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 446/881] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jun 8 06:29:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:01.615823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aab61c-0763-4b6e-956f-362a44df968e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:01.678679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 436/882] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:01.679333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:01.694867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa808215-3f34-40c5-80df-02f3666c8379 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:01.722505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aab61c-0763-4b6e-956f-362a44df968e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:01.767634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba418ff0-0868-4041-99c5-b4a82f499eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:01.768588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba418ff0-0868-4041-99c5-b4a82f499eed None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:01.768936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba418ff0-0868-4041-99c5-b4a82f499eed None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:01.769219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba418ff0-0868-4041-99c5-b4a82f499eed None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:01.770680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba418ff0-0868-4041-99c5-b4a82f499eed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:01.770999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba418ff0-0868-4041-99c5-b4a82f499eed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:01.772921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba418ff0-0868-4041-99c5-b4a82f499eed None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:01.782319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 447/883] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jun 8 06:29:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:01.786000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba418ff0-0868-4041-99c5-b4a82f499eed None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:01.822348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa808215-3f34-40c5-80df-02f3666c8379 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:01.824498 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:01.860271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cfe49-1773-489c-86db-66ffbf5c7d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:01.861471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cfe49-1773-489c-86db-66ffbf5c7d28 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:01.861964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cfe49-1773-489c-86db-66ffbf5c7d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:01.862496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cfe49-1773-489c-86db-66ffbf5c7d28 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:01.864188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cfe49-1773-489c-86db-66ffbf5c7d28 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:01.865797 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cfe49-1773-489c-86db-66ffbf5c7d28 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3f6cfe49-1773-489c-86db-66ffbf5c7d28 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:01.878290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:01.879427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 06:29:01.880284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:01.883124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 437/884] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:29:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:01.888705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cfe49-1773-489c-86db-66ffbf5c7d28 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:01.894430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba418ff0-0868-4041-99c5-b4a82f499eed None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:01.922276 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:01.937174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0f926-ac6f-4fff-9032-1aa09fbaa2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:01.937174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f926-ac6f-4fff-9032-1aa09fbaa2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:01.937174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f926-ac6f-4fff-9032-1aa09fbaa2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:01.937174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f926-ac6f-4fff-9032-1aa09fbaa2f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:01.937581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0f926-ac6f-4fff-9032-1aa09fbaa2f7 None admin] RBAC: Adding query filter params (interface=public, service_id=6c26325d630140a59b865278e5c5aa94, region_id=RegionOne) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:01.937581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0f926-ac6f-4fff-9032-1aa09fbaa2f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:01.938781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0f926-ac6f-4fff-9032-1aa09fbaa2f7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:01.944915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 448/885] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jun 8 06:29:01 2022] GET /identity/v3/endpoints?service_id=6c26325d630140a59b865278e5c5aa94&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:01.950115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0f926-ac6f-4fff-9032-1aa09fbaa2f7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:02.028364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cfe49-1773-489c-86db-66ffbf5c7d28 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:02.068190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0f926-ac6f-4fff-9032-1aa09fbaa2f7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:02.074899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24cba5-baf9-4701-a1b1-de4606232429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:02.075838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24cba5-baf9-4701-a1b1-de4606232429 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:02.076866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24cba5-baf9-4701-a1b1-de4606232429 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:02.077329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24cba5-baf9-4701-a1b1-de4606232429 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:02.078855 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24cba5-baf9-4701-a1b1-de4606232429 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:02.079806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24cba5-baf9-4701-a1b1-de4606232429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:02.082248 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24cba5-baf9-4701-a1b1-de4606232429 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:02.089392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 438/886] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:29:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:02.095946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24cba5-baf9-4701-a1b1-de4606232429 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:02.108871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7aa3-8297-4518-84f8-d52f65848cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:02.109646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7aa3-8297-4518-84f8-d52f65848cbd None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:02.109936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7aa3-8297-4518-84f8-d52f65848cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:02.110216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7aa3-8297-4518-84f8-d52f65848cbd None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:02.111094 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da7aa3-8297-4518-84f8-d52f65848cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:02.112601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da7aa3-8297-4518-84f8-d52f65848cbd None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:02.130345 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 449/887] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jun 8 06:29:01 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:29:02.148942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:02.233424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24cba5-baf9-4701-a1b1-de4606232429 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:02.271061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebd5fe-786a-4998-90ce-db452c42d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:02.271744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebd5fe-786a-4998-90ce-db452c42d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:02.272068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebd5fe-786a-4998-90ce-db452c42d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:02.272375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebd5fe-786a-4998-90ce-db452c42d2b2 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:02.273107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebd5fe-786a-4998-90ce-db452c42d2b2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:02.273411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebd5fe-786a-4998-90ce-db452c42d2b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:02.274867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebd5fe-786a-4998-90ce-db452c42d2b2 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:02.281114 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 439/888] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:29:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:02.287103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7aa3-8297-4518-84f8-d52f65848cbd None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:02.355226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:02.410366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7aa3-8297-4518-84f8-d52f65848cbd None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:02.447448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea38a9-6999-436f-bb81-dcd34cb0c31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:02.448099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea38a9-6999-436f-bb81-dcd34cb0c31c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:02.448384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea38a9-6999-436f-bb81-dcd34cb0c31c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:02.448663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea38a9-6999-436f-bb81-dcd34cb0c31c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:02.449717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea38a9-6999-436f-bb81-dcd34cb0c31c None admin] RBAC: Adding query filter params (interface=public, service_id=c7b2549e46b94209b29ad7a86386c336, region_id=RegionOne) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:02.450032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea38a9-6999-436f-bb81-dcd34cb0c31c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:02.451465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea38a9-6999-436f-bb81-dcd34cb0c31c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:02.457200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 450/889] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jun 8 06:29:02 2022] GET /identity/v3/endpoints?service_id=c7b2549e46b94209b29ad7a86386c336&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:02.462749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebd5fe-786a-4998-90ce-db452c42d2b2 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:02.523567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f55c-9924-4bd9-b6dd-a8f70c625ef7 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:02.523854 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f55c-9924-4bd9-b6dd-a8f70c625ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:02.524045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f55c-9924-4bd9-b6dd-a8f70c625ef7 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:02.525565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 451/890] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:29:02.531655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a59c4c-52dd-47b5-b58f-4dedd8335f7f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:02.531942 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a59c4c-52dd-47b5-b58f-4dedd8335f7f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:02.532216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a59c4c-52dd-47b5-b58f-4dedd8335f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:02.553081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e0a59c4c-52dd-47b5-b58f-4dedd8335f7f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:02.554579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e0a59c4c-52dd-47b5-b58f-4dedd8335f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:02.571134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:02.578406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebd5fe-786a-4998-90ce-db452c42d2b2 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:02.615910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8599259-df4f-4169-8c1b-6289b2ba4c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:02.616579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599259-df4f-4169-8c1b-6289b2ba4c33 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:02.616859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599259-df4f-4169-8c1b-6289b2ba4c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:02.617129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599259-df4f-4169-8c1b-6289b2ba4c33 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:02.617811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8599259-df4f-4169-8c1b-6289b2ba4c33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:02.619325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8599259-df4f-4169-8c1b-6289b2ba4c33 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:02.631020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 440/891] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jun 8 06:29:02 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:29:02.652846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 452/892] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:02.676685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8599259-df4f-4169-8c1b-6289b2ba4c33 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:02.789285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8599259-df4f-4169-8c1b-6289b2ba4c33 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:02.829841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1770f-556c-42e9-9d3f-f3b74b50eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:02.830713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1770f-556c-42e9-9d3f-f3b74b50eb66 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:02.830996 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1770f-556c-42e9-9d3f-f3b74b50eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:02.831269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1770f-556c-42e9-9d3f-f3b74b50eb66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:02.843998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1770f-556c-42e9-9d3f-f3b74b50eb66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-34c1770f-556c-42e9-9d3f-f3b74b50eb66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:29:02.852226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:02.853205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:02.854028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 441/893] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jun 8 06:29:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:02.860134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a59c4c-52dd-47b5-b58f-4dedd8335f7f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:02.911212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:02.969805 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a59c4c-52dd-47b5-b58f-4dedd8335f7f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:03.012118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf7203-9a52-49a2-87af-da8fc71424a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:03.013035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf7203-9a52-49a2-87af-da8fc71424a4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:03.013534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf7203-9a52-49a2-87af-da8fc71424a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:03.013946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf7203-9a52-49a2-87af-da8fc71424a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:03.014862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf7203-9a52-49a2-87af-da8fc71424a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:03.015339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf7203-9a52-49a2-87af-da8fc71424a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:03.016849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf7203-9a52-49a2-87af-da8fc71424a4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:03.026112 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 453/894] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jun 8 06:29:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:03.032461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1770f-556c-42e9-9d3f-f3b74b50eb66 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:03.053373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:03.147414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1770f-556c-42e9-9d3f-f3b74b50eb66 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:03.160377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91dfe7-e28b-43c7-b9a2-9fdfb7674a55 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:03.160678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91dfe7-e28b-43c7-b9a2-9fdfb7674a55 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:03.160930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91dfe7-e28b-43c7-b9a2-9fdfb7674a55 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:03.162307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 454/895] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:29:03.167160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a218736-4eef-45de-b414-b9911d30a425 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:03.167445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a218736-4eef-45de-b414-b9911d30a425 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:03.167720 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a218736-4eef-45de-b414-b9911d30a425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:03.184645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-8a218736-4eef-45de-b414-b9911d30a425 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:03.184956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0742127-75b5-42b1-ba0f-868b0dc18b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:03.185675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0742127-75b5-42b1-ba0f-868b0dc18b64 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:03.185855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8a218736-4eef-45de-b414-b9911d30a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:03.185973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0742127-75b5-42b1-ba0f-868b0dc18b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:03.186217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0742127-75b5-42b1-ba0f-868b0dc18b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:03.197784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0742127-75b5-42b1-ba0f-868b0dc18b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:03.199512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0742127-75b5-42b1-ba0f-868b0dc18b64 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-b0742127-75b5-42b1-ba0f-868b0dc18b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:03.217655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:03.219158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:03.220065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:03.220065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:03.220065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:03.220065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:03.220065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 442/896] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:03.225296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0742127-75b5-42b1-ba0f-868b0dc18b64 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:03.271576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 455/897] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:03.296752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a218736-4eef-45de-b414-b9911d30a425 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:03.314704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:03.348560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:03.360143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0742127-75b5-42b1-ba0f-868b0dc18b64 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:03.408752 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421eba1-486f-4603-90e9-d02a598667c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:03.410048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421eba1-486f-4603-90e9-d02a598667c9 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:03.410980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421eba1-486f-4603-90e9-d02a598667c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:03.411731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421eba1-486f-4603-90e9-d02a598667c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:03.412655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421eba1-486f-4603-90e9-d02a598667c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:03.413367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421eba1-486f-4603-90e9-d02a598667c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:03.415644 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421eba1-486f-4603-90e9-d02a598667c9 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:03.416981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a218736-4eef-45de-b414-b9911d30a425 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:03.437889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 443/898] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:03.438537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421eba1-486f-4603-90e9-d02a598667c9 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:03.461127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bf827-cad8-400c-be5e-5e20fa936c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:03.461955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bf827-cad8-400c-be5e-5e20fa936c19 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:03.462287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bf827-cad8-400c-be5e-5e20fa936c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:03.462533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bf827-cad8-400c-be5e-5e20fa936c19 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:03.463293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bf827-cad8-400c-be5e-5e20fa936c19 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:03.464771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bf827-cad8-400c-be5e-5e20fa936c19 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-ce6bf827-cad8-400c-be5e-5e20fa936c19 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:03.477598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:03.478652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:03.479575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:03.484585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 456/899] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jun 8 06:29:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:03.485472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bf827-cad8-400c-be5e-5e20fa936c19 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:03.575500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421eba1-486f-4603-90e9-d02a598667c9 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:03.601002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bf827-cad8-400c-be5e-5e20fa936c19 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:03.602659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:03.615080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:03.621962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4468c-8846-45c8-813c-ed3f97bf3189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:03.636475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4468c-8846-45c8-813c-ed3f97bf3189 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:03.636475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4468c-8846-45c8-813c-ed3f97bf3189 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:03.636475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4468c-8846-45c8-813c-ed3f97bf3189 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:03.636475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4468c-8846-45c8-813c-ed3f97bf3189 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:03.636475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4468c-8846-45c8-813c-ed3f97bf3189 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:03.638188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596406-2f76-4a70-8065-e739c6c16229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:03.639120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596406-2f76-4a70-8065-e739c6c16229 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:03.639601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596406-2f76-4a70-8065-e739c6c16229 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:03.640136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596406-2f76-4a70-8065-e739c6c16229 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:03.641050 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596406-2f76-4a70-8065-e739c6c16229 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:03.641552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596406-2f76-4a70-8065-e739c6c16229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:03.643147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596406-2f76-4a70-8065-e739c6c16229 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-bbf4468c-8846-45c8-813c-ed3f97bf3189 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:29:03.652236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:03.653188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:03.654130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:03.654130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:03.654130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:29:03.654130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:29:03.654130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:29:03.654130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:29:03.654130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:29:03.654130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:29:03.654130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:29:03.654130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:03.655496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 457/901] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jun 8 06:29:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:03.657488 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596406-2f76-4a70-8065-e739c6c16229 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:03.658943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 444/901] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jun 8 06:29:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:03.663521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4468c-8846-45c8-813c-ed3f97bf3189 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:03.767861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596406-2f76-4a70-8065-e739c6c16229 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:03.793625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4468c-8846-45c8-813c-ed3f97bf3189 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:03.805680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee25eaa-1afa-4865-a4a1-f541f81a7a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:03.806700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee25eaa-1afa-4865-a4a1-f541f81a7a04 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:03.807136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee25eaa-1afa-4865-a4a1-f541f81a7a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:03.807553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee25eaa-1afa-4865-a4a1-f541f81a7a04 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:03.808547 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee25eaa-1afa-4865-a4a1-f541f81a7a04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:03.809032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee25eaa-1afa-4865-a4a1-f541f81a7a04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:03.810737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee25eaa-1afa-4865-a4a1-f541f81a7a04 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:03.821010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 458/902] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jun 8 06:29:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:03.835524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee7f9d-6b8e-46c0-9a91-ae30b0a670b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:03.836187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee7f9d-6b8e-46c0-9a91-ae30b0a670b9 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:03.836471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee7f9d-6b8e-46c0-9a91-ae30b0a670b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:03.836744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee7f9d-6b8e-46c0-9a91-ae30b0a670b9 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:03.837644 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee7f9d-6b8e-46c0-9a91-ae30b0a670b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:03.837949 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee7f9d-6b8e-46c0-9a91-ae30b0a670b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:03.839499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee7f9d-6b8e-46c0-9a91-ae30b0a670b9 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:03.861800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 445/903] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jun 8 06:29:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:03.867487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee25eaa-1afa-4865-a4a1-f541f81a7a04 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:03.903929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:03.985433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee25eaa-1afa-4865-a4a1-f541f81a7a04 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:04.024963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38b849-ee06-4fcb-81d7-e384ec8c2d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:04.025622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38b849-ee06-4fcb-81d7-e384ec8c2d01 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:04.025903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38b849-ee06-4fcb-81d7-e384ec8c2d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:04.026186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38b849-ee06-4fcb-81d7-e384ec8c2d01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:04.102261 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38b849-ee06-4fcb-81d7-e384ec8c2d01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:04.104078 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38b849-ee06-4fcb-81d7-e384ec8c2d01 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:04.138506 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:04.217534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 459/904] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:29:03 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:29:04.223597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee7f9d-6b8e-46c0-9a91-ae30b0a670b9 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:04.275945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:04.328104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee7f9d-6b8e-46c0-9a91-ae30b0a670b9 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:04.363453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d588e-6dbf-43df-b991-9860d19b79a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:04.364609 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d588e-6dbf-43df-b991-9860d19b79a9 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:04.365089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d588e-6dbf-43df-b991-9860d19b79a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:04.365554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d588e-6dbf-43df-b991-9860d19b79a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:04.376973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d588e-6dbf-43df-b991-9860d19b79a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:04.378732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d588e-6dbf-43df-b991-9860d19b79a9 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-f03d588e-6dbf-43df-b991-9860d19b79a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:04.397346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:04.398472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:04.399544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:04.399544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:04.399544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:04.399544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:04.401376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 446/905] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:04.407026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38b849-ee06-4fcb-81d7-e384ec8c2d01 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:04.512775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38b849-ee06-4fcb-81d7-e384ec8c2d01 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:04.514452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e9ad0-7480-4a2f-9c44-6d2ecefde431 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:04.514743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e9ad0-7480-4a2f-9c44-6d2ecefde431 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:04.515085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e9ad0-7480-4a2f-9c44-6d2ecefde431 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:04.517193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 447/906] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:04.522507 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644be596-2b4b-487c-b2da-bda3e989aff3 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:04.523052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644be596-2b4b-487c-b2da-bda3e989aff3 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:04.523530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644be596-2b4b-487c-b2da-bda3e989aff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:04.541274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-644be596-2b4b-487c-b2da-bda3e989aff3 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:04.542496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-644be596-2b4b-487c-b2da-bda3e989aff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:04.543439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:04.549894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae660b8b-a230-4661-817d-4455371d4e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:04.550704 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae660b8b-a230-4661-817d-4455371d4e3b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:04.551054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae660b8b-a230-4661-817d-4455371d4e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:04.551442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae660b8b-a230-4661-817d-4455371d4e3b None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:04.552175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae660b8b-a230-4661-817d-4455371d4e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:04.552481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae660b8b-a230-4661-817d-4455371d4e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:04.553966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae660b8b-a230-4661-817d-4455371d4e3b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:04.567400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 460/907] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:04.573362 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae660b8b-a230-4661-817d-4455371d4e3b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:04.626264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 448/908] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:04.649760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644be596-2b4b-487c-b2da-bda3e989aff3 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:04.682497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:04.690013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae660b8b-a230-4661-817d-4455371d4e3b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:04.726347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4afd2-5d96-423c-8daa-57e20d7bd921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:04.727399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4afd2-5d96-423c-8daa-57e20d7bd921 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:04.727829 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4afd2-5d96-423c-8daa-57e20d7bd921 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:04.728273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4afd2-5d96-423c-8daa-57e20d7bd921 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:04.737469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4afd2-5d96-423c-8daa-57e20d7bd921 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:04.739188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4afd2-5d96-423c-8daa-57e20d7bd921 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-30a4afd2-5d96-423c-8daa-57e20d7bd921 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:29:04.755575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:04.756516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:04.757401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:29:04.757401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:29:04.757401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:29:04.757401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:29:04.757401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:29:04.757401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:29:04.757401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:04.757401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:04.757837 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644be596-2b4b-487c-b2da-bda3e989aff3 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:04.759901 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 461/909] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:04.767997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4afd2-5d96-423c-8daa-57e20d7bd921 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:04.791024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103cc8f-5bfa-4af9-b154-45a8cde4e407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:04.791729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103cc8f-5bfa-4af9-b154-45a8cde4e407 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:04.792008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103cc8f-5bfa-4af9-b154-45a8cde4e407 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:04.792274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103cc8f-5bfa-4af9-b154-45a8cde4e407 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:04.792972 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103cc8f-5bfa-4af9-b154-45a8cde4e407 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:04.794290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103cc8f-5bfa-4af9-b154-45a8cde4e407 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-d103cc8f-5bfa-4af9-b154-45a8cde4e407 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:04.806976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:04.807916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:04.808775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 449/910] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Jun 8 06:29:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:04.814599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103cc8f-5bfa-4af9-b154-45a8cde4e407 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:04.825664 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:04.881039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4afd2-5d96-423c-8daa-57e20d7bd921 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:04.917757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:04.920415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b1850-4107-4fc6-88d3-bc000409395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:04.921359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1850-4107-4fc6-88d3-bc000409395f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:04.921844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1850-4107-4fc6-88d3-bc000409395f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:04.922350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1850-4107-4fc6-88d3-bc000409395f None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:04.923431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b1850-4107-4fc6-88d3-bc000409395f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:04.923953 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b1850-4107-4fc6-88d3-bc000409395f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:04.924433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103cc8f-5bfa-4af9-b154-45a8cde4e407 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:04.925872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b1850-4107-4fc6-88d3-bc000409395f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:04.945299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 462/911] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:04.947765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b1850-4107-4fc6-88d3-bc000409395f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:04.961733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef6a07-8a55-4ceb-96cc-cf8ec9430c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:04.962514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef6a07-8a55-4ceb-96cc-cf8ec9430c82 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:04.962799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef6a07-8a55-4ceb-96cc-cf8ec9430c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:04.963076 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef6a07-8a55-4ceb-96cc-cf8ec9430c82 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:04.963788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef6a07-8a55-4ceb-96cc-cf8ec9430c82 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:04.964093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef6a07-8a55-4ceb-96cc-cf8ec9430c82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:04.965623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef6a07-8a55-4ceb-96cc-cf8ec9430c82 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:04.976133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 450/912] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jun 8 06:29:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:04.977618 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef6a07-8a55-4ceb-96cc-cf8ec9430c82 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:05.058800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b1850-4107-4fc6-88d3-bc000409395f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:05.071011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:05.088594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef6a07-8a55-4ceb-96cc-cf8ec9430c82 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:05.098068 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ae77b-d8c2-4f2e-a952-272a48fa4aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:05.099073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ae77b-d8c2-4f2e-a952-272a48fa4aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:05.099354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ae77b-d8c2-4f2e-a952-272a48fa4aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:05.099938 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ae77b-d8c2-4f2e-a952-272a48fa4aa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:05.101057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ae77b-d8c2-4f2e-a952-272a48fa4aa1 None admin] RBAC: Adding query filter params (role.id=a0f92bdf90fe4ea48797ef8120146bf3, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=e9f15c6bec2c4ed99834b2edf1e59947) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:05.101375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ae77b-d8c2-4f2e-a952-272a48fa4aa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:05.103329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ae77b-d8c2-4f2e-a952-272a48fa4aa1 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:05.118279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 463/913] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:29:04 2022] GET /identity/v3/role_assignments?user.id=e9f15c6bec2c4ed99834b2edf1e59947&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=a0f92bdf90fe4ea48797ef8120146bf3 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:05.118279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1435f28-d113-4687-a971-ff08004bcd77 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:05.118279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1435f28-d113-4687-a971-ff08004bcd77 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:05.118279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1435f28-d113-4687-a971-ff08004bcd77 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:05.118279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 464/914] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:05.119666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03216c82-9ac8-4c81-b854-c38e045247ac None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:05.122316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03216c82-9ac8-4c81-b854-c38e045247ac None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:05.122708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03216c82-9ac8-4c81-b854-c38e045247ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:05.135364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa336d61-db89-4f47-a3a0-945e3fc68283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:05.135970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa336d61-db89-4f47-a3a0-945e3fc68283 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:05.136255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa336d61-db89-4f47-a3a0-945e3fc68283 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:05.136532 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa336d61-db89-4f47-a3a0-945e3fc68283 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:05.137263 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa336d61-db89-4f47-a3a0-945e3fc68283 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:05.137574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa336d61-db89-4f47-a3a0-945e3fc68283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:05.139047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa336d61-db89-4f47-a3a0-945e3fc68283 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:05.145554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 451/915] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jun 8 06:29:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:05.151295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-03216c82-9ac8-4c81-b854-c38e045247ac None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:05.151489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa336d61-db89-4f47-a3a0-945e3fc68283 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:05.152501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-03216c82-9ac8-4c81-b854-c38e045247ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:05.180344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:05.266262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 465/916] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:05.309444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03216c82-9ac8-4c81-b854-c38e045247ac None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:05.317184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa336d61-db89-4f47-a3a0-945e3fc68283 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:05.399490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f14d9-6615-40dd-b48a-855111d16884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:05.400066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f14d9-6615-40dd-b48a-855111d16884 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:05.400342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f14d9-6615-40dd-b48a-855111d16884 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:05.400613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f14d9-6615-40dd-b48a-855111d16884 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:05.401359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f14d9-6615-40dd-b48a-855111d16884 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:05.402944 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f14d9-6615-40dd-b48a-855111d16884 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:05.443358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03216c82-9ac8-4c81-b854-c38e045247ac None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:05.446284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:05.480838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58023673-72cd-440a-bd82-47d1882d7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:05.481687 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58023673-72cd-440a-bd82-47d1882d7010 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:05.489207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58023673-72cd-440a-bd82-47d1882d7010 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:05.489207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58023673-72cd-440a-bd82-47d1882d7010 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:05.489207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58023673-72cd-440a-bd82-47d1882d7010 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:05.489207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58023673-72cd-440a-bd82-47d1882d7010 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-58023673-72cd-440a-bd82-47d1882d7010 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:05.497371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:05.498401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 06:29:05.499252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:05.504375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 466/917] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:29:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:05.505241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58023673-72cd-440a-bd82-47d1882d7010 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:05.522342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 452/918] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jun 8 06:29:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:29:05.713856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58023673-72cd-440a-bd82-47d1882d7010 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:05.788098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac72d4-b2f3-4f7b-a822-99c9dbdca5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:05.789042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac72d4-b2f3-4f7b-a822-99c9dbdca5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:05.789467 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac72d4-b2f3-4f7b-a822-99c9dbdca5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:05.789883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac72d4-b2f3-4f7b-a822-99c9dbdca5b1 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:05.790756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac72d4-b2f3-4f7b-a822-99c9dbdca5b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:05.791201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac72d4-b2f3-4f7b-a822-99c9dbdca5b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:05.792764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac72d4-b2f3-4f7b-a822-99c9dbdca5b1 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:05.801015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 467/919] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:29:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:05.806842 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f14d9-6615-40dd-b48a-855111d16884 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:05.903701 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:05.927811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f14d9-6615-40dd-b48a-855111d16884 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:05.962728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7e7f1-99e2-4e83-8f52-4a406bd13289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:05.963397 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7e7f1-99e2-4e83-8f52-4a406bd13289 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:05.963686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7e7f1-99e2-4e83-8f52-4a406bd13289 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:05.964012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7e7f1-99e2-4e83-8f52-4a406bd13289 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:05.964674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7e7f1-99e2-4e83-8f52-4a406bd13289 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:05.964978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7e7f1-99e2-4e83-8f52-4a406bd13289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:05.966490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7e7f1-99e2-4e83-8f52-4a406bd13289 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:05.972543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 453/920] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jun 8 06:29:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:05.978058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac72d4-b2f3-4f7b-a822-99c9dbdca5b1 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:06.008114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:06.081039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac72d4-b2f3-4f7b-a822-99c9dbdca5b1 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:06.116680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a16bef-2da1-4165-b6e5-15959536d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:06.117718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16bef-2da1-4165-b6e5-15959536d646 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:06.118198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16bef-2da1-4165-b6e5-15959536d646 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:06.118709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16bef-2da1-4165-b6e5-15959536d646 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:06.119646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a16bef-2da1-4165-b6e5-15959536d646 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:06.126760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a16bef-2da1-4165-b6e5-15959536d646 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:06.228925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0cfa3-e9cc-4b70-b7cc-2797942201b0 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:06.229101 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0cfa3-e9cc-4b70-b7cc-2797942201b0 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:06.229382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0cfa3-e9cc-4b70-b7cc-2797942201b0 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:06.231175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 454/921] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:29:06.236427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818bcd-cd8c-4dc0-96af-085b753802c5 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:06.236712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818bcd-cd8c-4dc0-96af-085b753802c5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:06.237071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818bcd-cd8c-4dc0-96af-085b753802c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:06.239433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 468/922] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jun 8 06:29:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:29:06.257525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-05818bcd-cd8c-4dc0-96af-085b753802c5 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:06.258901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-05818bcd-cd8c-4dc0-96af-085b753802c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:06.348761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 455/923] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:06.370989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a16bef-2da1-4165-b6e5-15959536d646 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:06.464011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:06.481468 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a16bef-2da1-4165-b6e5-15959536d646 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:06.516776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e3092-1793-4188-b2a6-51bde61c8e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:06.517448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e3092-1793-4188-b2a6-51bde61c8e1a None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:06.517759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e3092-1793-4188-b2a6-51bde61c8e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:06.518041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e3092-1793-4188-b2a6-51bde61c8e1a None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:06.518802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e3092-1793-4188-b2a6-51bde61c8e1a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:06.520232 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e3092-1793-4188-b2a6-51bde61c8e1a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:06.569468 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 469/924] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:29:06 2022] POST /identity/v3/services => generated 241 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:29:07.516215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef64d03-bb72-4b94-a0e3-c142d5e03889 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:07.516215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef64d03-bb72-4b94-a0e3-c142d5e03889 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:07.516215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef64d03-bb72-4b94-a0e3-c142d5e03889 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:07.516215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 456/925] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:07.520214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af11d09-13b5-4f8c-b138-f7048975b9c4 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:07.520601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af11d09-13b5-4f8c-b138-f7048975b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:07.520776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af11d09-13b5-4f8c-b138-f7048975b9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:07.538571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0af11d09-13b5-4f8c-b138-f7048975b9c4 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:07.539766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0af11d09-13b5-4f8c-b138-f7048975b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:07.627051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 470/926] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:07.652582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef64d03-bb72-4b94-a0e3-c142d5e03889 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:07.725591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:07.761430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef64d03-bb72-4b94-a0e3-c142d5e03889 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:07.797791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf585d0-2456-4c52-9437-486f692a8f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:07.798598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf585d0-2456-4c52-9437-486f692a8f2c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:07.798883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf585d0-2456-4c52-9437-486f692a8f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:07.799215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf585d0-2456-4c52-9437-486f692a8f2c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:07.810175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf585d0-2456-4c52-9437-486f692a8f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-acf585d0-2456-4c52-9437-486f692a8f2c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:29:07.818872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:07.819942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:07.821061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 457/927] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jun 8 06:29:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:07.826615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af11d09-13b5-4f8c-b138-f7048975b9c4 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:07.897763 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:07.920311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171bf3-c6e7-47f3-9bef-117b68e9fba4 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:07.920639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171bf3-c6e7-47f3-9bef-117b68e9fba4 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:07.920868 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171bf3-c6e7-47f3-9bef-117b68e9fba4 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:07.923239 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 458/928] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:07.928306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03cc20-bd4b-4034-94bf-bc02835aa619 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:07.928802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03cc20-bd4b-4034-94bf-bc02835aa619 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:07.929281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03cc20-bd4b-4034-94bf-bc02835aa619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:07.935430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af11d09-13b5-4f8c-b138-f7048975b9c4 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:07.948161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9e03cc20-bd4b-4034-94bf-bc02835aa619 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:07.949874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9e03cc20-bd4b-4034-94bf-bc02835aa619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:07.979388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3637d-bd63-4b1d-a1ae-b7d0b564bccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:07.980354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3637d-bd63-4b1d-a1ae-b7d0b564bccc None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:07.980643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3637d-bd63-4b1d-a1ae-b7d0b564bccc None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:07.980920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3637d-bd63-4b1d-a1ae-b7d0b564bccc None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:07.981692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3637d-bd63-4b1d-a1ae-b7d0b564bccc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:07.982002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3637d-bd63-4b1d-a1ae-b7d0b564bccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:07.984784 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3637d-bd63-4b1d-a1ae-b7d0b564bccc None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:07.998319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 471/929] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jun 8 06:29:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:08.002358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3637d-bd63-4b1d-a1ae-b7d0b564bccc None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:08.034269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 459/930] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:08.055421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03cc20-bd4b-4034-94bf-bc02835aa619 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:08.115868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3637d-bd63-4b1d-a1ae-b7d0b564bccc None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:08.127352 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:08.156863 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dba213-7880-49fa-97f8-5547a760fc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:08.158063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dba213-7880-49fa-97f8-5547a760fc8b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:08.158725 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dba213-7880-49fa-97f8-5547a760fc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:08.159223 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dba213-7880-49fa-97f8-5547a760fc8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:08.174459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:08.174952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dba213-7880-49fa-97f8-5547a760fc8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:08.176612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dba213-7880-49fa-97f8-5547a760fc8b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:08.176990 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03cc20-bd4b-4034-94bf-bc02835aa619 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-58dba213-7880-49fa-97f8-5547a760fc8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:08.198291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:08.199520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:08.200426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:08.200426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:08.200426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:08.200426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:08.202696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 472/931] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:08.208898 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dba213-7880-49fa-97f8-5547a760fc8b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:08.226591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9140df-08af-4416-a48c-3244378c4fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:08.227731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9140df-08af-4416-a48c-3244378c4fce None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:08.228238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9140df-08af-4416-a48c-3244378c4fce None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:08.228715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9140df-08af-4416-a48c-3244378c4fce None admin] PATH_INFO: `/v3/services/compute` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:08.229568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9140df-08af-4416-a48c-3244378c4fce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:08.231229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9140df-08af-4416-a48c-3244378c4fce None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3d9140df-08af-4416-a48c-3244378c4fce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:08.244580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:08.245577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 06:29:08.246442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:08.254085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 460/932] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:29:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:08.255336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9140df-08af-4416-a48c-3244378c4fce None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:08.347061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dba213-7880-49fa-97f8-5547a760fc8b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:08.372520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9140df-08af-4416-a48c-3244378c4fce None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:08.391919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdc3d9-cb36-4278-918a-72b3e8d37f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:08.392918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdc3d9-cb36-4278-918a-72b3e8d37f2b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:08.393468 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdc3d9-cb36-4278-918a-72b3e8d37f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:08.394085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdc3d9-cb36-4278-918a-72b3e8d37f2b None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:08.395081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdc3d9-cb36-4278-918a-72b3e8d37f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:08.395606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdc3d9-cb36-4278-918a-72b3e8d37f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:08.396851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:08.398415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdc3d9-cb36-4278-918a-72b3e8d37f2b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:08.411185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cc50c-706c-473d-8495-3731b306cdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:08.411859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cc50c-706c-473d-8495-3731b306cdec None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:08.412144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cc50c-706c-473d-8495-3731b306cdec None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:08.412419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cc50c-706c-473d-8495-3731b306cdec None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:08.413567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cc50c-706c-473d-8495-3731b306cdec None admin] RBAC: Adding query filter params (name=compute) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:08.413773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cc50c-706c-473d-8495-3731b306cdec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:08.414269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 473/933] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:08.419506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cc50c-706c-473d-8495-3731b306cdec None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:08.419778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdc3d9-cb36-4278-918a-72b3e8d37f2b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:08.429692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 461/934] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:29:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:08.431260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cc50c-706c-473d-8495-3731b306cdec None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:08.478823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:08.540699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cc50c-706c-473d-8495-3731b306cdec None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:08.558104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdc3d9-cb36-4278-918a-72b3e8d37f2b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:08.582160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56eb35-7206-4f30-811d-51944896e4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:08.583222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56eb35-7206-4f30-811d-51944896e4ed None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:08.583737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56eb35-7206-4f30-811d-51944896e4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:08.584214 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56eb35-7206-4f30-811d-51944896e4ed None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:08.585674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56eb35-7206-4f30-811d-51944896e4ed None admin] RBAC: Adding query filter params (type=compute) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:08.586488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56eb35-7206-4f30-811d-51944896e4ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:08.588742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56eb35-7206-4f30-811d-51944896e4ed None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:08.602528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 462/935] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:29:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:08.607565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f5d65-5e8b-4921-9f8e-d48c4bb40e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:08.608506 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5d65-5e8b-4921-9f8e-d48c4bb40e57 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:08.608794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5d65-5e8b-4921-9f8e-d48c4bb40e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:08.609069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f5d65-5e8b-4921-9f8e-d48c4bb40e57 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:08.618077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f5d65-5e8b-4921-9f8e-d48c4bb40e57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:08.619667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f5d65-5e8b-4921-9f8e-d48c4bb40e57 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:08.632386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbe035-e6c5-4693-b5a1-5debd29295eb None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:08.632692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbe035-e6c5-4693-b5a1-5debd29295eb None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:08.632949 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbe035-e6c5-4693-b5a1-5debd29295eb None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-ef5f5d65-5e8b-4921-9f8e-d48c4bb40e57 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:29:08.636518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:08.637479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:08.638449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:08.638449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:08.638449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:29:08.638449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:29:08.638449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:29:08.638449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:29:08.638449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:29:08.638449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:29:08.638449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:29:08.638449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:08.638449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 474/936] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jun 8 06:29:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:08.639046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 463/937] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:29:08.640751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dd40c-45aa-4eaf-8b7d-91f1eddbe8c6 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:08.641345 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dd40c-45aa-4eaf-8b7d-91f1eddbe8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:08.641619 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dd40c-45aa-4eaf-8b7d-91f1eddbe8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:08.644282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbe035-e6c5-4693-b5a1-5debd29295eb None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:08.662557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-375dd40c-45aa-4eaf-8b7d-91f1eddbe8c6 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:08.663854 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-375dd40c-45aa-4eaf-8b7d-91f1eddbe8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:08.703739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:08.750644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 475/938] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:08.769568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbe035-e6c5-4693-b5a1-5debd29295eb None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:08.776410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dd40c-45aa-4eaf-8b7d-91f1eddbe8c6 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:08.812473 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:08.814416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26df55e-d552-4cf7-8cd6-e4effa7a60f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:08.815415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26df55e-d552-4cf7-8cd6-e4effa7a60f4 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:08.815896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26df55e-d552-4cf7-8cd6-e4effa7a60f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:08.816369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26df55e-d552-4cf7-8cd6-e4effa7a60f4 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:08.817476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26df55e-d552-4cf7-8cd6-e4effa7a60f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:08.817986 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26df55e-d552-4cf7-8cd6-e4effa7a60f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:08.819729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26df55e-d552-4cf7-8cd6-e4effa7a60f4 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:08.839987 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 464/939] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jun 8 06:29:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:08.845361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26df55e-d552-4cf7-8cd6-e4effa7a60f4 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:08.896925 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dd40c-45aa-4eaf-8b7d-91f1eddbe8c6 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:08.931985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dc2dd-a263-47d2-9f46-396d03528efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:08.932649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dc2dd-a263-47d2-9f46-396d03528efc None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:08.932935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dc2dd-a263-47d2-9f46-396d03528efc None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:08.933213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dc2dd-a263-47d2-9f46-396d03528efc None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:08.933922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dc2dd-a263-47d2-9f46-396d03528efc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:08.935382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dc2dd-a263-47d2-9f46-396d03528efc None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:08.937285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: WARNING keystone.server.flask.common [None req-150dc2dd-a263-47d2-9f46-396d03528efc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 08 06:29:08.956855 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26df55e-d552-4cf7-8cd6-e4effa7a60f4 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:08.966848 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:08.989558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.sql.core [None req-150dc2dd-a263-47d2-9f46-396d03528efc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 06:29:08.989558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 08 06:29:08.989558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [parameters: {'id': 'd9b40486b5dc4ad4923a1441839b0271', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 08 06:29:08.989558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80764) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 06:29:08.990720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ee965-8b95-4526-868d-da4b60bd9edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:08.991515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ee965-8b95-4526-868d-da4b60bd9edb None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:08.991783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ee965-8b95-4526-868d-da4b60bd9edb None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:08.992051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ee965-8b95-4526-868d-da4b60bd9edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-150dc2dd-a263-47d2-9f46-396d03528efc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9b40486b5dc4ad4923a1441839b0271.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9b40486b5dc4ad4923a1441839b0271. Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application conn.query(q) Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 06:29:08.997035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result.read() Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 08 06:29:09.005757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application next(self.gen) Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application yield resource Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application next(self.gen) Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise self.value Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application session.commit() Jun 08 06:29:09.007005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.session.flush() Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application compat.raise_( Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 06:29:09.007936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 06:29:09.008820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application conn.query(q) Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result.read() Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 06:29:09.009714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [parameters: {'id': 'd9b40486b5dc4ad4923a1441839b0271', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:09.010618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:09.011614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9b40486b5dc4ad4923a1441839b0271. Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 476/940] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Jun 8 06:29:08 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7568-f2d3-4b2d-bcd0-3f56bb95a0a3 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:09.012739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7568-f2d3-4b2d-bcd0-3f56bb95a0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:09.013683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7568-f2d3-4b2d-bcd0-3f56bb95a0a3 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:09.013683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 477/941] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:09.013683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef7568-f2d3-4b2d-bcd0-3f56bb95a0a3 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:09.020251 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ee965-8b95-4526-868d-da4b60bd9edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:09.022970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ee965-8b95-4526-868d-da4b60bd9edb None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-857ee965-8b95-4526-868d-da4b60bd9edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:09.041413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:09.042386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:09.047185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:09.047185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:09.047185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:09.047185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:09.047185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 465/942] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:09.047185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d7fc9-fb06-4207-947b-4bc9aa10e319 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:09.047185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d7fc9-fb06-4207-947b-4bc9aa10e319 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:09.047185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d7fc9-fb06-4207-947b-4bc9aa10e319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:09.062089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-603d7fc9-fb06-4207-947b-4bc9aa10e319 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:09.063294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-603d7fc9-fb06-4207-947b-4bc9aa10e319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:09.114417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:09.128507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef7568-f2d3-4b2d-bcd0-3f56bb95a0a3 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:09.139521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 466/943] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:09.139521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d7fc9-fb06-4207-947b-4bc9aa10e319 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:09.179709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a844c-ee46-42bb-ae6d-a1453d5c8748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:09.180427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a844c-ee46-42bb-ae6d-a1453d5c8748 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:09.180806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a844c-ee46-42bb-ae6d-a1453d5c8748 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:09.181076 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a844c-ee46-42bb-ae6d-a1453d5c8748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:09.188958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a844c-ee46-42bb-ae6d-a1453d5c8748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:09.191497 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a844c-ee46-42bb-ae6d-a1453d5c8748 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-a47a844c-ee46-42bb-ae6d-a1453d5c8748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:29:09.205696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:09.206634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:09.207509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:29:09.207509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:29:09.207509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:29:09.207509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:29:09.207509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:29:09.207509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:29:09.207509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:09.207509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.207509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 478/944] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:09.208685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a844c-ee46-42bb-ae6d-a1453d5c8748 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:09.242828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:09.253948 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d7fc9-fb06-4207-947b-4bc9aa10e319 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:09.288371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73c474-d96f-439a-a26a-95cd4435ba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:09.289014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73c474-d96f-439a-a26a-95cd4435ba98 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:09.289287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73c474-d96f-439a-a26a-95cd4435ba98 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:09.289563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73c474-d96f-439a-a26a-95cd4435ba98 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:09.290298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73c474-d96f-439a-a26a-95cd4435ba98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:09.290603 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73c474-d96f-439a-a26a-95cd4435ba98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:09.291947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73c474-d96f-439a-a26a-95cd4435ba98 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:09.308336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 467/945] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:09.308336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73c474-d96f-439a-a26a-95cd4435ba98 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:09.318464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a844c-ee46-42bb-ae6d-a1453d5c8748 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:09.352067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a56bd-0f38-4743-86fc-b93cbed87f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:09.352871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a56bd-0f38-4743-86fc-b93cbed87f6c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:09.353155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a56bd-0f38-4743-86fc-b93cbed87f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:09.353428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a56bd-0f38-4743-86fc-b93cbed87f6c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:09.354074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a56bd-0f38-4743-86fc-b93cbed87f6c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:09.355562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a56bd-0f38-4743-86fc-b93cbed87f6c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-ae9a56bd-0f38-4743-86fc-b93cbed87f6c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:09.368269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:09.369260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.370091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 479/946] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jun 8 06:29:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:09.371414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a56bd-0f38-4743-86fc-b93cbed87f6c None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:09.394440 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:09.417917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73c474-d96f-439a-a26a-95cd4435ba98 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:09.453758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9554ce-6fa8-4c5a-8d0f-bc8049e36845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:09.454373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9554ce-6fa8-4c5a-8d0f-bc8049e36845 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:09.454658 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9554ce-6fa8-4c5a-8d0f-bc8049e36845 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:09.454934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9554ce-6fa8-4c5a-8d0f-bc8049e36845 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:09.455694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9554ce-6fa8-4c5a-8d0f-bc8049e36845 None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:09.455999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9554ce-6fa8-4c5a-8d0f-bc8049e36845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:09.457426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9554ce-6fa8-4c5a-8d0f-bc8049e36845 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:09.475682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 468/947] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:29:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:09.477248 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9554ce-6fa8-4c5a-8d0f-bc8049e36845 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:09.491436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a56bd-0f38-4743-86fc-b93cbed87f6c None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:09.495125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:09.543355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b8e83-8107-4fec-88cc-05d254bab85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:09.544214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b8e83-8107-4fec-88cc-05d254bab85e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:09.544496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b8e83-8107-4fec-88cc-05d254bab85e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:09.544766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b8e83-8107-4fec-88cc-05d254bab85e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:09.555191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b8e83-8107-4fec-88cc-05d254bab85e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:09.557365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b8e83-8107-4fec-88cc-05d254bab85e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-126b8e83-8107-4fec-88cc-05d254bab85e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:29:09.579209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:09.580587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:09.582130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:29:09.582130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:29:09.582130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:29:09.582130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:29:09.582130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:29:09.582130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:29:09.582130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:09.582130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:09.585477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 480/948] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:09.586487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b8e83-8107-4fec-88cc-05d254bab85e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:09.621484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9554ce-6fa8-4c5a-8d0f-bc8049e36845 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:09.668521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cc77c-25c2-4de7-b3ea-4aced98f51f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:09.669730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cc77c-25c2-4de7-b3ea-4aced98f51f4 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:09.670535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cc77c-25c2-4de7-b3ea-4aced98f51f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:09.671041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cc77c-25c2-4de7-b3ea-4aced98f51f4 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:09.672544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cc77c-25c2-4de7-b3ea-4aced98f51f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:09.672859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cc77c-25c2-4de7-b3ea-4aced98f51f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:09.674522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cc77c-25c2-4de7-b3ea-4aced98f51f4 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:09.683559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 469/949] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jun 8 06:29:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:09.691239 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cc77c-25c2-4de7-b3ea-4aced98f51f4 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:09.692708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:09.725795 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b8e83-8107-4fec-88cc-05d254bab85e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:09.766804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033700-1447-4f56-94aa-008dbaa7831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:09.768154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033700-1447-4f56-94aa-008dbaa7831e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:09.768154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033700-1447-4f56-94aa-008dbaa7831e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:09.768154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033700-1447-4f56-94aa-008dbaa7831e None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:09.768837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033700-1447-4f56-94aa-008dbaa7831e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:09.769147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033700-1447-4f56-94aa-008dbaa7831e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:09.770665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033700-1447-4f56-94aa-008dbaa7831e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:09.784097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 481/950] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:09.792122 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:09.792567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033700-1447-4f56-94aa-008dbaa7831e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:09.833052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cc77c-25c2-4de7-b3ea-4aced98f51f4 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:09.874757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f132a-03c8-4772-8ec1-29366442cc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:09.875476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f132a-03c8-4772-8ec1-29366442cc0b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:09.875763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f132a-03c8-4772-8ec1-29366442cc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:09.876037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f132a-03c8-4772-8ec1-29366442cc0b None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:09.876850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f132a-03c8-4772-8ec1-29366442cc0b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:09.877162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f132a-03c8-4772-8ec1-29366442cc0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:09.878932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f132a-03c8-4772-8ec1-29366442cc0b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:09.884699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 470/951] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jun 8 06:29:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:09.891125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f132a-03c8-4772-8ec1-29366442cc0b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:09.901314 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033700-1447-4f56-94aa-008dbaa7831e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:09.935744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e843c51-6736-45b9-987f-fadd1abd9d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:09.936691 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e843c51-6736-45b9-987f-fadd1abd9d2a None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:09.936972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e843c51-6736-45b9-987f-fadd1abd9d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:09.937247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e843c51-6736-45b9-987f-fadd1abd9d2a None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/e9f15c6bec2c4ed99834b2edf1e59947/roles/a0f92bdf90fe4ea48797ef8120146bf3` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:09.939698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e843c51-6736-45b9-987f-fadd1abd9d2a None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=e9f15c6bec2c4ed99834b2edf1e59947, role_id=a0f92bdf90fe4ea48797ef8120146bf3)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:09.941121 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e843c51-6736-45b9-987f-fadd1abd9d2a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:09.943530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:09.999768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f132a-03c8-4772-8ec1-29366442cc0b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:10.037382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774373fe-85b4-4007-9c42-c3eb8cafb8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:10.038041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774373fe-85b4-4007-9c42-c3eb8cafb8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:10.038401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774373fe-85b4-4007-9c42-c3eb8cafb8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:10.038645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774373fe-85b4-4007-9c42-c3eb8cafb8e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:10.039438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774373fe-85b4-4007-9c42-c3eb8cafb8e8 None admin] RBAC: Adding query filter params (interface=public, service_id=625fa85da0f54217a48681e67b51ce1c, region_id=RegionOne) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:10.039749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774373fe-85b4-4007-9c42-c3eb8cafb8e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:10.041127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774373fe-85b4-4007-9c42-c3eb8cafb8e8 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:10.042458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 482/952] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:29:09 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/e9f15c6bec2c4ed99834b2edf1e59947/roles/a0f92bdf90fe4ea48797ef8120146bf3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:29:10.048398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 471/953] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jun 8 06:29:09 2022] GET /identity/v3/endpoints?service_id=625fa85da0f54217a48681e67b51ce1c&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:10.054111 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e843c51-6736-45b9-987f-fadd1abd9d2a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:10.170543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e843c51-6736-45b9-987f-fadd1abd9d2a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:10.209108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c92beb-f4f6-466b-9ad4-54dd9faabfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:10.209792 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c92beb-f4f6-466b-9ad4-54dd9faabfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:10.210074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c92beb-f4f6-466b-9ad4-54dd9faabfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:10.210382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c92beb-f4f6-466b-9ad4-54dd9faabfb1 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:10.211083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c92beb-f4f6-466b-9ad4-54dd9faabfb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:10.212596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c92beb-f4f6-466b-9ad4-54dd9faabfb1 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:10.220537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 483/954] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jun 8 06:29:10 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:29:10.918390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23778170-2208-46cc-bc12-a7dcbda2f9a0 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:10.918942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23778170-2208-46cc-bc12-a7dcbda2f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:10.918942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23778170-2208-46cc-bc12-a7dcbda2f9a0 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:10.920556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 472/955] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:10.926761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6575af7-32aa-4a85-9238-a02b0b1ace12 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:10.927204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6575af7-32aa-4a85-9238-a02b0b1ace12 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:10.927380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6575af7-32aa-4a85-9238-a02b0b1ace12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:10.945247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e6575af7-32aa-4a85-9238-a02b0b1ace12 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:10.946780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e6575af7-32aa-4a85-9238-a02b0b1ace12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:11.007126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:11.024209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 484/956] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:11.052444 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23778170-2208-46cc-bc12-a7dcbda2f9a0 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:11.055628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:11.161762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23778170-2208-46cc-bc12-a7dcbda2f9a0 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:11.197107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cff26-e962-47c3-82b1-0a4b3fa94b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:11.197757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cff26-e962-47c3-82b1-0a4b3fa94b0b None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:11.198045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cff26-e962-47c3-82b1-0a4b3fa94b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:11.198351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cff26-e962-47c3-82b1-0a4b3fa94b0b None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:11.199347 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cff26-e962-47c3-82b1-0a4b3fa94b0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:11.200705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cff26-e962-47c3-82b1-0a4b3fa94b0b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:11.300923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 473/957] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:29:11 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:29:11.907402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd87e79-4515-4be8-86fd-c2b0ede01659 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:11.907797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd87e79-4515-4be8-86fd-c2b0ede01659 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:11.907988 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd87e79-4515-4be8-86fd-c2b0ede01659 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:11.909613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 485/958] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:11.914989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89511b-10bb-49f9-9876-69f1f813391c None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:11.915284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89511b-10bb-49f9-9876-69f1f813391c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:11.915567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89511b-10bb-49f9-9876-69f1f813391c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:11.932915 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-7b89511b-10bb-49f9-9876-69f1f813391c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:11.934118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7b89511b-10bb-49f9-9876-69f1f813391c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:11.994793 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:12.018047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 474/959] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:12.043150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd87e79-4515-4be8-86fd-c2b0ede01659 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:12.157515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd87e79-4515-4be8-86fd-c2b0ede01659 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:12.193262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e7716-ce35-4c5b-b1ac-6ca59f04cfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:12.193932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e7716-ce35-4c5b-b1ac-6ca59f04cfb2 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:12.194215 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e7716-ce35-4c5b-b1ac-6ca59f04cfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:12.194515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e7716-ce35-4c5b-b1ac-6ca59f04cfb2 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:12.195208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e7716-ce35-4c5b-b1ac-6ca59f04cfb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:12.196632 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e7716-ce35-4c5b-b1ac-6ca59f04cfb2 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:12.247224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.sql.core [None req-455e7716-ce35-4c5b-b1ac-6ca59f04cfb2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 06:29:12.247224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 08 06:29:12.247224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [parameters: {'user_id': '19c28402fa9b425ba02c86ca4106e8a2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 08 06:29:12.247224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80764) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-455e7716-ce35-4c5b-b1ac-6ca59f04cfb2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application conn.query(q) Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result.read() Jun 08 06:29:12.255710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 06:29:12.256918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application next(self.gen) Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application yield resource Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application next(self.gen) Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise self.value Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application session.commit() Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 06:29:12.257940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.session.flush() Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application compat.raise_( Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 06:29:12.258862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 06:29:12.259770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application conn.query(q) Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application result.read() Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 06:29:12.260683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [parameters: {'user_id': '19c28402fa9b425ba02c86ca4106e8a2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:12.261501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 08 06:29:12.262503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 08 06:29:12.263548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 08 06:29:12.263548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 08 06:29:12.263548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 06:29:12.263548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 06:29:12.263548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 08 06:29:12.263548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:12.263548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 486/960] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Jun 8 06:29:12 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:12.264025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89511b-10bb-49f9-9876-69f1f813391c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:12.368382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89511b-10bb-49f9-9876-69f1f813391c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:12.394899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9a69-528c-4af1-b41f-4abebd24861b None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:12.395196 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9a69-528c-4af1-b41f-4abebd24861b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:12.395457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9a69-528c-4af1-b41f-4abebd24861b None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:12.402447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 487/961] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:12.405016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269824-329a-48f1-9a3e-196807b1125b None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:12.405396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269824-329a-48f1-9a3e-196807b1125b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:12.405570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b437c55-4a70-4ed3-8920-fcec317177fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:12.405762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269824-329a-48f1-9a3e-196807b1125b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:12.406303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b437c55-4a70-4ed3-8920-fcec317177fe None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:12.406592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b437c55-4a70-4ed3-8920-fcec317177fe None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:12.406866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b437c55-4a70-4ed3-8920-fcec317177fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:12.414753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b437c55-4a70-4ed3-8920-fcec317177fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:12.416130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b437c55-4a70-4ed3-8920-fcec317177fe None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:12.424000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-ee269824-329a-48f1-9a3e-196807b1125b None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:12.425500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ee269824-329a-48f1-9a3e-196807b1125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3b437c55-4a70-4ed3-8920-fcec317177fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:29:12.431617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:12.433512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:12.435424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:12.435424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:12.435424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:29:12.435424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:29:12.435424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:29:12.435424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:29:12.435424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:29:12.435424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:29:12.435424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 06:29:12.435424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:12.435424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 475/962] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:29:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:12.439536 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b437c55-4a70-4ed3-8920-fcec317177fe None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:12.474984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:12.494887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:12.506380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 488/963] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:12.524670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee269824-329a-48f1-9a3e-196807b1125b None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:12.549002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b437c55-4a70-4ed3-8920-fcec317177fe None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:12.585116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eefba2-35d3-4e0f-a393-4bab75f7635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:12.585962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eefba2-35d3-4e0f-a393-4bab75f7635f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:12.586254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eefba2-35d3-4e0f-a393-4bab75f7635f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:12.586545 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eefba2-35d3-4e0f-a393-4bab75f7635f None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:12.587371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eefba2-35d3-4e0f-a393-4bab75f7635f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:12.587678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eefba2-35d3-4e0f-a393-4bab75f7635f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:12.589452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eefba2-35d3-4e0f-a393-4bab75f7635f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:12.634055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 476/964] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jun 8 06:29:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:12.634303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee269824-329a-48f1-9a3e-196807b1125b None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:12.634404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2297a-5f39-4efa-8bd3-6abe28d4bc00 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:12.634404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2297a-5f39-4efa-8bd3-6abe28d4bc00 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:12.634404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2297a-5f39-4efa-8bd3-6abe28d4bc00 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:12.636648 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 477/965] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:12.638069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecafeb-5781-4b57-94be-dbd947f23f19 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:12.638396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecafeb-5781-4b57-94be-dbd947f23f19 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:12.638683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecafeb-5781-4b57-94be-dbd947f23f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:12.659388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-f0ecafeb-5781-4b57-94be-dbd947f23f19 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:12.660994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f0ecafeb-5781-4b57-94be-dbd947f23f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:12.676474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661557-787e-4dfb-a37f-18209f28f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:12.677321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661557-787e-4dfb-a37f-18209f28f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:12.677665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661557-787e-4dfb-a37f-18209f28f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:12.678122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661557-787e-4dfb-a37f-18209f28f9b3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:12.691007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661557-787e-4dfb-a37f-18209f28f9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-02661557-787e-4dfb-a37f-18209f28f9b3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:29:12.700524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:12.701536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:12.702993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 489/966] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jun 8 06:29:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:12.713648 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661557-787e-4dfb-a37f-18209f28f9b3 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:12.756326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 478/967] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:12.771450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:12.775430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecafeb-5781-4b57-94be-dbd947f23f19 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:12.814771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:12.849373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661557-787e-4dfb-a37f-18209f28f9b3 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:12.887371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08773c9b-657f-4c6c-8744-9332d1909d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:12.888179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773c9b-657f-4c6c-8744-9332d1909d15 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:12.888435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773c9b-657f-4c6c-8744-9332d1909d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:12.888706 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773c9b-657f-4c6c-8744-9332d1909d15 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:12.889451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08773c9b-657f-4c6c-8744-9332d1909d15 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:12.890312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08773c9b-657f-4c6c-8744-9332d1909d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:12.891726 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecafeb-5781-4b57-94be-dbd947f23f19 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:12.891845 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08773c9b-657f-4c6c-8744-9332d1909d15 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:12.901613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 490/968] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jun 8 06:29:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:12.908006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08773c9b-657f-4c6c-8744-9332d1909d15 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:12.941301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a2851-27a7-476c-9e2b-5e6d34c3fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:12.942065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a2851-27a7-476c-9e2b-5e6d34c3fe23 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:12.942455 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a2851-27a7-476c-9e2b-5e6d34c3fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:12.942737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a2851-27a7-476c-9e2b-5e6d34c3fe23 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:12.943522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a2851-27a7-476c-9e2b-5e6d34c3fe23 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:12.945034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a2851-27a7-476c-9e2b-5e6d34c3fe23 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-b10a2851-27a7-476c-9e2b-5e6d34c3fe23 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:12.959077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:12.960164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:12.961041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 479/969] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jun 8 06:29:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:12.966709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a2851-27a7-476c-9e2b-5e6d34c3fe23 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:13.028534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08773c9b-657f-4c6c-8744-9332d1909d15 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:13.031258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:13.065743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeba04-0ec2-47c9-adce-b13a467f3c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:13.067043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeba04-0ec2-47c9-adce-b13a467f3c5f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:13.067336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeba04-0ec2-47c9-adce-b13a467f3c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:13.067771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeba04-0ec2-47c9-adce-b13a467f3c5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:13.076667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:13.079624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeba04-0ec2-47c9-adce-b13a467f3c5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:13.080674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a2851-27a7-476c-9e2b-5e6d34c3fe23 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:13.081065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeba04-0ec2-47c9-adce-b13a467f3c5f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-c7aeba04-0ec2-47c9-adce-b13a467f3c5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:13.100012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:13.100956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:13.101981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:13.101981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:13.101981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:13.101981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:13.101981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 491/970] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:13.106691 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeba04-0ec2-47c9-adce-b13a467f3c5f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:13.124738 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aa083-3506-4ef9-b225-1c6195f2e8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:13.126261 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aa083-3506-4ef9-b225-1c6195f2e8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:13.126706 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aa083-3506-4ef9-b225-1c6195f2e8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:13.127035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aa083-3506-4ef9-b225-1c6195f2e8e8 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:13.127766 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aa083-3506-4ef9-b225-1c6195f2e8e8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:13.128071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aa083-3506-4ef9-b225-1c6195f2e8e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:13.129442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aa083-3506-4ef9-b225-1c6195f2e8e8 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:13.139002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 480/971] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jun 8 06:29:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:13.140939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aa083-3506-4ef9-b225-1c6195f2e8e8 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:13.226454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeba04-0ec2-47c9-adce-b13a467f3c5f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:13.247997 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aa083-3506-4ef9-b225-1c6195f2e8e8 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:13.262456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e132db7-360c-4553-95a4-c8d16f5f0121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:13.263123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e132db7-360c-4553-95a4-c8d16f5f0121 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:13.263407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e132db7-360c-4553-95a4-c8d16f5f0121 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:13.263694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e132db7-360c-4553-95a4-c8d16f5f0121 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:13.264400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e132db7-360c-4553-95a4-c8d16f5f0121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:13.265329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e132db7-360c-4553-95a4-c8d16f5f0121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:13.266799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e132db7-360c-4553-95a4-c8d16f5f0121 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:13.278908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 492/972] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:13.284488 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e132db7-360c-4553-95a4-c8d16f5f0121 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:13.289938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38873-e060-4ab4-8c51-761129da42ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:13.290678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38873-e060-4ab4-8c51-761129da42ff None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:13.290966 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38873-e060-4ab4-8c51-761129da42ff None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:13.291246 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38873-e060-4ab4-8c51-761129da42ff None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:13.291978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca38873-e060-4ab4-8c51-761129da42ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:13.292290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca38873-e060-4ab4-8c51-761129da42ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:13.293727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca38873-e060-4ab4-8c51-761129da42ff None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:13.299584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 481/973] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jun 8 06:29:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:13.305448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38873-e060-4ab4-8c51-761129da42ff None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:13.306197 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:13.339571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:13.394587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e132db7-360c-4553-95a4-c8d16f5f0121 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:13.414829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38873-e060-4ab4-8c51-761129da42ff None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:13.430048 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c0443-e996-4d38-b2f4-7e7ef0774b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:13.430961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c0443-e996-4d38-b2f4-7e7ef0774b3e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:13.431249 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c0443-e996-4d38-b2f4-7e7ef0774b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:13.431526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c0443-e996-4d38-b2f4-7e7ef0774b3e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:13.438973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c0443-e996-4d38-b2f4-7e7ef0774b3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:13.440411 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c0443-e996-4d38-b2f4-7e7ef0774b3e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:13.455680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bb156-578f-4520-a56e-4aaae740822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:13.456338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bb156-578f-4520-a56e-4aaae740822f None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:13.456625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bb156-578f-4520-a56e-4aaae740822f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-309c0443-e996-4d38-b2f4-7e7ef0774b3e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:29:13.456849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:13.457776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:13.464034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:13.464034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:13.464034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:29:13.464034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:29:13.464034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:29:13.464034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:29:13.464034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:29:13.464034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:29:13.464034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 06:29:13.464034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:13.464621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bb156-578f-4520-a56e-4aaae740822f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:13.464621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bb156-578f-4520-a56e-4aaae740822f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:13.464745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 493/974] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jun 8 06:29:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:13.464812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bb156-578f-4520-a56e-4aaae740822f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:13.464891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c0443-e996-4d38-b2f4-7e7ef0774b3e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:13.539117 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:13.550281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 482/975] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jun 8 06:29:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:29:13.575955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c0443-e996-4d38-b2f4-7e7ef0774b3e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:13.622422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fec92-771b-430a-b14f-35620241cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:13.623103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fec92-771b-430a-b14f-35620241cf26 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:13.623383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fec92-771b-430a-b14f-35620241cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:13.623655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fec92-771b-430a-b14f-35620241cf26 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:13.624566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fec92-771b-430a-b14f-35620241cf26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:13.624871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fec92-771b-430a-b14f-35620241cf26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:13.626330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fec92-771b-430a-b14f-35620241cf26 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:13.633170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1aa7-f1fb-46e0-ae1f-2cd7a0f59e46 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:13.633457 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1aa7-f1fb-46e0-ae1f-2cd7a0f59e46 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:13.633739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1aa7-f1fb-46e0-ae1f-2cd7a0f59e46 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:13.635144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 483/976] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:29:13.641718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559f405-5a24-45c4-b3a7-42d045c59475 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:13.642091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559f405-5a24-45c4-b3a7-42d045c59475 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:13.642440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559f405-5a24-45c4-b3a7-42d045c59475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:13.647747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 494/977] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jun 8 06:29:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:13.653663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fec92-771b-430a-b14f-35620241cf26 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:13.664394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5559f405-5a24-45c4-b3a7-42d045c59475 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:13.665638 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5559f405-5a24-45c4-b3a7-42d045c59475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:13.740575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 484/978] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:13.764314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559f405-5a24-45c4-b3a7-42d045c59475 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:13.770059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fec92-771b-430a-b14f-35620241cf26 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:13.783562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:13.804369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:13.807674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e726e-7b8e-4c83-bc4e-bd1b56cfe669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:13.808334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e726e-7b8e-4c83-bc4e-bd1b56cfe669 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:13.808623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e726e-7b8e-4c83-bc4e-bd1b56cfe669 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:13.808900 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e726e-7b8e-4c83-bc4e-bd1b56cfe669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:13.871703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559f405-5a24-45c4-b3a7-42d045c59475 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:13.876749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e726e-7b8e-4c83-bc4e-bd1b56cfe669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:13.878210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e726e-7b8e-4c83-bc4e-bd1b56cfe669 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:13.906316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4686a8-a3e1-4b60-8deb-f51c1bae2ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:13.907123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4686a8-a3e1-4b60-8deb-f51c1bae2ddb None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:13.907405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4686a8-a3e1-4b60-8deb-f51c1bae2ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:13.907683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4686a8-a3e1-4b60-8deb-f51c1bae2ddb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:13.908328 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4686a8-a3e1-4b60-8deb-f51c1bae2ddb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:13.909771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4686a8-a3e1-4b60-8deb-f51c1bae2ddb None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-8c4686a8-a3e1-4b60-8deb-f51c1bae2ddb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:13.922681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:13.923732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:13.924571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 485/979] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:29:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:13.929731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4686a8-a3e1-4b60-8deb-f51c1bae2ddb None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:13.986207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 495/980] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:29:13 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 06:29:13.991658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e726e-7b8e-4c83-bc4e-bd1b56cfe669 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:14.019579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:14.020425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:14.043961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4686a8-a3e1-4b60-8deb-f51c1bae2ddb None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:14.083241 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510e49e-6d49-41af-906d-067864d1905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:14.083832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e49e-6d49-41af-906d-067864d1905f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:14.084116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e49e-6d49-41af-906d-067864d1905f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:14.084828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e49e-6d49-41af-906d-067864d1905f None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:14.085549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510e49e-6d49-41af-906d-067864d1905f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:14.085861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510e49e-6d49-41af-906d-067864d1905f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:14.087266 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510e49e-6d49-41af-906d-067864d1905f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:14.092367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 486/981] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:29:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:14.096211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e726e-7b8e-4c83-bc4e-bd1b56cfe669 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:14.097828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510e49e-6d49-41af-906d-067864d1905f None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:14.133823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61465f3a-d0bd-4c26-bda7-daad9c515761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:14.134653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61465f3a-d0bd-4c26-bda7-daad9c515761 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:14.135049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61465f3a-d0bd-4c26-bda7-daad9c515761 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:14.135328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61465f3a-d0bd-4c26-bda7-daad9c515761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:14.147412 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61465f3a-d0bd-4c26-bda7-daad9c515761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:14.148864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61465f3a-d0bd-4c26-bda7-daad9c515761 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-61465f3a-d0bd-4c26-bda7-daad9c515761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:14.167768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:14.168776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:14.169675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:14.169675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:14.169675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:14.169675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:14.173741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 496/982] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:14.174775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61465f3a-d0bd-4c26-bda7-daad9c515761 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:14.205702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510e49e-6d49-41af-906d-067864d1905f None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:14.241773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72fd6e-7f35-4a12-af86-fbc9a2504271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:14.242457 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72fd6e-7f35-4a12-af86-fbc9a2504271 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:14.242782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72fd6e-7f35-4a12-af86-fbc9a2504271 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:14.243007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72fd6e-7f35-4a12-af86-fbc9a2504271 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:14.243707 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72fd6e-7f35-4a12-af86-fbc9a2504271 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:14.244008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72fd6e-7f35-4a12-af86-fbc9a2504271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:14.245361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72fd6e-7f35-4a12-af86-fbc9a2504271 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:14.251735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 487/983] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:29:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:14.257080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72fd6e-7f35-4a12-af86-fbc9a2504271 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:14.267877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:14.268267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:14.286914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61465f3a-d0bd-4c26-bda7-daad9c515761 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:14.321205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598081e2-83de-413c-9c25-b447662a52c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:14.321869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598081e2-83de-413c-9c25-b447662a52c4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:14.322153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598081e2-83de-413c-9c25-b447662a52c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:14.322459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598081e2-83de-413c-9c25-b447662a52c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:14.323187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598081e2-83de-413c-9c25-b447662a52c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:14.323496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598081e2-83de-413c-9c25-b447662a52c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:14.325120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598081e2-83de-413c-9c25-b447662a52c4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:14.338878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 497/984] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:14.344433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598081e2-83de-413c-9c25-b447662a52c4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:14.362812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72fd6e-7f35-4a12-af86-fbc9a2504271 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:14.398624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f70be-a4f4-4f13-a13e-47486d3e2f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:14.399279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f70be-a4f4-4f13-a13e-47486d3e2f26 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:14.399561 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f70be-a4f4-4f13-a13e-47486d3e2f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:14.399830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f70be-a4f4-4f13-a13e-47486d3e2f26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:14.400615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f70be-a4f4-4f13-a13e-47486d3e2f26 None admin] RBAC: Adding query filter params (interface=public, service_id=72b301130431475386872fae0693702d, region_id=RegionOne) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:14.400924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f70be-a4f4-4f13-a13e-47486d3e2f26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:14.402338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f70be-a4f4-4f13-a13e-47486d3e2f26 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:14.407688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 488/985] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jun 8 06:29:14 2022] GET /identity/v3/endpoints?service_id=72b301130431475386872fae0693702d&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:14.413335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f70be-a4f4-4f13-a13e-47486d3e2f26 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:14.455079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598081e2-83de-413c-9c25-b447662a52c4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:14.486899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:14.489589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ecd5a-9357-47d7-b097-ad2f86dd30e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:14.490425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ecd5a-9357-47d7-b097-ad2f86dd30e6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:14.490714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ecd5a-9357-47d7-b097-ad2f86dd30e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:14.490987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ecd5a-9357-47d7-b097-ad2f86dd30e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:14.497841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ecd5a-9357-47d7-b097-ad2f86dd30e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:14.499879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ecd5a-9357-47d7-b097-ad2f86dd30e6 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:14.502878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-051ecd5a-9357-47d7-b097-ad2f86dd30e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:29:14.514834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:14.515907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:14.516930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:29:14.516930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:29:14.516930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:29:14.516930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:29:14.516930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:29:14.516930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:29:14.516930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:14.516930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:14.516930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 498/986] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:29:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:14.520126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f70be-a4f4-4f13-a13e-47486d3e2f26 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:14.521575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ecd5a-9357-47d7-b097-ad2f86dd30e6 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:14.556301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964e7de-e5f2-4c30-9d07-7d391cbf3059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:14.557053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964e7de-e5f2-4c30-9d07-7d391cbf3059 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:14.557339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964e7de-e5f2-4c30-9d07-7d391cbf3059 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:14.557708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964e7de-e5f2-4c30-9d07-7d391cbf3059 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:14.558491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964e7de-e5f2-4c30-9d07-7d391cbf3059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:14.559868 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964e7de-e5f2-4c30-9d07-7d391cbf3059 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:14.567413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 489/987] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jun 8 06:29:14 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:29:14.641348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ecd5a-9357-47d7-b097-ad2f86dd30e6 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:14.678059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102546b-dee2-4af6-a902-cde00862d1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:14.678795 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102546b-dee2-4af6-a902-cde00862d1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:14.679082 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102546b-dee2-4af6-a902-cde00862d1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:14.679355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102546b-dee2-4af6-a902-cde00862d1c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:14.680188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102546b-dee2-4af6-a902-cde00862d1c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:14.680500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102546b-dee2-4af6-a902-cde00862d1c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:14.681998 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102546b-dee2-4af6-a902-cde00862d1c1 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:14.701250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 499/988] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:29:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:14.702886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964e7de-e5f2-4c30-9d07-7d391cbf3059 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:14.810603 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964e7de-e5f2-4c30-9d07-7d391cbf3059 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:14.845804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95402e65-1e1c-4712-9fb7-e5e8736df622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:14.846486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95402e65-1e1c-4712-9fb7-e5e8736df622 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:14.846767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95402e65-1e1c-4712-9fb7-e5e8736df622 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:14.847039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95402e65-1e1c-4712-9fb7-e5e8736df622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:14.847862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95402e65-1e1c-4712-9fb7-e5e8736df622 None admin] RBAC: Adding query filter params (role.id=a0f92bdf90fe4ea48797ef8120146bf3, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=e9f15c6bec2c4ed99834b2edf1e59947) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:14.848169 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95402e65-1e1c-4712-9fb7-e5e8736df622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:14.849573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95402e65-1e1c-4712-9fb7-e5e8736df622 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:14.851543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:14.856258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 490/989] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:29:14 2022] GET /identity/v3/role_assignments?user.id=e9f15c6bec2c4ed99834b2edf1e59947&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=a0f92bdf90fe4ea48797ef8120146bf3 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:15.817234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9ce34-9d4c-4bf1-8f2c-e286e1da99d5 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:15.817758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9ce34-9d4c-4bf1-8f2c-e286e1da99d5 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:15.817758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9ce34-9d4c-4bf1-8f2c-e286e1da99d5 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:15.819458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 500/990] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:15.824759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942531ca-917f-4c00-8da2-523cf799bd74 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:15.825192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942531ca-917f-4c00-8da2-523cf799bd74 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:15.825356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942531ca-917f-4c00-8da2-523cf799bd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:15.842472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-942531ca-917f-4c00-8da2-523cf799bd74 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:15.843667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-942531ca-917f-4c00-8da2-523cf799bd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:15.910732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 491/991] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:15.932799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9ce34-9d4c-4bf1-8f2c-e286e1da99d5 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:15.994157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:16.036410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9ce34-9d4c-4bf1-8f2c-e286e1da99d5 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:16.071233 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632ed33-80b7-4aff-96cb-591bdbd8fdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:16.071967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ed33-80b7-4aff-96cb-591bdbd8fdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:16.072250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ed33-80b7-4aff-96cb-591bdbd8fdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:16.072521 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ed33-80b7-4aff-96cb-591bdbd8fdb3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:16.073168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632ed33-80b7-4aff-96cb-591bdbd8fdb3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:16.074812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632ed33-80b7-4aff-96cb-591bdbd8fdb3 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-6632ed33-80b7-4aff-96cb-591bdbd8fdb3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:16.086751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:16.087734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:16.088591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 501/992] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jun 8 06:29:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:16.095808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942531ca-917f-4c00-8da2-523cf799bd74 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:16.205572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942531ca-917f-4c00-8da2-523cf799bd74 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:16.231069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:16.239678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6313b-cd9b-4789-89f0-18571c96df6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:16.240339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6313b-cd9b-4789-89f0-18571c96df6b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:16.240618 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6313b-cd9b-4789-89f0-18571c96df6b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:16.244247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6313b-cd9b-4789-89f0-18571c96df6b None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:16.244247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6313b-cd9b-4789-89f0-18571c96df6b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:16.244247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6313b-cd9b-4789-89f0-18571c96df6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:16.244247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6313b-cd9b-4789-89f0-18571c96df6b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:16.248387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 492/993] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jun 8 06:29:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:16.254699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632ed33-80b7-4aff-96cb-591bdbd8fdb3 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:16.359439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632ed33-80b7-4aff-96cb-591bdbd8fdb3 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:16.382117 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:16.393175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fdcc8-2f0c-4984-a103-ecd38a197184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:16.393849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fdcc8-2f0c-4984-a103-ecd38a197184 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:16.394130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fdcc8-2f0c-4984-a103-ecd38a197184 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:16.396189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fdcc8-2f0c-4984-a103-ecd38a197184 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:16.396189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fdcc8-2f0c-4984-a103-ecd38a197184 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:16.396189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fdcc8-2f0c-4984-a103-ecd38a197184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:16.396869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fdcc8-2f0c-4984-a103-ecd38a197184 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:16.406962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 502/994] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jun 8 06:29:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:16.408204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6313b-cd9b-4789-89f0-18571c96df6b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:16.509153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6313b-cd9b-4789-89f0-18571c96df6b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:16.548419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109687a8-93df-4ecd-a7b6-4ec9a51b5be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:16.549080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109687a8-93df-4ecd-a7b6-4ec9a51b5be9 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:16.549369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109687a8-93df-4ecd-a7b6-4ec9a51b5be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:16.549645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109687a8-93df-4ecd-a7b6-4ec9a51b5be9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:16.550475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109687a8-93df-4ecd-a7b6-4ec9a51b5be9 None admin] RBAC: Adding query filter params (interface=admin, service_id=625fa85da0f54217a48681e67b51ce1c, region_id=RegionOne) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:16.550790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109687a8-93df-4ecd-a7b6-4ec9a51b5be9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:16.552147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109687a8-93df-4ecd-a7b6-4ec9a51b5be9 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:16.561824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 493/995] 10.222.0.40 () {56 vars in 1249 bytes} [Wed Jun 8 06:29:16 2022] GET /identity/v3/endpoints?service_id=625fa85da0f54217a48681e67b51ce1c&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:16.563178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fdcc8-2f0c-4984-a103-ecd38a197184 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:16.665589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fdcc8-2f0c-4984-a103-ecd38a197184 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:16.698060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54564bd8-848f-46d5-b990-49f3a92ea3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:16.698752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54564bd8-848f-46d5-b990-49f3a92ea3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:16.699283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54564bd8-848f-46d5-b990-49f3a92ea3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:16.699553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54564bd8-848f-46d5-b990-49f3a92ea3f0 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:16.700229 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54564bd8-848f-46d5-b990-49f3a92ea3f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:16.701574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54564bd8-848f-46d5-b990-49f3a92ea3f0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:16.708618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 503/996] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jun 8 06:29:16 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:29:16.857501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d741-93b0-4a75-bc5c-92b84bdc4e94 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:16.858062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d741-93b0-4a75-bc5c-92b84bdc4e94 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:16.858062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d741-93b0-4a75-bc5c-92b84bdc4e94 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:16.859728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 494/997] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:16.866000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eefba0-9039-4864-a223-a5c1d9517be9 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:16.866576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eefba0-9039-4864-a223-a5c1d9517be9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:16.866576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eefba0-9039-4864-a223-a5c1d9517be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:16.884540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-97eefba0-9039-4864-a223-a5c1d9517be9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:16.885687 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-97eefba0-9039-4864-a223-a5c1d9517be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:16.938621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:16.959158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 504/998] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:16.982531 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633d741-93b0-4a75-bc5c-92b84bdc4e94 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:17.043663 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:17.089473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633d741-93b0-4a75-bc5c-92b84bdc4e94 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:17.126254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777b763-7873-4e7f-9a32-b608d7d85543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:17.127073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777b763-7873-4e7f-9a32-b608d7d85543 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:17.127401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777b763-7873-4e7f-9a32-b608d7d85543 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:17.127678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777b763-7873-4e7f-9a32-b608d7d85543 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:17.128331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777b763-7873-4e7f-9a32-b608d7d85543 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:17.129687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777b763-7873-4e7f-9a32-b608d7d85543 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:17.135303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f3a4-7ffa-4790-995d-bc03df96f9a9 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:17.135588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f3a4-7ffa-4790-995d-bc03df96f9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:17.135861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f3a4-7ffa-4790-995d-bc03df96f9a9 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:17.137385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 505/999] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-7777b763-7873-4e7f-9a32-b608d7d85543 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:17.146291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:17.147780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:17.148613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 495/1000] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:29:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:17.149557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523c32e-db40-47cd-bdc7-fdbe4b432967 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:17.149557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523c32e-db40-47cd-bdc7-fdbe4b432967 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:17.149557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523c32e-db40-47cd-bdc7-fdbe4b432967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:17.150600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777b763-7873-4e7f-9a32-b608d7d85543 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:17.165182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0523c32e-db40-47cd-bdc7-fdbe4b432967 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:17.166392 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0523c32e-db40-47cd-bdc7-fdbe4b432967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:17.234697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 506/1001] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:17.255949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523c32e-db40-47cd-bdc7-fdbe4b432967 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:17.257708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777b763-7873-4e7f-9a32-b608d7d85543 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:17.280476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:17.294216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5169010-cf78-459f-9849-720b1eaa4707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:17.294908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5169010-cf78-459f-9849-720b1eaa4707 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:17.295191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5169010-cf78-459f-9849-720b1eaa4707 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:17.295469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5169010-cf78-459f-9849-720b1eaa4707 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:17.296179 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5169010-cf78-459f-9849-720b1eaa4707 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:17.296480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5169010-cf78-459f-9849-720b1eaa4707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:17.297861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5169010-cf78-459f-9849-720b1eaa4707 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:17.302776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 496/1002] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:29:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:17.308340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5169010-cf78-459f-9849-720b1eaa4707 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:17.361607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523c32e-db40-47cd-bdc7-fdbe4b432967 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:17.375816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:17.397499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd44f-9ea2-4547-bf10-56e3541e3e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:17.398329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd44f-9ea2-4547-bf10-56e3541e3e3f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:17.398619 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd44f-9ea2-4547-bf10-56e3541e3e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:17.398895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd44f-9ea2-4547-bf10-56e3541e3e3f None admin] PATH_INFO: `/v3/services/image` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:17.399555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cd44f-9ea2-4547-bf10-56e3541e3e3f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:17.400914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cd44f-9ea2-4547-bf10-56e3541e3e3f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:17.412878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5169010-cf78-459f-9849-720b1eaa4707 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-dd2cd44f-9ea2-4547-bf10-56e3541e3e3f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:17.413205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:17.414173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 06:29:17.415054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:17.419396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 507/1003] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Jun 8 06:29:17 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:17.420098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd44f-9ea2-4547-bf10-56e3541e3e3f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:17.453452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a22ec9-176d-46b8-aab5-f22804ec7eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:17.454120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a22ec9-176d-46b8-aab5-f22804ec7eab None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:17.454435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a22ec9-176d-46b8-aab5-f22804ec7eab None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:17.454713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a22ec9-176d-46b8-aab5-f22804ec7eab None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:17.455425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a22ec9-176d-46b8-aab5-f22804ec7eab None admin] RBAC: Adding query filter params (type=compute) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:17.455729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a22ec9-176d-46b8-aab5-f22804ec7eab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:17.457100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a22ec9-176d-46b8-aab5-f22804ec7eab None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:17.462169 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 497/1004] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jun 8 06:29:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:17.467436 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a22ec9-176d-46b8-aab5-f22804ec7eab None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:17.521308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:17.525267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd44f-9ea2-4547-bf10-56e3541e3e3f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:17.559660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cf8e6-539d-49dc-8ea6-6c3efb30118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:17.560325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cf8e6-539d-49dc-8ea6-6c3efb30118f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:17.560610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cf8e6-539d-49dc-8ea6-6c3efb30118f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:17.560880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cf8e6-539d-49dc-8ea6-6c3efb30118f None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:17.562212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cf8e6-539d-49dc-8ea6-6c3efb30118f None admin] RBAC: Adding query filter params (name=image) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:17.562552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cf8e6-539d-49dc-8ea6-6c3efb30118f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:17.563912 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cf8e6-539d-49dc-8ea6-6c3efb30118f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:17.568915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 508/1005] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:17.574514 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cf8e6-539d-49dc-8ea6-6c3efb30118f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:17.577859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a22ec9-176d-46b8-aab5-f22804ec7eab None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:17.614051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32063d3-7a0b-4ade-a6ad-cfcb0a77f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:17.614737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32063d3-7a0b-4ade-a6ad-cfcb0a77f10a None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:17.615017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32063d3-7a0b-4ade-a6ad-cfcb0a77f10a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:17.615292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32063d3-7a0b-4ade-a6ad-cfcb0a77f10a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:17.616024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32063d3-7a0b-4ade-a6ad-cfcb0a77f10a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:17.617017 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:17.617388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32063d3-7a0b-4ade-a6ad-cfcb0a77f10a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:17.676234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cf8e6-539d-49dc-8ea6-6c3efb30118f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:17.709591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c18c9-9a76-4532-8eb2-8dd45a5fc4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:17.710266 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c18c9-9a76-4532-8eb2-8dd45a5fc4eb None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:17.710561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c18c9-9a76-4532-8eb2-8dd45a5fc4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:17.710839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c18c9-9a76-4532-8eb2-8dd45a5fc4eb None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:17.711681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c18c9-9a76-4532-8eb2-8dd45a5fc4eb None admin] RBAC: Adding query filter params (type=image) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:17.711991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c18c9-9a76-4532-8eb2-8dd45a5fc4eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:17.713381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c18c9-9a76-4532-8eb2-8dd45a5fc4eb None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:17.717850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 509/1006] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:17.734298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 498/1007] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jun 8 06:29:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:29:18.971028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ec717-802d-44ea-b95e-154bb5f3035e None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:18.971608 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ec717-802d-44ea-b95e-154bb5f3035e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:18.971608 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ec717-802d-44ea-b95e-154bb5f3035e None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:18.973161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 510/1008] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:18.978552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e798a-311e-40e7-a2dc-8cf6ed7f9a67 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:18.978954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e798a-311e-40e7-a2dc-8cf6ed7f9a67 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:18.979112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e798a-311e-40e7-a2dc-8cf6ed7f9a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:18.995759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-af7e798a-311e-40e7-a2dc-8cf6ed7f9a67 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:18.996939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-af7e798a-311e-40e7-a2dc-8cf6ed7f9a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:19.074279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 499/1009] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:18 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:19.098974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ec717-802d-44ea-b95e-154bb5f3035e None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:19.207301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ec717-802d-44ea-b95e-154bb5f3035e None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:19.210281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:19.239917 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f8fb0-ec79-40b2-8393-f8525f2cffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:19.240651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f8fb0-ec79-40b2-8393-f8525f2cffd8 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:19.240931 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f8fb0-ec79-40b2-8393-f8525f2cffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:19.241201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f8fb0-ec79-40b2-8393-f8525f2cffd8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:19.241850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f8fb0-ec79-40b2-8393-f8525f2cffd8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:19.243244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f8fb0-ec79-40b2-8393-f8525f2cffd8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-415f8fb0-ec79-40b2-8393-f8525f2cffd8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:19.255890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:19.257055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 06:29:19.258081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:19.260846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 511/1010] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jun 8 06:29:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:19.267218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e798a-311e-40e7-a2dc-8cf6ed7f9a67 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:19.296296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:19.366433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e798a-311e-40e7-a2dc-8cf6ed7f9a67 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:19.402849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9974481-ea76-4c05-9ed7-98257ead72a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:19.403520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9974481-ea76-4c05-9ed7-98257ead72a6 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:19.403803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9974481-ea76-4c05-9ed7-98257ead72a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:19.404078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9974481-ea76-4c05-9ed7-98257ead72a6 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:19.404783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9974481-ea76-4c05-9ed7-98257ead72a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:19.405118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9974481-ea76-4c05-9ed7-98257ead72a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:19.406511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9974481-ea76-4c05-9ed7-98257ead72a6 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:19.417503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 500/1011] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jun 8 06:29:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:19.417670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f8fb0-ec79-40b2-8393-f8525f2cffd8 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:19.519627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f8fb0-ec79-40b2-8393-f8525f2cffd8 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:19.552857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e5545-79d6-4bd3-88d5-c8eec2a1950d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:19.553526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e5545-79d6-4bd3-88d5-c8eec2a1950d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:19.553871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e5545-79d6-4bd3-88d5-c8eec2a1950d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:19.554144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e5545-79d6-4bd3-88d5-c8eec2a1950d None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:19.554951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e5545-79d6-4bd3-88d5-c8eec2a1950d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:19.555254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e5545-79d6-4bd3-88d5-c8eec2a1950d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:19.556610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e5545-79d6-4bd3-88d5-c8eec2a1950d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:19.562171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 512/1012] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jun 8 06:29:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:19.567575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9974481-ea76-4c05-9ed7-98257ead72a6 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:19.660657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:19.667787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9974481-ea76-4c05-9ed7-98257ead72a6 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:19.708614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56420da3-b75b-4a8f-9e6e-71d398d9f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:19.709276 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56420da3-b75b-4a8f-9e6e-71d398d9f248 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:19.714045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56420da3-b75b-4a8f-9e6e-71d398d9f248 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:19.714045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56420da3-b75b-4a8f-9e6e-71d398d9f248 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:19.714045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56420da3-b75b-4a8f-9e6e-71d398d9f248 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:19.714045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56420da3-b75b-4a8f-9e6e-71d398d9f248 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:19.863589 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 501/1013] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jun 8 06:29:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:29:20.028441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb848-eb21-409d-bd40-c61c45a52a57 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:20.028962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb848-eb21-409d-bd40-c61c45a52a57 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:20.029067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb848-eb21-409d-bd40-c61c45a52a57 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:20.031114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 513/1014] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:20.036774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17260c61-650f-47f1-a077-4a1945b9e83e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:20.037276 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17260c61-650f-47f1-a077-4a1945b9e83e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:20.037348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17260c61-650f-47f1-a077-4a1945b9e83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:20.055504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-17260c61-650f-47f1-a077-4a1945b9e83e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:20.056718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-17260c61-650f-47f1-a077-4a1945b9e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:20.112621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d55c02-2f35-4f05-adb9-d1d08cdf9808 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:20.112915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d55c02-2f35-4f05-adb9-d1d08cdf9808 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:20.113202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d55c02-2f35-4f05-adb9-d1d08cdf9808 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:20.114708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 514/1015] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:29:20.119896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5b52-f370-4ce3-8e45-f2d47ff919b9 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:20.120540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5b52-f370-4ce3-8e45-f2d47ff919b9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:20.120833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5b52-f370-4ce3-8e45-f2d47ff919b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:20.136994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 502/1016] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:20 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:20.143445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a7bd5b52-f370-4ce3-8e45-f2d47ff919b9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:20.144696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a7bd5b52-f370-4ce3-8e45-f2d47ff919b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:20.160456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17260c61-650f-47f1-a077-4a1945b9e83e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:20.172987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:20.216995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 515/1017] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:20 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:20.240794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd5b52-f370-4ce3-8e45-f2d47ff919b9 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:20.246021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:20.267023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17260c61-650f-47f1-a077-4a1945b9e83e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:20.303630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7455a27-4db3-4064-b9a7-83571a45224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:20.304292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7455a27-4db3-4064-b9a7-83571a45224f None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:20.304570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7455a27-4db3-4064-b9a7-83571a45224f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:20.304840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7455a27-4db3-4064-b9a7-83571a45224f None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:20.305559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7455a27-4db3-4064-b9a7-83571a45224f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:20.308083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7455a27-4db3-4064-b9a7-83571a45224f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:20.354153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd5b52-f370-4ce3-8e45-f2d47ff919b9 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:20.388775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0f0f2-fbd9-4ee5-94e6-d54e65f3e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:20.390058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0f0f2-fbd9-4ee5-94e6-d54e65f3e96f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:20.390410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0f0f2-fbd9-4ee5-94e6-d54e65f3e96f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:20.390679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0f0f2-fbd9-4ee5-94e6-d54e65f3e96f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:20.397159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 503/1018] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:29:20 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:29:20.402094 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0f0f2-fbd9-4ee5-94e6-d54e65f3e96f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-8ca0f0f2-fbd9-4ee5-94e6-d54e65f3e96f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:29:20.411098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:20.412127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:20.413049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:20.414777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 516/1019] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jun 8 06:29:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:20.418729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7455a27-4db3-4064-b9a7-83571a45224f None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:20.536060 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7455a27-4db3-4064-b9a7-83571a45224f None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:20.579160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b97292-c782-4962-a041-4b4c7f27f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:20.580197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b97292-c782-4962-a041-4b4c7f27f381 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:20.580670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b97292-c782-4962-a041-4b4c7f27f381 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:20.581121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b97292-c782-4962-a041-4b4c7f27f381 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:20.582054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b97292-c782-4962-a041-4b4c7f27f381 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:20.582576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b97292-c782-4962-a041-4b4c7f27f381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:20.584195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b97292-c782-4962-a041-4b4c7f27f381 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:20.587052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:20.595998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 504/1020] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jun 8 06:29:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:20.601540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0f0f2-fbd9-4ee5-94e6-d54e65f3e96f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:20.628637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:20.704738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0f0f2-fbd9-4ee5-94e6-d54e65f3e96f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:20.737957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb396-7a5e-45b7-982d-f19d96c8ea6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:20.738776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb396-7a5e-45b7-982d-f19d96c8ea6d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:20.739056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb396-7a5e-45b7-982d-f19d96c8ea6d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:20.739328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb396-7a5e-45b7-982d-f19d96c8ea6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:20.750528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffb396-7a5e-45b7-982d-f19d96c8ea6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:20.751966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffb396-7a5e-45b7-982d-f19d96c8ea6d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-35ffb396-7a5e-45b7-982d-f19d96c8ea6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:20.769067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:20.769939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:20.770861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:20.770861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:20.770861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:20.770861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:20.770861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 517/1021] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:20.775803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b97292-c782-4962-a041-4b4c7f27f381 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:20.879145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b97292-c782-4962-a041-4b4c7f27f381 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:20.912646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cdd4-610a-474b-b984-6c1ce77e8382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:20.913303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cdd4-610a-474b-b984-6c1ce77e8382 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:20.913584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cdd4-610a-474b-b984-6c1ce77e8382 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:20.913857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cdd4-610a-474b-b984-6c1ce77e8382 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:20.914614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527cdd4-610a-474b-b984-6c1ce77e8382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:20.914918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527cdd4-610a-474b-b984-6c1ce77e8382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:20.916266 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527cdd4-610a-474b-b984-6c1ce77e8382 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:20.932499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 505/1022] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:20.933646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb396-7a5e-45b7-982d-f19d96c8ea6d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:21.008731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:21.038866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb396-7a5e-45b7-982d-f19d96c8ea6d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:21.073055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7199ab5-06cf-4e00-8b9b-f33413bcb39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:21.073847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199ab5-06cf-4e00-8b9b-f33413bcb39c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:21.074524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199ab5-06cf-4e00-8b9b-f33413bcb39c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:21.074685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199ab5-06cf-4e00-8b9b-f33413bcb39c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:21.083368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7199ab5-06cf-4e00-8b9b-f33413bcb39c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:21.084803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7199ab5-06cf-4e00-8b9b-f33413bcb39c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-a7199ab5-06cf-4e00-8b9b-f33413bcb39c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:29:21.099397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:21.100353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:21.101293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:21.101293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:21.101293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:29:21.101293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:29:21.101293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:29:21.101293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:29:21.101293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:29:21.101293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:29:21.101293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:29:21.101293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:21.101293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 518/1023] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jun 8 06:29:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:21.106312 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cdd4-610a-474b-b984-6c1ce77e8382 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:21.176827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:21.219006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cdd4-610a-474b-b984-6c1ce77e8382 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:21.252389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69654407-f9f5-4d48-bf4f-799c153af800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:21.253061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69654407-f9f5-4d48-bf4f-799c153af800 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:21.253344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69654407-f9f5-4d48-bf4f-799c153af800 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:21.253620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69654407-f9f5-4d48-bf4f-799c153af800 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:21.254486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69654407-f9f5-4d48-bf4f-799c153af800 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:21.254799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69654407-f9f5-4d48-bf4f-799c153af800 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:21.256218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69654407-f9f5-4d48-bf4f-799c153af800 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:21.278438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 506/1024] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jun 8 06:29:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:21.280775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7199ab5-06cf-4e00-8b9b-f33413bcb39c None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:21.378663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7199ab5-06cf-4e00-8b9b-f33413bcb39c None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:21.412100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77379b92-5621-4b85-a6a3-2bcbd5cfa41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:21.412748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379b92-5621-4b85-a6a3-2bcbd5cfa41e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:21.413033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379b92-5621-4b85-a6a3-2bcbd5cfa41e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:21.413309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379b92-5621-4b85-a6a3-2bcbd5cfa41e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:21.415947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:21.481173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77379b92-5621-4b85-a6a3-2bcbd5cfa41e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:21.482670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77379b92-5621-4b85-a6a3-2bcbd5cfa41e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:21.587771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 519/1025] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:29:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 06:29:21.593557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69654407-f9f5-4d48-bf4f-799c153af800 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:21.694205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69654407-f9f5-4d48-bf4f-799c153af800 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:21.712004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:21.730016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436921ae-97c1-4b25-a585-07d2674de54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:21.730851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436921ae-97c1-4b25-a585-07d2674de54b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:21.731127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436921ae-97c1-4b25-a585-07d2674de54b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:21.731403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436921ae-97c1-4b25-a585-07d2674de54b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:21.741447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436921ae-97c1-4b25-a585-07d2674de54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:21.742926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436921ae-97c1-4b25-a585-07d2674de54b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-436921ae-97c1-4b25-a585-07d2674de54b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:21.762207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:21.763146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:21.769225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:21.769225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:21.769225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:21.769225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:21.769225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 507/1026] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:21.769888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77379b92-5621-4b85-a6a3-2bcbd5cfa41e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:21.802560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:21.873325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77379b92-5621-4b85-a6a3-2bcbd5cfa41e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:21.907377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8732ea-ae59-4227-8576-e256601866a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:21.908044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8732ea-ae59-4227-8576-e256601866a7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:21.908326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8732ea-ae59-4227-8576-e256601866a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:21.908599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8732ea-ae59-4227-8576-e256601866a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:21.909315 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8732ea-ae59-4227-8576-e256601866a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:21.909620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8732ea-ae59-4227-8576-e256601866a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:21.911004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8732ea-ae59-4227-8576-e256601866a7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:21.923157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 520/1027] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:21.928566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436921ae-97c1-4b25-a585-07d2674de54b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:22.033221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436921ae-97c1-4b25-a585-07d2674de54b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:22.070879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043627a-35ba-4760-8e70-367fcfdd973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:22.071696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043627a-35ba-4760-8e70-367fcfdd973e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:22.071983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043627a-35ba-4760-8e70-367fcfdd973e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:22.072256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043627a-35ba-4760-8e70-367fcfdd973e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:22.079333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043627a-35ba-4760-8e70-367fcfdd973e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:22.080762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043627a-35ba-4760-8e70-367fcfdd973e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-0043627a-35ba-4760-8e70-367fcfdd973e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:29:22.094580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:22.095484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:22.101089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:29:22.101089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:29:22.101089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:29:22.101089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:29:22.101089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:29:22.101089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:29:22.101089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:22.101089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:22.101089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 508/1028] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:22.103227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8732ea-ae59-4227-8576-e256601866a7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:22.155813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eae23-653b-4ad9-94d1-36bf38938ce9 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:22.156311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eae23-653b-4ad9-94d1-36bf38938ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:22.156388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eae23-653b-4ad9-94d1-36bf38938ce9 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:22.157976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 509/1029] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:22.162932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358dcca-490f-4a7e-ba5f-c90a6de21d28 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:22.163216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358dcca-490f-4a7e-ba5f-c90a6de21d28 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:22.163489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358dcca-490f-4a7e-ba5f-c90a6de21d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:22.180419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-6358dcca-490f-4a7e-ba5f-c90a6de21d28 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:22.181581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-6358dcca-490f-4a7e-ba5f-c90a6de21d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:22.207319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:22.213886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:22.219810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8732ea-ae59-4227-8576-e256601866a7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:22.255337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 510/1030] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:22.264310 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cb2f2-df15-43ea-9160-4f825a108040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:22.264977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cb2f2-df15-43ea-9160-4f825a108040 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:22.265263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cb2f2-df15-43ea-9160-4f825a108040 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:22.265539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cb2f2-df15-43ea-9160-4f825a108040 None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:22.266361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cb2f2-df15-43ea-9160-4f825a108040 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:22.266675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cb2f2-df15-43ea-9160-4f825a108040 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:22.268100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cb2f2-df15-43ea-9160-4f825a108040 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:22.279169 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358dcca-490f-4a7e-ba5f-c90a6de21d28 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:22.286200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 521/1031] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:29:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:22.287084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cb2f2-df15-43ea-9160-4f825a108040 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:22.391127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358dcca-490f-4a7e-ba5f-c90a6de21d28 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:22.393287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cb2f2-df15-43ea-9160-4f825a108040 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:22.429303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b562ac0-02bd-4a1e-bb1b-4c597757f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:22.430092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b562ac0-02bd-4a1e-bb1b-4c597757f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:22.430415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b562ac0-02bd-4a1e-bb1b-4c597757f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:22.430692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b562ac0-02bd-4a1e-bb1b-4c597757f9e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:22.430942 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b72b6-7629-443d-b894-d54110bd1b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:22.431603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b72b6-7629-443d-b894-d54110bd1b77 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:22.431871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b72b6-7629-443d-b894-d54110bd1b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:22.431965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b562ac0-02bd-4a1e-bb1b-4c597757f9e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:22.432145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b72b6-7629-443d-b894-d54110bd1b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:22.432976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b72b6-7629-443d-b894-d54110bd1b77 None admin] RBAC: Adding query filter params (role.id=a0f92bdf90fe4ea48797ef8120146bf3, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=b8661ef27af34bbea11e215831d50843) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:22.433286 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b72b6-7629-443d-b894-d54110bd1b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:22.433378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b562ac0-02bd-4a1e-bb1b-4c597757f9e2 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:22.434711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b72b6-7629-443d-b894-d54110bd1b77 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:22.438326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 511/1032] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:22.440548 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b562ac0-02bd-4a1e-bb1b-4c597757f9e2 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:22.446482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 522/1033] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:29:22 2022] GET /identity/v3/role_assignments?user.id=b8661ef27af34bbea11e215831d50843&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=a0f92bdf90fe4ea48797ef8120146bf3 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:22.475092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:22.556087 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b562ac0-02bd-4a1e-bb1b-4c597757f9e2 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:22.593780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bfe6b-151c-47f5-b671-7d69081583c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:22.594543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bfe6b-151c-47f5-b671-7d69081583c3 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:22.594834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bfe6b-151c-47f5-b671-7d69081583c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:22.595111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bfe6b-151c-47f5-b671-7d69081583c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:22.595889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bfe6b-151c-47f5-b671-7d69081583c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:22.597333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bfe6b-151c-47f5-b671-7d69081583c3 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:22.688743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 512/1034] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:29:22 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:29:22.697959 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138a008-b271-48fe-8220-42bca4309646 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:22.698299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138a008-b271-48fe-8220-42bca4309646 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:22.698564 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138a008-b271-48fe-8220-42bca4309646 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:22.700495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 523/1035] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:22.706824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c338f3-435c-45af-8157-42019effe247 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:22.709847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c338f3-435c-45af-8157-42019effe247 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:22.709847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c338f3-435c-45af-8157-42019effe247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:22.726503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c5c338f3-435c-45af-8157-42019effe247 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:22.727727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c5c338f3-435c-45af-8157-42019effe247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:22.802293 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 513/1036] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:22.824772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138a008-b271-48fe-8220-42bca4309646 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:22.846949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:22.940815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138a008-b271-48fe-8220-42bca4309646 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:22.976396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462277-3c7a-468e-98e0-ff5669706690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:22.977222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462277-3c7a-468e-98e0-ff5669706690 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:22.977504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462277-3c7a-468e-98e0-ff5669706690 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:22.977775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462277-3c7a-468e-98e0-ff5669706690 None admin] PATH_INFO: `/v3/services/image` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:22.978449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462277-3c7a-468e-98e0-ff5669706690 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:22.979807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462277-3c7a-468e-98e0-ff5669706690 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-72462277-3c7a-468e-98e0-ff5669706690 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:22.991351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:22.992352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:22.993247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 524/1037] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Jun 8 06:29:22 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:22.999998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c338f3-435c-45af-8157-42019effe247 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:23.010332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:23.100060 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c338f3-435c-45af-8157-42019effe247 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:23.135538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3754bd6-e018-40a7-9585-b3149dba89f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:23.137044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754bd6-e018-40a7-9585-b3149dba89f1 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:23.137551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754bd6-e018-40a7-9585-b3149dba89f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:23.138052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754bd6-e018-40a7-9585-b3149dba89f1 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:23.139007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3754bd6-e018-40a7-9585-b3149dba89f1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:23.140132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3754bd6-e018-40a7-9585-b3149dba89f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:23.142144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3754bd6-e018-40a7-9585-b3149dba89f1 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:23.151476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 514/1038] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:23.152681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462277-3c7a-468e-98e0-ff5669706690 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:23.237211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:23.257463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462277-3c7a-468e-98e0-ff5669706690 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:23.295454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee0753-a4bb-4f99-82d7-b063b605973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:23.296114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee0753-a4bb-4f99-82d7-b063b605973f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:23.296393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee0753-a4bb-4f99-82d7-b063b605973f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:23.296663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee0753-a4bb-4f99-82d7-b063b605973f None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:23.297363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee0753-a4bb-4f99-82d7-b063b605973f None admin] RBAC: Adding query filter params (type=image) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:23.297663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee0753-a4bb-4f99-82d7-b063b605973f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:23.299045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee0753-a4bb-4f99-82d7-b063b605973f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:23.308578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 525/1039] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:23.309534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3754bd6-e018-40a7-9585-b3149dba89f1 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:23.379191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:23.408301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3754bd6-e018-40a7-9585-b3149dba89f1 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:23.444756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe1346-8c36-4cda-a7f8-97c9ea5223d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:23.445409 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe1346-8c36-4cda-a7f8-97c9ea5223d1 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:23.445688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe1346-8c36-4cda-a7f8-97c9ea5223d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:23.445958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe1346-8c36-4cda-a7f8-97c9ea5223d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:23.446771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe1346-8c36-4cda-a7f8-97c9ea5223d1 None admin] RBAC: Adding query filter params (interface=public, service_id=906fa242ef554da78c2abe4971611875, region_id=RegionOne) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:23.447078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe1346-8c36-4cda-a7f8-97c9ea5223d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:23.448416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe1346-8c36-4cda-a7f8-97c9ea5223d1 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:23.459707 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 515/1040] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jun 8 06:29:23 2022] GET /identity/v3/endpoints?service_id=906fa242ef554da78c2abe4971611875&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:23.459846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee0753-a4bb-4f99-82d7-b063b605973f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:23.563692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee0753-a4bb-4f99-82d7-b063b605973f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:23.596931 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d620b-27d0-4f38-ab6a-1f0254af7b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:23.597590 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d620b-27d0-4f38-ab6a-1f0254af7b8c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:23.597870 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d620b-27d0-4f38-ab6a-1f0254af7b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:23.598142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d620b-27d0-4f38-ab6a-1f0254af7b8c None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:23.598852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d620b-27d0-4f38-ab6a-1f0254af7b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:23.600197 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d620b-27d0-4f38-ab6a-1f0254af7b8c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:23.606833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 526/1041] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jun 8 06:29:23 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:29:24.682623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f9628-8c7c-4c1a-9475-e8725dbe5b57 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:24.683154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f9628-8c7c-4c1a-9475-e8725dbe5b57 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:24.683154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f9628-8c7c-4c1a-9475-e8725dbe5b57 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:24.684542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 516/1042] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:24.690364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf648067-26db-4900-93d0-67f02d95e809 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:24.690821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf648067-26db-4900-93d0-67f02d95e809 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:24.690920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf648067-26db-4900-93d0-67f02d95e809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:24.708994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-cf648067-26db-4900-93d0-67f02d95e809 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:24.710224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-cf648067-26db-4900-93d0-67f02d95e809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:24.713537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:24.779412 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 527/1043] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:24.802666 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f9628-8c7c-4c1a-9475-e8725dbe5b57 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:24.904384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f9628-8c7c-4c1a-9475-e8725dbe5b57 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:24.937740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9ba91-b316-4e04-95b8-41c8fc0f635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:24.938511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ba91-b316-4e04-95b8-41c8fc0f635b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:24.938796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ba91-b316-4e04-95b8-41c8fc0f635b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:24.939071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ba91-b316-4e04-95b8-41c8fc0f635b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:24.941693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:24.950119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9ba91-b316-4e04-95b8-41c8fc0f635b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-9ef9ba91-b316-4e04-95b8-41c8fc0f635b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:29:24.958828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:24.959740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:24.960657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:24.962597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 517/1044] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jun 8 06:29:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:24.965912 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf648067-26db-4900-93d0-67f02d95e809 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:24.992922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ad61-59dd-4bb6-9335-1543b49725cb None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:24.993336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ad61-59dd-4bb6-9335-1543b49725cb None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:24.993757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ad61-59dd-4bb6-9335-1543b49725cb None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:24.996017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 518/1045] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:29:25.000761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd183-798e-486f-953d-e90b7a1be6e9 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:25.001200 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd183-798e-486f-953d-e90b7a1be6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:25.001489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd183-798e-486f-953d-e90b7a1be6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:25.018776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-3bbbd183-798e-486f-953d-e90b7a1be6e9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:25.019926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3bbbd183-798e-486f-953d-e90b7a1be6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:25.069919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf648067-26db-4900-93d0-67f02d95e809 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:25.091562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 519/1046] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:25.105820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c841b-9d00-45d9-92e3-10c289c85704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:25.106516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c841b-9d00-45d9-92e3-10c289c85704 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:25.106799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c841b-9d00-45d9-92e3-10c289c85704 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:25.107108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c841b-9d00-45d9-92e3-10c289c85704 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:25.107882 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c841b-9d00-45d9-92e3-10c289c85704 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:25.108187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c841b-9d00-45d9-92e3-10c289c85704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:25.109540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c841b-9d00-45d9-92e3-10c289c85704 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:25.116090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbd183-798e-486f-953d-e90b7a1be6e9 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:25.118421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 528/1047] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jun 8 06:29:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:25.124582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c841b-9d00-45d9-92e3-10c289c85704 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:25.127423 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:25.224100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbd183-798e-486f-953d-e90b7a1be6e9 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:25.232346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c841b-9d00-45d9-92e3-10c289c85704 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:25.250556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:25.259812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951da25f-8dfa-4054-827c-299c32f23030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:25.260619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951da25f-8dfa-4054-827c-299c32f23030 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:25.260905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951da25f-8dfa-4054-827c-299c32f23030 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:25.271383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951da25f-8dfa-4054-827c-299c32f23030 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:25.271383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951da25f-8dfa-4054-827c-299c32f23030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:25.271383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951da25f-8dfa-4054-827c-299c32f23030 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:25.271383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 520/1048] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:25.271752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2249ba1-0dd1-4dcc-b2ed-73ece2b62216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:25.271752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249ba1-0dd1-4dcc-b2ed-73ece2b62216 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:25.271752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249ba1-0dd1-4dcc-b2ed-73ece2b62216 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:25.271752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249ba1-0dd1-4dcc-b2ed-73ece2b62216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:25.272252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951da25f-8dfa-4054-827c-299c32f23030 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:25.281255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2249ba1-0dd1-4dcc-b2ed-73ece2b62216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:25.282793 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2249ba1-0dd1-4dcc-b2ed-73ece2b62216 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-c2249ba1-0dd1-4dcc-b2ed-73ece2b62216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:25.299970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:25.300933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:25.306855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:25.306855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:25.306855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:25.306855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:25.306855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 529/1049] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:25.306855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2249ba1-0dd1-4dcc-b2ed-73ece2b62216 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:25.364153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:25.397552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951da25f-8dfa-4054-827c-299c32f23030 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:25.411078 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2249ba1-0dd1-4dcc-b2ed-73ece2b62216 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:25.437166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b953c95-ac52-4bc3-8916-8c2cd60a6603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:25.437843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953c95-ac52-4bc3-8916-8c2cd60a6603 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:25.438125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953c95-ac52-4bc3-8916-8c2cd60a6603 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:25.438430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953c95-ac52-4bc3-8916-8c2cd60a6603 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:25.439135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b953c95-ac52-4bc3-8916-8c2cd60a6603 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:25.440559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b953c95-ac52-4bc3-8916-8c2cd60a6603 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:25.445536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8364b23-58df-4ace-aad9-91ec7e74a6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:25.446202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8364b23-58df-4ace-aad9-91ec7e74a6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:25.446517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8364b23-58df-4ace-aad9-91ec7e74a6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:25.446816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8364b23-58df-4ace-aad9-91ec7e74a6c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:25.447717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8364b23-58df-4ace-aad9-91ec7e74a6c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:25.448619 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8364b23-58df-4ace-aad9-91ec7e74a6c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:25.450889 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8364b23-58df-4ace-aad9-91ec7e74a6c7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:25.463898 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 530/1050] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:25.470668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8364b23-58df-4ace-aad9-91ec7e74a6c7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:25.543174 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 521/1051] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:29:25 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:29:25.581507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8364b23-58df-4ace-aad9-91ec7e74a6c7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:25.599084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:25.625724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089b86b-2d22-4cf5-95c3-ce402a57fd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:25.626830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089b86b-2d22-4cf5-95c3-ce402a57fd96 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:25.627114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089b86b-2d22-4cf5-95c3-ce402a57fd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:25.627389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089b86b-2d22-4cf5-95c3-ce402a57fd96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:25.636457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089b86b-2d22-4cf5-95c3-ce402a57fd96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:25.637923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089b86b-2d22-4cf5-95c3-ce402a57fd96 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-a089b86b-2d22-4cf5-95c3-ce402a57fd96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:29:25.654230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:25.655311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:25.656304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:25.656304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:25.656304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:29:25.656304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:29:25.656304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:29:25.656304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:29:25.656304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:29:25.656304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:29:25.656304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:29:25.656304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:25.657667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 531/1052] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jun 8 06:29:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:25.661954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b953c95-ac52-4bc3-8916-8c2cd60a6603 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:25.721189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:25.774296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b953c95-ac52-4bc3-8916-8c2cd60a6603 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:25.810395 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05411c-ceee-4d5c-8c9a-87b41f5d7d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:25.811541 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05411c-ceee-4d5c-8c9a-87b41f5d7d21 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:25.811842 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05411c-ceee-4d5c-8c9a-87b41f5d7d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:25.812093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05411c-ceee-4d5c-8c9a-87b41f5d7d21 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:25.813034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05411c-ceee-4d5c-8c9a-87b41f5d7d21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:25.813336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05411c-ceee-4d5c-8c9a-87b41f5d7d21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:25.814800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05411c-ceee-4d5c-8c9a-87b41f5d7d21 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:25.833444 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 522/1053] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jun 8 06:29:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:25.838766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089b86b-2d22-4cf5-95c3-ce402a57fd96 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:25.847170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a61cbe-78eb-48bf-b2cf-10651541b1fb None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:25.847463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a61cbe-78eb-48bf-b2cf-10651541b1fb None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:25.847778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a61cbe-78eb-48bf-b2cf-10651541b1fb None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:25.849185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 523/1054] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:29:25.854538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5dde4-c052-4a04-b48a-f590d01269dd None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:25.855212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5dde4-c052-4a04-b48a-f590d01269dd None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:25.855495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5dde4-c052-4a04-b48a-f590d01269dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:25.872480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-dfd5dde4-c052-4a04-b48a-f590d01269dd None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:25.874201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-dfd5dde4-c052-4a04-b48a-f590d01269dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:25.940801 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 524/1055] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:25.944919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089b86b-2d22-4cf5-95c3-ce402a57fd96 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:25.964969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5dde4-c052-4a04-b48a-f590d01269dd None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:25.981154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1affe-fd82-4362-91e8-3cee8d67440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:25.981956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1affe-fd82-4362-91e8-3cee8d67440b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:25.982249 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1affe-fd82-4362-91e8-3cee8d67440b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:25.982553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1affe-fd82-4362-91e8-3cee8d67440b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:25.994578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1affe-fd82-4362-91e8-3cee8d67440b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:25.996020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1affe-fd82-4362-91e8-3cee8d67440b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:26.012865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-4de1affe-fd82-4362-91e8-3cee8d67440b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:26.014354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:26.015209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:26.016101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:26.016101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:26.016101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:26.016101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:26.018530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 532/1056] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:26.021032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1affe-fd82-4362-91e8-3cee8d67440b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:26.050090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:26.081870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5dde4-c052-4a04-b48a-f590d01269dd None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:26.120061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddea4b-6fd0-4177-befb-14a6745a32db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:26.121607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddea4b-6fd0-4177-befb-14a6745a32db None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:26.122061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddea4b-6fd0-4177-befb-14a6745a32db None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:26.122364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddea4b-6fd0-4177-befb-14a6745a32db None admin] PATH_INFO: `/v3/services/image` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:26.123023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddea4b-6fd0-4177-befb-14a6745a32db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:26.124437 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddea4b-6fd0-4177-befb-14a6745a32db None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:26.127998 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1affe-fd82-4362-91e8-3cee8d67440b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-0cddea4b-6fd0-4177-befb-14a6745a32db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:26.139719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:26.141020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 06:29:26.142018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:26.143266 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 525/1057] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Jun 8 06:29:25 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:26.148884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddea4b-6fd0-4177-befb-14a6745a32db None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:26.169143 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046da262-15e3-4f4a-b54a-bda54ae47a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:26.169814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046da262-15e3-4f4a-b54a-bda54ae47a78 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:26.170098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046da262-15e3-4f4a-b54a-bda54ae47a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:26.171026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046da262-15e3-4f4a-b54a-bda54ae47a78 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:26.171755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046da262-15e3-4f4a-b54a-bda54ae47a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:26.172061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046da262-15e3-4f4a-b54a-bda54ae47a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:26.173428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046da262-15e3-4f4a-b54a-bda54ae47a78 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:26.184595 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 533/1058] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:26.190061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046da262-15e3-4f4a-b54a-bda54ae47a78 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:26.263673 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddea4b-6fd0-4177-befb-14a6745a32db None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:26.265185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:26.282526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:26.299079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046da262-15e3-4f4a-b54a-bda54ae47a78 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:26.311230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3910c9-32ea-45b4-aa74-a8a76bd9bbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:26.311939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3910c9-32ea-45b4-aa74-a8a76bd9bbca None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:26.312218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3910c9-32ea-45b4-aa74-a8a76bd9bbca None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:26.312443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3910c9-32ea-45b4-aa74-a8a76bd9bbca None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:26.313243 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3910c9-32ea-45b4-aa74-a8a76bd9bbca None admin] RBAC: Adding query filter params (name=image) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:26.313557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3910c9-32ea-45b4-aa74-a8a76bd9bbca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:26.314945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3910c9-32ea-45b4-aa74-a8a76bd9bbca None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:26.320687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 526/1059] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:26.326290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3910c9-32ea-45b4-aa74-a8a76bd9bbca None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:26.336674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901db707-dfa7-419e-aa0a-7db3670494a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:26.337413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db707-dfa7-419e-aa0a-7db3670494a4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:26.337698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db707-dfa7-419e-aa0a-7db3670494a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:26.337975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db707-dfa7-419e-aa0a-7db3670494a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:26.345420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901db707-dfa7-419e-aa0a-7db3670494a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:26.346903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901db707-dfa7-419e-aa0a-7db3670494a4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-901db707-dfa7-419e-aa0a-7db3670494a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:29:26.361861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:26.362823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:26.363702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:29:26.363702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:29:26.363702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:29:26.363702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:29:26.363702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:29:26.363702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:29:26.363702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:26.363702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:26.363702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 534/1060] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:26.368576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901db707-dfa7-419e-aa0a-7db3670494a4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:26.442719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3910c9-32ea-45b4-aa74-a8a76bd9bbca None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:26.468756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901db707-dfa7-419e-aa0a-7db3670494a4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:26.480295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0beda8-b46d-46ed-a335-90f9ad25a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:26.480952 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0beda8-b46d-46ed-a335-90f9ad25a020 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:26.481231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0beda8-b46d-46ed-a335-90f9ad25a020 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:26.481612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0beda8-b46d-46ed-a335-90f9ad25a020 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:26.482450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0beda8-b46d-46ed-a335-90f9ad25a020 None admin] RBAC: Adding query filter params (type=image) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:26.484558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0beda8-b46d-46ed-a335-90f9ad25a020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:26.486195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0beda8-b46d-46ed-a335-90f9ad25a020 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:26.495966 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 527/1061] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:26.496953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0beda8-b46d-46ed-a335-90f9ad25a020 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:26.506552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb858f82-ee24-4ec5-9f47-9441017e407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:26.507208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858f82-ee24-4ec5-9f47-9441017e407f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:26.512492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858f82-ee24-4ec5-9f47-9441017e407f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:26.512492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858f82-ee24-4ec5-9f47-9441017e407f None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:26.512492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb858f82-ee24-4ec5-9f47-9441017e407f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:26.512492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb858f82-ee24-4ec5-9f47-9441017e407f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:26.512492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb858f82-ee24-4ec5-9f47-9441017e407f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:26.522937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 535/1062] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:26.528466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb858f82-ee24-4ec5-9f47-9441017e407f None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:26.529161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:26.537628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:26.605113 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0beda8-b46d-46ed-a335-90f9ad25a020 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:26.630617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb858f82-ee24-4ec5-9f47-9441017e407f None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:26.641058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c226d-b525-432d-8067-aff185c61ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:26.641717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c226d-b525-432d-8067-aff185c61ddd None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:26.642003 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c226d-b525-432d-8067-aff185c61ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:26.642306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c226d-b525-432d-8067-aff185c61ddd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:26.643048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c226d-b525-432d-8067-aff185c61ddd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:26.644412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c226d-b525-432d-8067-aff185c61ddd None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:26.665294 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd993bcc-1f03-4cb0-9687-df30e452e612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:26.666183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd993bcc-1f03-4cb0-9687-df30e452e612 None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:26.666495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd993bcc-1f03-4cb0-9687-df30e452e612 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:26.666770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd993bcc-1f03-4cb0-9687-df30e452e612 None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/b8661ef27af34bbea11e215831d50843/roles/a0f92bdf90fe4ea48797ef8120146bf3` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:26.669075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd993bcc-1f03-4cb0-9687-df30e452e612 None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=b8661ef27af34bbea11e215831d50843, role_id=a0f92bdf90fe4ea48797ef8120146bf3)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:26.670536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd993bcc-1f03-4cb0-9687-df30e452e612 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:26.709421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 528/1063] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jun 8 06:29:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:29:26.741592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 536/1064] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:29:26 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/b8661ef27af34bbea11e215831d50843/roles/a0f92bdf90fe4ea48797ef8120146bf3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:29:27.896274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ee9fb-274c-497d-99cb-f03b5652eea4 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:27.896792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ee9fb-274c-497d-99cb-f03b5652eea4 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:27.896898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ee9fb-274c-497d-99cb-f03b5652eea4 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:27.898229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 529/1065] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:27.903536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78d05c-c9e0-4d47-8eba-b642fd42d243 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:27.903955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78d05c-c9e0-4d47-8eba-b642fd42d243 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:27.904139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78d05c-c9e0-4d47-8eba-b642fd42d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:27.921243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-cf78d05c-c9e0-4d47-8eba-b642fd42d243 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:27.922461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-cf78d05c-c9e0-4d47-8eba-b642fd42d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:27.981922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:27.995158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 537/1066] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:28.019171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ee9fb-274c-497d-99cb-f03b5652eea4 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:28.108252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:28.128772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ee9fb-274c-497d-99cb-f03b5652eea4 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:28.165477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0e312-010b-44c8-8ee2-7e96960d9379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:28.166206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e312-010b-44c8-8ee2-7e96960d9379 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:28.166524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e312-010b-44c8-8ee2-7e96960d9379 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:28.166802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e312-010b-44c8-8ee2-7e96960d9379 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:28.177569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0e312-010b-44c8-8ee2-7e96960d9379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-36c0e312-010b-44c8-8ee2-7e96960d9379 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:29:28.185145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:28.186059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:28.192199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 530/1067] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:28.194469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78d05c-c9e0-4d47-8eba-b642fd42d243 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:28.293146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78d05c-c9e0-4d47-8eba-b642fd42d243 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:28.327703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3533bd-ed11-48b8-8e36-05ac0ec284a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:28.328373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3533bd-ed11-48b8-8e36-05ac0ec284a8 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:28.328653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3533bd-ed11-48b8-8e36-05ac0ec284a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:28.328923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3533bd-ed11-48b8-8e36-05ac0ec284a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:28.329665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3533bd-ed11-48b8-8e36-05ac0ec284a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:28.329969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3533bd-ed11-48b8-8e36-05ac0ec284a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:28.331359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3533bd-ed11-48b8-8e36-05ac0ec284a8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:28.339612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 538/1068] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:28.345285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0e312-010b-44c8-8ee2-7e96960d9379 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:28.448678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0e312-010b-44c8-8ee2-7e96960d9379 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:28.482316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42e59f-07fe-4ae1-b830-0cdfe0c6e6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:28.483192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42e59f-07fe-4ae1-b830-0cdfe0c6e6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:28.483472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42e59f-07fe-4ae1-b830-0cdfe0c6e6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:28.483744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42e59f-07fe-4ae1-b830-0cdfe0c6e6d3 None admin] PATH_INFO: `/v3/users/7599db1c16d349acb349dde196bce2e3` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:28.497194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42e59f-07fe-4ae1-b830-0cdfe0c6e6d3 None admin] RBAC: Authorizing `identity:get_user(user_id=7599db1c16d349acb349dde196bce2e3)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:28.499170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42e59f-07fe-4ae1-b830-0cdfe0c6e6d3 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:28.505562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 531/1069] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:29:28 2022] GET /identity/v3/users/7599db1c16d349acb349dde196bce2e3 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:28.507101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3533bd-ed11-48b8-8e36-05ac0ec284a8 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:28.567282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:28.611881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3533bd-ed11-48b8-8e36-05ac0ec284a8 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:28.646613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9eff-ee6f-4ddf-9dcd-6efbcb953632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:28.647272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9eff-ee6f-4ddf-9dcd-6efbcb953632 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:28.647552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9eff-ee6f-4ddf-9dcd-6efbcb953632 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:28.647825 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9eff-ee6f-4ddf-9dcd-6efbcb953632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:28.722966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a9eff-ee6f-4ddf-9dcd-6efbcb953632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:28.724321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a9eff-ee6f-4ddf-9dcd-6efbcb953632 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:28.777483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:28.825068 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 539/1070] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:29:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:29:28.831203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42e59f-07fe-4ae1-b830-0cdfe0c6e6d3 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:28.835975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:28.932964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42e59f-07fe-4ae1-b830-0cdfe0c6e6d3 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:28.967254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e42b5-3d60-412a-9371-6c758fd3bd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:28.968109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e42b5-3d60-412a-9371-6c758fd3bd48 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:28.968394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e42b5-3d60-412a-9371-6c758fd3bd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:28.968672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e42b5-3d60-412a-9371-6c758fd3bd48 None admin] PATH_INFO: `/v3/projects/dce7f384781f41f085dd11d45b77c207` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:28.969845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e42b5-3d60-412a-9371-6c758fd3bd48 None admin] RBAC: Authorizing `identity:get_project(project_id=dce7f384781f41f085dd11d45b77c207)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:28.971313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e42b5-3d60-412a-9371-6c758fd3bd48 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:28.977941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 532/1071] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:29:28 2022] GET /identity/v3/projects/dce7f384781f41f085dd11d45b77c207 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:28.979502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9eff-ee6f-4ddf-9dcd-6efbcb953632 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:28.995525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02a43-7e0e-4032-be2e-a0fc447f35c8 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:28.995813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02a43-7e0e-4032-be2e-a0fc447f35c8 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:28.996088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02a43-7e0e-4032-be2e-a0fc447f35c8 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:28.997694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 533/1072] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:29.003229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abb240-0b92-498b-bb3e-044a685281f4 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:29.003509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abb240-0b92-498b-bb3e-044a685281f4 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:29.003781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abb240-0b92-498b-bb3e-044a685281f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:29.020988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-88abb240-0b92-498b-bb3e-044a685281f4 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:29.022167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-88abb240-0b92-498b-bb3e-044a685281f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:29.087299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 534/1073] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:29.088677 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63d18c-9d30-45c9-9671-0ff2b1e0aeaf None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:29.088966 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63d18c-9d30-45c9-9671-0ff2b1e0aeaf None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:29.089064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9eff-ee6f-4ddf-9dcd-6efbcb953632 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:29.089235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63d18c-9d30-45c9-9671-0ff2b1e0aeaf None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:29.090775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 535/1074] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:29.096767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc4949-0235-4fff-8d79-9285e389fae1 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:29.097054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc4949-0235-4fff-8d79-9285e389fae1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:29.097333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc4949-0235-4fff-8d79-9285e389fae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:29.103160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:29.117647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-3fcc4949-0235-4fff-8d79-9285e389fae1 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:29.118878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3fcc4949-0235-4fff-8d79-9285e389fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:29.127701 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bc204-be39-415a-a230-533a2e450067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:29.128359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc204-be39-415a-a230-533a2e450067 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:29.128641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc204-be39-415a-a230-533a2e450067 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:29.128913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc204-be39-415a-a230-533a2e450067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:29.129743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bc204-be39-415a-a230-533a2e450067 None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=dce7f384781f41f085dd11d45b77c207, user.id=7599db1c16d349acb349dde196bce2e3) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:29.130052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bc204-be39-415a-a230-533a2e450067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:29.131524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bc204-be39-415a-a230-533a2e450067 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:29.150274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 540/1075] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:29:28 2022] GET /identity/v3/role_assignments?user.id=7599db1c16d349acb349dde196bce2e3&scope.project.id=dce7f384781f41f085dd11d45b77c207&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:29.150274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bc204-be39-415a-a230-533a2e450067 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:29.164316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:29.202296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 536/1076] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:29:29.222474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc4949-0235-4fff-8d79-9285e389fae1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:29.266339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bc204-be39-415a-a230-533a2e450067 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:29.306949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b777c7-4b21-413e-b3b8-b748f7992f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:29.307622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b777c7-4b21-413e-b3b8-b748f7992f70 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:29.307907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b777c7-4b21-413e-b3b8-b748f7992f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:29.308191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b777c7-4b21-413e-b3b8-b748f7992f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:29.334973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc4949-0235-4fff-8d79-9285e389fae1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:29.366909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:29.372741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5a62-7ac3-45d0-9bbb-2f1789e67375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:29.375535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5a62-7ac3-45d0-9bbb-2f1789e67375 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:29.375535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5a62-7ac3-45d0-9bbb-2f1789e67375 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:29.375535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5a62-7ac3-45d0-9bbb-2f1789e67375 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:29.382340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b777c7-4b21-413e-b3b8-b748f7992f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:29.383788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b777c7-4b21-413e-b3b8-b748f7992f70 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:29.384766 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e5a62-7ac3-45d0-9bbb-2f1789e67375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-611e5a62-7ac3-45d0-9bbb-2f1789e67375 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:29:29.393446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:29.394760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:29.396068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 537/1077] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jun 8 06:29:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:29.400561 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5a62-7ac3-45d0-9bbb-2f1789e67375 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:29.407129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:29.490714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 541/1078] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:29:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:29:29.496164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b777c7-4b21-413e-b3b8-b748f7992f70 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:29.508079 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5a62-7ac3-45d0-9bbb-2f1789e67375 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:29.543571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a705749-8a87-4a80-b7d4-d228ce6f777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:29.544142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a705749-8a87-4a80-b7d4-d228ce6f777b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:29.544427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a705749-8a87-4a80-b7d4-d228ce6f777b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:29.544694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a705749-8a87-4a80-b7d4-d228ce6f777b None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:29.545477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a705749-8a87-4a80-b7d4-d228ce6f777b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:29.545782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a705749-8a87-4a80-b7d4-d228ce6f777b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:29.547172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a705749-8a87-4a80-b7d4-d228ce6f777b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:29.556056 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 538/1079] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jun 8 06:29:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:29.561427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a705749-8a87-4a80-b7d4-d228ce6f777b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:29.603353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b777c7-4b21-413e-b3b8-b748f7992f70 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:29.621008 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:29.623468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:29.639713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3e207-aa83-4d7d-87b3-3af33d23caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:29.640510 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3e207-aa83-4d7d-87b3-3af33d23caa2 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:29.640790 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3e207-aa83-4d7d-87b3-3af33d23caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:29.641059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3e207-aa83-4d7d-87b3-3af33d23caa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:29.652552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3e207-aa83-4d7d-87b3-3af33d23caa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:29.654490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3e207-aa83-4d7d-87b3-3af33d23caa2 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:29.669145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a705749-8a87-4a80-b7d4-d228ce6f777b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-b8f3e207-aa83-4d7d-87b3-3af33d23caa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:29.674358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:29.675206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:29.681208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:29.681208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:29.681208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:29.681208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:29.681208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 542/1080] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:29.681208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3e207-aa83-4d7d-87b3-3af33d23caa2 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:29.711444 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed4c4-5649-4441-84ee-3c7b9eab8231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:29.712237 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed4c4-5649-4441-84ee-3c7b9eab8231 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:29.712636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed4c4-5649-4441-84ee-3c7b9eab8231 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:29.712921 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed4c4-5649-4441-84ee-3c7b9eab8231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:29.724313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ed4c4-5649-4441-84ee-3c7b9eab8231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:29.725750 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ed4c4-5649-4441-84ee-3c7b9eab8231 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-5e2ed4c4-5649-4441-84ee-3c7b9eab8231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:29.742723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:29.743617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:29.744527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:29.744527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:29.744527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:29.744527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:29.744527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 539/1081] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:29.750099 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed4c4-5649-4441-84ee-3c7b9eab8231 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:29.784034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3e207-aa83-4d7d-87b3-3af33d23caa2 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:29.818519 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbba84-5568-48cc-8620-c8fa10bfb42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:29.819097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbba84-5568-48cc-8620-c8fa10bfb42c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:29.819380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbba84-5568-48cc-8620-c8fa10bfb42c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:29.819662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbba84-5568-48cc-8620-c8fa10bfb42c None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:29.820389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbba84-5568-48cc-8620-c8fa10bfb42c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:29.820710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbba84-5568-48cc-8620-c8fa10bfb42c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:29.822064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbba84-5568-48cc-8620-c8fa10bfb42c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:29.835276 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 543/1082] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:29.869525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed4c4-5649-4441-84ee-3c7b9eab8231 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:29.879023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:29.908078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362bd61-a963-4382-aa8b-0f2d7dfce32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:29.908771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362bd61-a963-4382-aa8b-0f2d7dfce32e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:29.909518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362bd61-a963-4382-aa8b-0f2d7dfce32e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:29.910178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362bd61-a963-4382-aa8b-0f2d7dfce32e None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:29.911488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362bd61-a963-4382-aa8b-0f2d7dfce32e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:29.911810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362bd61-a963-4382-aa8b-0f2d7dfce32e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:29.913213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362bd61-a963-4382-aa8b-0f2d7dfce32e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:29.926674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 540/1083] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:29.932561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbba84-5568-48cc-8620-c8fa10bfb42c None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:29.976422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:30.051447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbba84-5568-48cc-8620-c8fa10bfb42c None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:30.089289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4675d-1b70-4efd-9254-5c4db9550aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:30.090686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4675d-1b70-4efd-9254-5c4db9550aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:30.090686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4675d-1b70-4efd-9254-5c4db9550aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:30.090686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4675d-1b70-4efd-9254-5c4db9550aa5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:30.098354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4675d-1b70-4efd-9254-5c4db9550aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:30.099791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4675d-1b70-4efd-9254-5c4db9550aa5 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-74b4675d-1b70-4efd-9254-5c4db9550aa5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:29:30.113717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:30.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:30.115833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:30.115833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:30.115833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:29:30.115833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:29:30.115833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:29:30.115833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:29:30.115833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:29:30.115833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:29:30.115833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 06:29:30.115833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:30.115833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 544/1084] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jun 8 06:29:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:30.122965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362bd61-a963-4382-aa8b-0f2d7dfce32e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:30.229351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362bd61-a963-4382-aa8b-0f2d7dfce32e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:30.262876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51732a31-ca1a-4b61-939b-4a0e12adead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:30.263562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51732a31-ca1a-4b61-939b-4a0e12adead1 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:30.263885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51732a31-ca1a-4b61-939b-4a0e12adead1 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:30.264159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51732a31-ca1a-4b61-939b-4a0e12adead1 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:30.265012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51732a31-ca1a-4b61-939b-4a0e12adead1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:30.265320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51732a31-ca1a-4b61-939b-4a0e12adead1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:30.266809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51732a31-ca1a-4b61-939b-4a0e12adead1 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:30.285106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 541/1085] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jun 8 06:29:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:30.290881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4675d-1b70-4efd-9254-5c4db9550aa5 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:30.382861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:30.393675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4675d-1b70-4efd-9254-5c4db9550aa5 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:30.427096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080638d5-6f16-41b6-a0c8-dbb444676108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:30.427745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080638d5-6f16-41b6-a0c8-dbb444676108 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:30.428029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080638d5-6f16-41b6-a0c8-dbb444676108 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:30.428307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080638d5-6f16-41b6-a0c8-dbb444676108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:30.494790 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080638d5-6f16-41b6-a0c8-dbb444676108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:30.496228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080638d5-6f16-41b6-a0c8-dbb444676108 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:30.583876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:30.594344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 545/1086] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:29:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:29:30.600032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51732a31-ca1a-4b61-939b-4a0e12adead1 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:30.625068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:30.697445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51732a31-ca1a-4b61-939b-4a0e12adead1 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:30.730626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572acd-1338-4638-9cce-5dc5e88e48fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:30.731412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572acd-1338-4638-9cce-5dc5e88e48fb None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:30.731697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572acd-1338-4638-9cce-5dc5e88e48fb None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:30.731975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572acd-1338-4638-9cce-5dc5e88e48fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:30.742519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d572acd-1338-4638-9cce-5dc5e88e48fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:30.743952 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d572acd-1338-4638-9cce-5dc5e88e48fb None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-9d572acd-1338-4638-9cce-5dc5e88e48fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:29:30.760873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:30.761933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:30.763373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:29:30.763373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:29:30.763373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:29:30.763373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:30.763373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 542/1087] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:30.767771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080638d5-6f16-41b6-a0c8-dbb444676108 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:30.862724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080638d5-6f16-41b6-a0c8-dbb444676108 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:30.895136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d68ff-cf13-4001-9713-0aed600f3966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:30.895792 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d68ff-cf13-4001-9713-0aed600f3966 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:30.896069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d68ff-cf13-4001-9713-0aed600f3966 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:30.896337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d68ff-cf13-4001-9713-0aed600f3966 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:30.897052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d68ff-cf13-4001-9713-0aed600f3966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:30.897350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d68ff-cf13-4001-9713-0aed600f3966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:30.898751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d68ff-cf13-4001-9713-0aed600f3966 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:30.910741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 546/1088] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:30.916316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572acd-1338-4638-9cce-5dc5e88e48fb None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:30.992435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:31.015567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572acd-1338-4638-9cce-5dc5e88e48fb None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:31.049221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb585a-92b9-4dd7-ae87-421c422a713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:31.050036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb585a-92b9-4dd7-ae87-421c422a713d None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:31.050354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb585a-92b9-4dd7-ae87-421c422a713d None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:31.050627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb585a-92b9-4dd7-ae87-421c422a713d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:31.058417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb585a-92b9-4dd7-ae87-421c422a713d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:31.059897 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb585a-92b9-4dd7-ae87-421c422a713d None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-c8bb585a-92b9-4dd7-ae87-421c422a713d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:29:31.075040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:31.076192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:31.077641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:29:31.077641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:29:31.077641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:29:31.077641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:29:31.077641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:29:31.077641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:29:31.077641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:29:31.077641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:31.077641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 543/1089] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:29:31.083073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d68ff-cf13-4001-9713-0aed600f3966 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:31.133972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:31.183775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d68ff-cf13-4001-9713-0aed600f3966 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:31.216181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b32ad1-cf10-4302-9d20-4483e55a23ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:31.216858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b32ad1-cf10-4302-9d20-4483e55a23ac None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:31.217721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b32ad1-cf10-4302-9d20-4483e55a23ac None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:31.217993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b32ad1-cf10-4302-9d20-4483e55a23ac None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:31.218812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b32ad1-cf10-4302-9d20-4483e55a23ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:31.219120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b32ad1-cf10-4302-9d20-4483e55a23ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:31.220534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b32ad1-cf10-4302-9d20-4483e55a23ac None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:31.232189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 547/1090] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:29:31.238230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb585a-92b9-4dd7-ae87-421c422a713d None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:31.336049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb585a-92b9-4dd7-ae87-421c422a713d None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:31.368038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c719a9-190a-4e3c-a1d6-d42b08462d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:31.368683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c719a9-190a-4e3c-a1d6-d42b08462d84 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:31.368963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c719a9-190a-4e3c-a1d6-d42b08462d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:31.369234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c719a9-190a-4e3c-a1d6-d42b08462d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:31.370065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c719a9-190a-4e3c-a1d6-d42b08462d84 None admin] RBAC: Adding query filter params (role.id=a0f92bdf90fe4ea48797ef8120146bf3, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=b8661ef27af34bbea11e215831d50843) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:31.370410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c719a9-190a-4e3c-a1d6-d42b08462d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:31.371824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c719a9-190a-4e3c-a1d6-d42b08462d84 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:31.375184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:31.378557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 544/1091] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:29:31 2022] GET /identity/v3/role_assignments?user.id=b8661ef27af34bbea11e215831d50843&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=a0f92bdf90fe4ea48797ef8120146bf3 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:31.390560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52fca-d4c3-4bff-9235-de71ffe5da54 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:31.390850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52fca-d4c3-4bff-9235-de71ffe5da54 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:31.391128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52fca-d4c3-4bff-9235-de71ffe5da54 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:31.392542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 548/1092] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:31.398648 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46ad65-4b4a-4929-aa49-13b361faf7ea None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:31.399011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46ad65-4b4a-4929-aa49-13b361faf7ea None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:31.399301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46ad65-4b4a-4929-aa49-13b361faf7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:31.419968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-3e46ad65-4b4a-4929-aa49-13b361faf7ea None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:31.421211 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3e46ad65-4b4a-4929-aa49-13b361faf7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:31.492432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 545/1093] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:31.516579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c52fca-d4c3-4bff-9235-de71ffe5da54 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:31.621583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c52fca-d4c3-4bff-9235-de71ffe5da54 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:31.632799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:31.656593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765411d-cc35-4639-b1a0-6e6575e7f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:31.657515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765411d-cc35-4639-b1a0-6e6575e7f7cb None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:31.657799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765411d-cc35-4639-b1a0-6e6575e7f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:31.658076 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765411d-cc35-4639-b1a0-6e6575e7f7cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:31.668869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765411d-cc35-4639-b1a0-6e6575e7f7cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-5765411d-cc35-4639-b1a0-6e6575e7f7cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:29:31.676934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:31.678085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:29:31.679443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 549/1094] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:29:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:31.684307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46ad65-4b4a-4929-aa49-13b361faf7ea None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:31.783345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46ad65-4b4a-4929-aa49-13b361faf7ea None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:31.814163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:31.819965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa883a1-3494-45b4-943d-b38959600106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:31.820638 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa883a1-3494-45b4-943d-b38959600106 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:31.820922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa883a1-3494-45b4-943d-b38959600106 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:31.821199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa883a1-3494-45b4-943d-b38959600106 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:31.821946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa883a1-3494-45b4-943d-b38959600106 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:31.822274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa883a1-3494-45b4-943d-b38959600106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:31.826947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa883a1-3494-45b4-943d-b38959600106 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:31.832165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 546/1095] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:29:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:31.838398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765411d-cc35-4639-b1a0-6e6575e7f7cb None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:31.942952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765411d-cc35-4639-b1a0-6e6575e7f7cb None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:31.975862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f393f55-8919-4c11-86db-b51ac5e37d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:31.976736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f393f55-8919-4c11-86db-b51ac5e37d1c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:31.977019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f393f55-8919-4c11-86db-b51ac5e37d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:31.977302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f393f55-8919-4c11-86db-b51ac5e37d1c None admin] PATH_INFO: `/v3/users/7599db1c16d349acb349dde196bce2e3` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:31.978508 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f393f55-8919-4c11-86db-b51ac5e37d1c None admin] RBAC: Authorizing `identity:get_user(user_id=7599db1c16d349acb349dde196bce2e3)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:31.979947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f393f55-8919-4c11-86db-b51ac5e37d1c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:31.981581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 550/1096] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:29:31 2022] GET /identity/v3/users/7599db1c16d349acb349dde196bce2e3 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:31.988019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa883a1-3494-45b4-943d-b38959600106 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:32.091287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa883a1-3494-45b4-943d-b38959600106 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:32.124910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8db9bb-890d-4d9e-912e-14d5eb3be85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:32.125768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8db9bb-890d-4d9e-912e-14d5eb3be85e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:32.126046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8db9bb-890d-4d9e-912e-14d5eb3be85e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:32.126345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8db9bb-890d-4d9e-912e-14d5eb3be85e None admin] PATH_INFO: `/v3/projects/dce7f384781f41f085dd11d45b77c207` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:32.127524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8db9bb-890d-4d9e-912e-14d5eb3be85e None admin] RBAC: Authorizing `identity:get_project(project_id=dce7f384781f41f085dd11d45b77c207)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:32.128957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8db9bb-890d-4d9e-912e-14d5eb3be85e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:32.130979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 547/1097] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:29:31 2022] GET /identity/v3/projects/dce7f384781f41f085dd11d45b77c207 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:32.136517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f393f55-8919-4c11-86db-b51ac5e37d1c None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:32.177061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:32.239094 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f393f55-8919-4c11-86db-b51ac5e37d1c None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:32.271762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d71f1-bfe9-4e51-b1d4-27f018c78fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:32.272651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d71f1-bfe9-4e51-b1d4-27f018c78fba None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:32.272936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d71f1-bfe9-4e51-b1d4-27f018c78fba None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:32.273210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d71f1-bfe9-4e51-b1d4-27f018c78fba None admin] PATH_INFO: `/v3/projects/dce7f384781f41f085dd11d45b77c207/users/7599db1c16d349acb349dde196bce2e3/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:32.275187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d71f1-bfe9-4e51-b1d4-27f018c78fba None admin] RBAC: Authorizing `identity:create_grant(project_id=dce7f384781f41f085dd11d45b77c207, user_id=7599db1c16d349acb349dde196bce2e3, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:32.276608 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d71f1-bfe9-4e51-b1d4-27f018c78fba None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:32.343468 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 551/1098] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:29:32 2022] PUT /identity/v3/projects/dce7f384781f41f085dd11d45b77c207/users/7599db1c16d349acb349dde196bce2e3/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:29:34.533887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3278525-25bd-4624-be5a-855e83e10653 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:34.534441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3278525-25bd-4624-be5a-855e83e10653 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:34.534441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3278525-25bd-4624-be5a-855e83e10653 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:34.535767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 548/1099] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:34.541156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8406e7-cf86-476a-9ee3-206ef624afd6 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:34.541583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8406e7-cf86-476a-9ee3-206ef624afd6 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:34.541699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8406e7-cf86-476a-9ee3-206ef624afd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:34.558890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-dd8406e7-cf86-476a-9ee3-206ef624afd6 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:34.560072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-dd8406e7-cf86-476a-9ee3-206ef624afd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:34.626048 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 552/1100] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:34.650149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3278525-25bd-4624-be5a-855e83e10653 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:34.709158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:34.749788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3278525-25bd-4624-be5a-855e83e10653 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:34.781642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c23049-f725-411a-82d1-8acd58174a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:34.782444 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23049-f725-411a-82d1-8acd58174a95 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:34.782727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23049-f725-411a-82d1-8acd58174a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:34.782998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23049-f725-411a-82d1-8acd58174a95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:34.792859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c23049-f725-411a-82d1-8acd58174a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-29c23049-f725-411a-82d1-8acd58174a95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:29:34.800961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:34.802059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:34.802993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 549/1101] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:29:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:34.808132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8406e7-cf86-476a-9ee3-206ef624afd6 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:34.835784 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:34.904542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8406e7-cf86-476a-9ee3-206ef624afd6 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:34.937673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d03a9-891f-4d68-8fed-b990b77d8e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:34.938350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d03a9-891f-4d68-8fed-b990b77d8e27 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:34.944062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d03a9-891f-4d68-8fed-b990b77d8e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:34.944062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d03a9-891f-4d68-8fed-b990b77d8e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:34.944062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d03a9-891f-4d68-8fed-b990b77d8e27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:34.944062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d03a9-891f-4d68-8fed-b990b77d8e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:34.944062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d03a9-891f-4d68-8fed-b990b77d8e27 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:34.949262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 553/1102] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:34.954965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c23049-f725-411a-82d1-8acd58174a95 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:35.051101 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c23049-f725-411a-82d1-8acd58174a95 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:35.069429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:35.082776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef8a97-de1f-44e8-87e4-cb83914571e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:35.083626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef8a97-de1f-44e8-87e4-cb83914571e7 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:35.083905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef8a97-de1f-44e8-87e4-cb83914571e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:35.084172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef8a97-de1f-44e8-87e4-cb83914571e7 None admin] PATH_INFO: `/v3/users/7599db1c16d349acb349dde196bce2e3` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:35.085328 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef8a97-de1f-44e8-87e4-cb83914571e7 None admin] RBAC: Authorizing `identity:get_user(user_id=7599db1c16d349acb349dde196bce2e3)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:35.086768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef8a97-de1f-44e8-87e4-cb83914571e7 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:35.088338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 550/1103] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:29:34 2022] GET /identity/v3/users/7599db1c16d349acb349dde196bce2e3 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:35.097214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d03a9-891f-4d68-8fed-b990b77d8e27 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:35.190702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:35.200075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d03a9-891f-4d68-8fed-b990b77d8e27 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:35.233408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b23a-95b4-4e72-9df8-5be5f3007718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:35.234051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b23a-95b4-4e72-9df8-5be5f3007718 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:35.234360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b23a-95b4-4e72-9df8-5be5f3007718 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:35.234635 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b23a-95b4-4e72-9df8-5be5f3007718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:35.297774 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067b23a-95b4-4e72-9df8-5be5f3007718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:35.299256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067b23a-95b4-4e72-9df8-5be5f3007718 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:35.383211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:35.393523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 554/1104] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:29:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:29:35.399452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef8a97-de1f-44e8-87e4-cb83914571e7 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:35.495652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef8a97-de1f-44e8-87e4-cb83914571e7 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:35.528149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519d415-78f9-426a-bd39-8a4a58cbc2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:35.529032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519d415-78f9-426a-bd39-8a4a58cbc2cb None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:35.529308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519d415-78f9-426a-bd39-8a4a58cbc2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:35.529577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519d415-78f9-426a-bd39-8a4a58cbc2cb None admin] PATH_INFO: `/v3/projects/dce7f384781f41f085dd11d45b77c207` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:35.530759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519d415-78f9-426a-bd39-8a4a58cbc2cb None admin] RBAC: Authorizing `identity:get_project(project_id=dce7f384781f41f085dd11d45b77c207)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:35.532168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519d415-78f9-426a-bd39-8a4a58cbc2cb None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:35.533826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 551/1105] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:29:35 2022] GET /identity/v3/projects/dce7f384781f41f085dd11d45b77c207 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:35.539739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b23a-95b4-4e72-9df8-5be5f3007718 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:35.643868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b23a-95b4-4e72-9df8-5be5f3007718 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:35.676345 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662a4f8-474a-424e-904c-b9886da177dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:35.676993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662a4f8-474a-424e-904c-b9886da177dc None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:35.677280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662a4f8-474a-424e-904c-b9886da177dc None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:35.677559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662a4f8-474a-424e-904c-b9886da177dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:35.678419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662a4f8-474a-424e-904c-b9886da177dc None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=dce7f384781f41f085dd11d45b77c207, user.id=7599db1c16d349acb349dde196bce2e3) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:35.678734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662a4f8-474a-424e-904c-b9886da177dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:35.680153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662a4f8-474a-424e-904c-b9886da177dc None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:35.686414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 555/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:29:35 2022] GET /identity/v3/role_assignments?user.id=7599db1c16d349acb349dde196bce2e3&scope.project.id=dce7f384781f41f085dd11d45b77c207&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:37.920194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62cb46-6c64-466b-b68d-c0e802c4e9d2 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:37.920719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62cb46-6c64-466b-b68d-c0e802c4e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:37.920836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62cb46-6c64-466b-b68d-c0e802c4e9d2 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:37.922119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 552/1107] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:37.927505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1359cfa-c557-4ffb-bb32-86fc72961c8d None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:37.927868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1359cfa-c557-4ffb-bb32-86fc72961c8d None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:37.928062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1359cfa-c557-4ffb-bb32-86fc72961c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:37.944284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-d1359cfa-c557-4ffb-bb32-86fc72961c8d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:37.945448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d1359cfa-c557-4ffb-bb32-86fc72961c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:37.994001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:38.011190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 556/1108] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:38.035973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62cb46-6c64-466b-b68d-c0e802c4e9d2 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:38.092006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:38.135694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62cb46-6c64-466b-b68d-c0e802c4e9d2 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:38.168431 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f7ad4-f11c-4fb6-93f4-a5051f7e2211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:38.169211 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f7ad4-f11c-4fb6-93f4-a5051f7e2211 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:38.169495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f7ad4-f11c-4fb6-93f4-a5051f7e2211 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:38.169800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f7ad4-f11c-4fb6-93f4-a5051f7e2211 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:38.171044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f7ad4-f11c-4fb6-93f4-a5051f7e2211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:38.172416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f7ad4-f11c-4fb6-93f4-a5051f7e2211 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:38.174015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 553/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:38.179800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1359cfa-c557-4ffb-bb32-86fc72961c8d None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:38.277545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1359cfa-c557-4ffb-bb32-86fc72961c8d None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:38.309232 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee1d0b-b3dd-42d0-b7f4-4705c69113f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:38.309891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee1d0b-b3dd-42d0-b7f4-4705c69113f8 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:38.310174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee1d0b-b3dd-42d0-b7f4-4705c69113f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:38.310965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee1d0b-b3dd-42d0-b7f4-4705c69113f8 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:38.311673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee1d0b-b3dd-42d0-b7f4-4705c69113f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:38.313092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee1d0b-b3dd-42d0-b7f4-4705c69113f8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:38.399681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 557/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:29:38 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:29:40.648081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0a9b-2d57-49b8-b541-32004fd068cf None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:40.648594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0a9b-2d57-49b8-b541-32004fd068cf None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:40.648715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0a9b-2d57-49b8-b541-32004fd068cf None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:40.649987 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 554/1111] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:40.655279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7515ab-912d-4663-97cc-2e3ce62eb61a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:40.655680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7515ab-912d-4663-97cc-2e3ce62eb61a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:40.655836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7515ab-912d-4663-97cc-2e3ce62eb61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:40.672699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-fe7515ab-912d-4663-97cc-2e3ce62eb61a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:40.673860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fe7515ab-912d-4663-97cc-2e3ce62eb61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:40.707255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:40.739153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 558/1112] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:40.762944 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b0a9b-2d57-49b8-b541-32004fd068cf None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:40.861769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b0a9b-2d57-49b8-b541-32004fd068cf None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:40.886599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:40.899030 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab65dda-f6f8-4d09-9e9f-466dd5142f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:40.899815 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65dda-f6f8-4d09-9e9f-466dd5142f44 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:40.900096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65dda-f6f8-4d09-9e9f-466dd5142f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:40.900371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65dda-f6f8-4d09-9e9f-466dd5142f44 None admin] PATH_INFO: `/v3/roles/d27765da961f442fa1ab376c59342273` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:40.901823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65dda-f6f8-4d09-9e9f-466dd5142f44 None admin] RBAC: Authorizing `identity:get_role(role_id=d27765da961f442fa1ab376c59342273)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:40.903239 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65dda-f6f8-4d09-9e9f-466dd5142f44 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:40.904601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 555/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:29:40 2022] GET /identity/v3/roles/d27765da961f442fa1ab376c59342273 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:40.910358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7515ab-912d-4663-97cc-2e3ce62eb61a None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:41.006028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7515ab-912d-4663-97cc-2e3ce62eb61a None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:41.038499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852e88b-e0d0-4a5a-ac7a-88deabfd7abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:41.039351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852e88b-e0d0-4a5a-ac7a-88deabfd7abf None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:41.039630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852e88b-e0d0-4a5a-ac7a-88deabfd7abf None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:41.039901 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852e88b-e0d0-4a5a-ac7a-88deabfd7abf None admin] PATH_INFO: `/v3/users/e44601bfe2cd4f72b34fa9608c7e1a6d` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:41.053056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852e88b-e0d0-4a5a-ac7a-88deabfd7abf None admin] RBAC: Authorizing `identity:get_user(user_id=e44601bfe2cd4f72b34fa9608c7e1a6d)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:41.054502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852e88b-e0d0-4a5a-ac7a-88deabfd7abf None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:41.056103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 559/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:29:40 2022] GET /identity/v3/users/e44601bfe2cd4f72b34fa9608c7e1a6d => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:41.061557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab65dda-f6f8-4d09-9e9f-466dd5142f44 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:41.161175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab65dda-f6f8-4d09-9e9f-466dd5142f44 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:41.193876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffe158-98c9-45b5-a816-03371ad74a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:41.194543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe158-98c9-45b5-a816-03371ad74a54 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:41.194830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe158-98c9-45b5-a816-03371ad74a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:41.195109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe158-98c9-45b5-a816-03371ad74a54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:41.252565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:41.262823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffe158-98c9-45b5-a816-03371ad74a54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:41.264331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffe158-98c9-45b5-a816-03371ad74a54 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:41.360538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 556/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:29:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:29:41.366408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852e88b-e0d0-4a5a-ac7a-88deabfd7abf None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:41.393809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:41.462631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852e88b-e0d0-4a5a-ac7a-88deabfd7abf None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:41.495042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c508b2-2a96-4378-be1e-88727980290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:41.495890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c508b2-2a96-4378-be1e-88727980290f None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:41.496177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c508b2-2a96-4378-be1e-88727980290f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:41.496451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c508b2-2a96-4378-be1e-88727980290f None admin] PATH_INFO: `/v3/projects/dce7f384781f41f085dd11d45b77c207` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:41.497638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c508b2-2a96-4378-be1e-88727980290f None admin] RBAC: Authorizing `identity:get_project(project_id=dce7f384781f41f085dd11d45b77c207)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:41.499096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c508b2-2a96-4378-be1e-88727980290f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:41.500754 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 560/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:29:41 2022] GET /identity/v3/projects/dce7f384781f41f085dd11d45b77c207 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:41.506783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffe158-98c9-45b5-a816-03371ad74a54 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:41.606063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:41.614327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffe158-98c9-45b5-a816-03371ad74a54 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:41.646784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63379ca8-1084-4d10-af4e-81a3d2f23311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:41.647421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379ca8-1084-4d10-af4e-81a3d2f23311 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:41.647700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379ca8-1084-4d10-af4e-81a3d2f23311 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:41.647971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379ca8-1084-4d10-af4e-81a3d2f23311 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:41.648787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63379ca8-1084-4d10-af4e-81a3d2f23311 None admin] RBAC: Adding query filter params (role.id=d27765da961f442fa1ab376c59342273, scope.project.id=dce7f384781f41f085dd11d45b77c207, user.id=e44601bfe2cd4f72b34fa9608c7e1a6d) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:41.649330 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63379ca8-1084-4d10-af4e-81a3d2f23311 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:41.650507 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63379ca8-1084-4d10-af4e-81a3d2f23311 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:41.656399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 557/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:29:41 2022] GET /identity/v3/role_assignments?user.id=e44601bfe2cd4f72b34fa9608c7e1a6d&scope.project.id=dce7f384781f41f085dd11d45b77c207&role.id=d27765da961f442fa1ab376c59342273 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:43.840338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0d95-82b3-4b66-93bb-e3ef07ca1583 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:43.840869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0d95-82b3-4b66-93bb-e3ef07ca1583 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:43.840869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0d95-82b3-4b66-93bb-e3ef07ca1583 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:43.842288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 561/1118] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:43.847596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74213fc-0f41-4430-88dd-a2e4d24dd519 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:43.848033 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74213fc-0f41-4430-88dd-a2e4d24dd519 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:43.848156 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74213fc-0f41-4430-88dd-a2e4d24dd519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:43.865011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-e74213fc-0f41-4430-88dd-a2e4d24dd519 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:43.866177 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e74213fc-0f41-4430-88dd-a2e4d24dd519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:43.930213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 558/1119] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:43.953291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd0d95-82b3-4b66-93bb-e3ef07ca1583 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:44.043334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:44.050162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd0d95-82b3-4b66-93bb-e3ef07ca1583 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:44.082891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c679e2a-011c-46bc-a221-4a43a6fc58c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:44.083734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c679e2a-011c-46bc-a221-4a43a6fc58c1 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:44.084020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c679e2a-011c-46bc-a221-4a43a6fc58c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:44.084295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c679e2a-011c-46bc-a221-4a43a6fc58c1 None admin] PATH_INFO: `/v3/roles/d27765da961f442fa1ab376c59342273` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:44.085744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c679e2a-011c-46bc-a221-4a43a6fc58c1 None admin] RBAC: Authorizing `identity:get_role(role_id=d27765da961f442fa1ab376c59342273)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:44.087145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c679e2a-011c-46bc-a221-4a43a6fc58c1 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:44.088484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 562/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:29:43 2022] GET /identity/v3/roles/d27765da961f442fa1ab376c59342273 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:44.094626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74213fc-0f41-4430-88dd-a2e4d24dd519 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:44.176587 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:44.190604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74213fc-0f41-4430-88dd-a2e4d24dd519 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:44.224088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad22da0-314b-4e37-a4f1-ccfb32e2d963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:44.224946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad22da0-314b-4e37-a4f1-ccfb32e2d963 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:44.225229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad22da0-314b-4e37-a4f1-ccfb32e2d963 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:44.225503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad22da0-314b-4e37-a4f1-ccfb32e2d963 None admin] PATH_INFO: `/v3/users/e44601bfe2cd4f72b34fa9608c7e1a6d` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:44.226699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad22da0-314b-4e37-a4f1-ccfb32e2d963 None admin] RBAC: Authorizing `identity:get_user(user_id=e44601bfe2cd4f72b34fa9608c7e1a6d)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:44.228113 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad22da0-314b-4e37-a4f1-ccfb32e2d963 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:44.229720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 559/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:29:44 2022] GET /identity/v3/users/e44601bfe2cd4f72b34fa9608c7e1a6d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:44.235960 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c679e2a-011c-46bc-a221-4a43a6fc58c1 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:44.330321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c679e2a-011c-46bc-a221-4a43a6fc58c1 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:44.362843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe4ea1-7984-434e-9228-84ccb0cbe393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:44.363620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe4ea1-7984-434e-9228-84ccb0cbe393 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:44.363893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe4ea1-7984-434e-9228-84ccb0cbe393 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:44.364158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe4ea1-7984-434e-9228-84ccb0cbe393 None admin] PATH_INFO: `/v3/projects/dce7f384781f41f085dd11d45b77c207` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:44.365303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe4ea1-7984-434e-9228-84ccb0cbe393 None admin] RBAC: Authorizing `identity:get_project(project_id=dce7f384781f41f085dd11d45b77c207)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:44.366731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe4ea1-7984-434e-9228-84ccb0cbe393 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:44.368370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 563/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:29:44 2022] GET /identity/v3/projects/dce7f384781f41f085dd11d45b77c207 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:44.373989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad22da0-314b-4e37-a4f1-ccfb32e2d963 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:44.470452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad22da0-314b-4e37-a4f1-ccfb32e2d963 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:44.504366 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bab4c-b43f-41f1-96e9-d9b3a21ad34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:44.505255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bab4c-b43f-41f1-96e9-d9b3a21ad34a None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:44.505538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bab4c-b43f-41f1-96e9-d9b3a21ad34a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:44.505812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bab4c-b43f-41f1-96e9-d9b3a21ad34a None admin] PATH_INFO: `/v3/projects/dce7f384781f41f085dd11d45b77c207/users/e44601bfe2cd4f72b34fa9608c7e1a6d/roles/d27765da961f442fa1ab376c59342273` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:44.507990 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bab4c-b43f-41f1-96e9-d9b3a21ad34a None admin] RBAC: Authorizing `identity:create_grant(project_id=dce7f384781f41f085dd11d45b77c207, user_id=e44601bfe2cd4f72b34fa9608c7e1a6d, role_id=d27765da961f442fa1ab376c59342273)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:44.509390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bab4c-b43f-41f1-96e9-d9b3a21ad34a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:44.575024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 560/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:29:44 2022] PUT /identity/v3/projects/dce7f384781f41f085dd11d45b77c207/users/e44601bfe2cd4f72b34fa9608c7e1a6d/roles/d27765da961f442fa1ab376c59342273 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:29:46.761142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980b04-67e7-4750-939b-d9e3ffebfd57 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:46.761689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980b04-67e7-4750-939b-d9e3ffebfd57 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:46.761689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980b04-67e7-4750-939b-d9e3ffebfd57 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:46.763231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 564/1124] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:29:46.768346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec8946-6551-4aec-b3b7-f7f446b6e20e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:46.768768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec8946-6551-4aec-b3b7-f7f446b6e20e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:46.768903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec8946-6551-4aec-b3b7-f7f446b6e20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:46.784769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-4cec8946-6551-4aec-b3b7-f7f446b6e20e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:46.785950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4cec8946-6551-4aec-b3b7-f7f446b6e20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:46.795964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:46.851812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 561/1125] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:46.875696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980b04-67e7-4750-939b-d9e3ffebfd57 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:46.912110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:46.980198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980b04-67e7-4750-939b-d9e3ffebfd57 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:47.013491 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b4d50-64da-405f-b980-d4f2b187a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:47.014293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b4d50-64da-405f-b980-d4f2b187a619 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:47.014576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b4d50-64da-405f-b980-d4f2b187a619 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:47.014847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b4d50-64da-405f-b980-d4f2b187a619 None admin] PATH_INFO: `/v3/roles/d27765da961f442fa1ab376c59342273` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:47.016285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b4d50-64da-405f-b980-d4f2b187a619 None admin] RBAC: Authorizing `identity:get_role(role_id=d27765da961f442fa1ab376c59342273)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:47.017626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b4d50-64da-405f-b980-d4f2b187a619 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:47.019010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 565/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:29:46 2022] GET /identity/v3/roles/d27765da961f442fa1ab376c59342273 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:47.024810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec8946-6551-4aec-b3b7-f7f446b6e20e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:47.120746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec8946-6551-4aec-b3b7-f7f446b6e20e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:47.153484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1251151-fd7b-4498-a2c2-dd7de4de53d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:47.154954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1251151-fd7b-4498-a2c2-dd7de4de53d2 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:47.155240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1251151-fd7b-4498-a2c2-dd7de4de53d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:47.155513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1251151-fd7b-4498-a2c2-dd7de4de53d2 None admin] PATH_INFO: `/v3/users/e44601bfe2cd4f72b34fa9608c7e1a6d` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:47.156694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1251151-fd7b-4498-a2c2-dd7de4de53d2 None admin] RBAC: Authorizing `identity:get_user(user_id=e44601bfe2cd4f72b34fa9608c7e1a6d)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:47.158119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1251151-fd7b-4498-a2c2-dd7de4de53d2 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:47.159938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 562/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:29:47 2022] GET /identity/v3/users/e44601bfe2cd4f72b34fa9608c7e1a6d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:47.165639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b4d50-64da-405f-b980-d4f2b187a619 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:47.260064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:47.262885 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b4d50-64da-405f-b980-d4f2b187a619 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:47.295624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1143167-e725-401d-90a7-05762cbcec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:47.296213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1143167-e725-401d-90a7-05762cbcec8e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:47.296501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1143167-e725-401d-90a7-05762cbcec8e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:47.296780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1143167-e725-401d-90a7-05762cbcec8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:47.361686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1143167-e725-401d-90a7-05762cbcec8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:47.363145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1143167-e725-401d-90a7-05762cbcec8e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:47.453996 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:47.457402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 566/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:29:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:29:47.463175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1251151-fd7b-4498-a2c2-dd7de4de53d2 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:47.478764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:47.560296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1251151-fd7b-4498-a2c2-dd7de4de53d2 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:47.593108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f506fdc-bc23-422b-8b5f-0a7ddd827324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:47.593955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f506fdc-bc23-422b-8b5f-0a7ddd827324 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:47.594265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f506fdc-bc23-422b-8b5f-0a7ddd827324 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:47.594549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f506fdc-bc23-422b-8b5f-0a7ddd827324 None admin] PATH_INFO: `/v3/projects/dce7f384781f41f085dd11d45b77c207` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:47.595713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f506fdc-bc23-422b-8b5f-0a7ddd827324 None admin] RBAC: Authorizing `identity:get_project(project_id=dce7f384781f41f085dd11d45b77c207)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:47.597126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f506fdc-bc23-422b-8b5f-0a7ddd827324 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:47.598838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 563/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:29:47 2022] GET /identity/v3/projects/dce7f384781f41f085dd11d45b77c207 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:47.604685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1143167-e725-401d-90a7-05762cbcec8e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:47.697939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1143167-e725-401d-90a7-05762cbcec8e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:47.731097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e332b2-1ac7-492a-b138-b10fe22fc6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:47.731747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e332b2-1ac7-492a-b138-b10fe22fc6ce None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:47.732032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e332b2-1ac7-492a-b138-b10fe22fc6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:47.732303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e332b2-1ac7-492a-b138-b10fe22fc6ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:47.733119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e332b2-1ac7-492a-b138-b10fe22fc6ce None admin] RBAC: Adding query filter params (role.id=d27765da961f442fa1ab376c59342273, scope.project.id=dce7f384781f41f085dd11d45b77c207, user.id=e44601bfe2cd4f72b34fa9608c7e1a6d) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:47.733424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e332b2-1ac7-492a-b138-b10fe22fc6ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:47.734854 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e332b2-1ac7-492a-b138-b10fe22fc6ce None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:47.740423 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 567/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:29:47 2022] GET /identity/v3/role_assignments?user.id=e44601bfe2cd4f72b34fa9608c7e1a6d&scope.project.id=dce7f384781f41f085dd11d45b77c207&role.id=d27765da961f442fa1ab376c59342273 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:49.966300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fafc2-911c-40be-a98c-6386cedb890b None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:49.966828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fafc2-911c-40be-a98c-6386cedb890b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:49.966938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fafc2-911c-40be-a98c-6386cedb890b None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:49.968234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 564/1131] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:49.973270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d968e6-bd0f-469e-84b9-7f202baa6745 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:49.973649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d968e6-bd0f-469e-84b9-7f202baa6745 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:49.973819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d968e6-bd0f-469e-84b9-7f202baa6745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:49.990491 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-b3d968e6-bd0f-469e-84b9-7f202baa6745 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:49.991641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b3d968e6-bd0f-469e-84b9-7f202baa6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:50.049414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:50.057430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 568/1132] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:50.080720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fafc2-911c-40be-a98c-6386cedb890b None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:50.163599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:50.183525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fafc2-911c-40be-a98c-6386cedb890b None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:50.217062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bb37f-aa1c-4ed3-9c35-622c9c45cff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:50.217784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb37f-aa1c-4ed3-9c35-622c9c45cff3 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:50.218069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb37f-aa1c-4ed3-9c35-622c9c45cff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:50.218375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb37f-aa1c-4ed3-9c35-622c9c45cff3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:50.219544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bb37f-aa1c-4ed3-9c35-622c9c45cff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:50.220965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bb37f-aa1c-4ed3-9c35-622c9c45cff3 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:50.222653 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 565/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:50.228421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d968e6-bd0f-469e-84b9-7f202baa6745 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:50.322053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d968e6-bd0f-469e-84b9-7f202baa6745 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:50.354522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e513a1-24c7-4563-aef1-df598c4f62b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:50.355167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e513a1-24c7-4563-aef1-df598c4f62b0 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:50.355449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e513a1-24c7-4563-aef1-df598c4f62b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:50.355723 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e513a1-24c7-4563-aef1-df598c4f62b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:50.356417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e513a1-24c7-4563-aef1-df598c4f62b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:50.358433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e513a1-24c7-4563-aef1-df598c4f62b0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:50.484891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 569/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:29:50 2022] POST /identity/v3/projects => generated 311 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:29:52.712527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed020-7022-41a7-8c53-68e4470701e1 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:52.713077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed020-7022-41a7-8c53-68e4470701e1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:52.713077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed020-7022-41a7-8c53-68e4470701e1 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:52.714443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 566/1135] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:52.719834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228d501-f18a-40e2-be71-433dfd475e74 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:52.720207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228d501-f18a-40e2-be71-433dfd475e74 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:52.720392 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228d501-f18a-40e2-be71-433dfd475e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:52.737144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-5228d501-f18a-40e2-be71-433dfd475e74 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:52.738340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5228d501-f18a-40e2-be71-433dfd475e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:52.778500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:52.802302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 570/1136] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:52.827520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ed020-7022-41a7-8c53-68e4470701e1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:52.926335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ed020-7022-41a7-8c53-68e4470701e1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:52.959110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c036b-0673-4414-a093-4313186384ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:52.959883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c036b-0673-4414-a093-4313186384ec None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:52.960165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c036b-0673-4414-a093-4313186384ec None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:52.960437 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c036b-0673-4414-a093-4313186384ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:52.961597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c036b-0673-4414-a093-4313186384ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:52.963097 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c036b-0673-4414-a093-4313186384ec None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:52.964631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 567/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:29:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:52.970382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228d501-f18a-40e2-be71-433dfd475e74 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:53.064566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228d501-f18a-40e2-be71-433dfd475e74 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:53.097077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cf4d3-251a-4f96-b40b-7b3ecc4e1c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:53.097731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cf4d3-251a-4f96-b40b-7b3ecc4e1c43 None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:53.098011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cf4d3-251a-4f96-b40b-7b3ecc4e1c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:53.098310 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cf4d3-251a-4f96-b40b-7b3ecc4e1c43 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:53.099013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cf4d3-251a-4f96-b40b-7b3ecc4e1c43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:53.100426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cf4d3-251a-4f96-b40b-7b3ecc4e1c43 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:53.209407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 571/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:29:52 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:29:55.555685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb1f13-5267-452e-8e86-f7d2869865d1 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:55.556208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb1f13-5267-452e-8e86-f7d2869865d1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:55.556208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb1f13-5267-452e-8e86-f7d2869865d1 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:55.557520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 568/1139] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:55.563484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688efb-161c-4c75-b28e-b0a533988835 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:55.563882 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688efb-161c-4c75-b28e-b0a533988835 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:55.564034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688efb-161c-4c75-b28e-b0a533988835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:55.581172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a4688efb-161c-4c75-b28e-b0a533988835 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:55.582376 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a4688efb-161c-4c75-b28e-b0a533988835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:55.606867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:55.646966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 572/1140] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:55.670904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb1f13-5267-452e-8e86-f7d2869865d1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:55.689115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:55.769681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb1f13-5267-452e-8e86-f7d2869865d1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:55.803321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329015b-271b-4734-8907-c2d39d4f9f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:55.804092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329015b-271b-4734-8907-c2d39d4f9f7a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:55.804375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329015b-271b-4734-8907-c2d39d4f9f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:55.804649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329015b-271b-4734-8907-c2d39d4f9f7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:55.815065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329015b-271b-4734-8907-c2d39d4f9f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-4329015b-271b-4734-8907-c2d39d4f9f7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:29:55.822465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:55.823558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:55.824838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 569/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:29:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:55.829963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4688efb-161c-4c75-b28e-b0a533988835 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:55.924555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4688efb-161c-4c75-b28e-b0a533988835 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:55.957712 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd63f6-8226-4f63-817f-c40e7e0b9a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:55.958405 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd63f6-8226-4f63-817f-c40e7e0b9a4e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:55.958694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd63f6-8226-4f63-817f-c40e7e0b9a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:55.958972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd63f6-8226-4f63-817f-c40e7e0b9a4e None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:55.959717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd63f6-8226-4f63-817f-c40e7e0b9a4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:55.960028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd63f6-8226-4f63-817f-c40e7e0b9a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:55.961388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd63f6-8226-4f63-817f-c40e7e0b9a4e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:55.969263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 573/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:55.974909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329015b-271b-4734-8907-c2d39d4f9f7a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:56.050258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:56.071844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329015b-271b-4734-8907-c2d39d4f9f7a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:56.103643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cb41a-050a-42b0-b0b2-6105ff9a650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:56.104482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb41a-050a-42b0-b0b2-6105ff9a650a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:56.104765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb41a-050a-42b0-b0b2-6105ff9a650a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:56.105037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb41a-050a-42b0-b0b2-6105ff9a650a None admin] PATH_INFO: `/v3/users/14e3f7a3bedd4ae187edbad73eeecebc` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:56.118895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cb41a-050a-42b0-b0b2-6105ff9a650a None admin] RBAC: Authorizing `identity:get_user(user_id=14e3f7a3bedd4ae187edbad73eeecebc)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:56.120334 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cb41a-050a-42b0-b0b2-6105ff9a650a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:56.122303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 570/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:29:55 2022] GET /identity/v3/users/14e3f7a3bedd4ae187edbad73eeecebc => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:56.127946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd63f6-8226-4f63-817f-c40e7e0b9a4e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:56.153087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:56.230730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd63f6-8226-4f63-817f-c40e7e0b9a4e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:56.263279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba905bd-62f4-4ffd-a3b7-58cedc8a184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:56.263918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba905bd-62f4-4ffd-a3b7-58cedc8a184c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:56.264202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba905bd-62f4-4ffd-a3b7-58cedc8a184c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:56.264474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba905bd-62f4-4ffd-a3b7-58cedc8a184c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:56.329207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba905bd-62f4-4ffd-a3b7-58cedc8a184c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:56.330622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba905bd-62f4-4ffd-a3b7-58cedc8a184c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:56.353544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:56.425536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 574/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:29:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:29:56.431561 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cb41a-050a-42b0-b0b2-6105ff9a650a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:56.527168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cb41a-050a-42b0-b0b2-6105ff9a650a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:56.561990 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f7195-2616-4b40-8491-2a9945620604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:56.562868 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7195-2616-4b40-8491-2a9945620604 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:56.563151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7195-2616-4b40-8491-2a9945620604 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:56.563422 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7195-2616-4b40-8491-2a9945620604 None admin] PATH_INFO: `/v3/projects/45f14d0502394f348dc5735239baf0c8` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:56.564598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f7195-2616-4b40-8491-2a9945620604 None admin] RBAC: Authorizing `identity:get_project(project_id=45f14d0502394f348dc5735239baf0c8)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:56.566009 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f7195-2616-4b40-8491-2a9945620604 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:56.567726 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 571/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:29:56 2022] GET /identity/v3/projects/45f14d0502394f348dc5735239baf0c8 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:56.574265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba905bd-62f4-4ffd-a3b7-58cedc8a184c None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:56.670858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba905bd-62f4-4ffd-a3b7-58cedc8a184c None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:56.692851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:56.703634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7645bc-3df4-4574-9f37-077dae4a56a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:56.704277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7645bc-3df4-4574-9f37-077dae4a56a5 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:56.704560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7645bc-3df4-4574-9f37-077dae4a56a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:56.704836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7645bc-3df4-4574-9f37-077dae4a56a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:56.705661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7645bc-3df4-4574-9f37-077dae4a56a5 None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=45f14d0502394f348dc5735239baf0c8, user.id=14e3f7a3bedd4ae187edbad73eeecebc) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:56.705972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7645bc-3df4-4574-9f37-077dae4a56a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:56.707425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7645bc-3df4-4574-9f37-077dae4a56a5 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:56.712594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 575/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:29:56 2022] GET /identity/v3/role_assignments?user.id=14e3f7a3bedd4ae187edbad73eeecebc&scope.project.id=45f14d0502394f348dc5735239baf0c8&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:58.901662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a207868-4775-4489-8a03-0c7949694c10 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:58.902195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a207868-4775-4489-8a03-0c7949694c10 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:58.902195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a207868-4775-4489-8a03-0c7949694c10 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:58.903625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 572/1147] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:29:58.908979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e473b-b626-4277-ab40-eb0e90308867 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:58.909396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e473b-b626-4277-ab40-eb0e90308867 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:58.909536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e473b-b626-4277-ab40-eb0e90308867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:58.926366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-bc1e473b-b626-4277-ab40-eb0e90308867 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:29:58.927545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-bc1e473b-b626-4277-ab40-eb0e90308867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:29:58.993335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 576/1148] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:29:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:29:59.015791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a207868-4775-4489-8a03-0c7949694c10 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:59.018649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:59.114691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a207868-4775-4489-8a03-0c7949694c10 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:59.147598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545e8c4-a3c5-4614-8905-c018cc317d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:59.148378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545e8c4-a3c5-4614-8905-c018cc317d2f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:59.148656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545e8c4-a3c5-4614-8905-c018cc317d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:59.148929 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545e8c4-a3c5-4614-8905-c018cc317d2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:59.159500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545e8c4-a3c5-4614-8905-c018cc317d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-8545e8c4-a3c5-4614-8905-c018cc317d2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:29:59.166933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:29:59.168026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:29:59.169771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 573/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:29:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:29:59.174582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e473b-b626-4277-ab40-eb0e90308867 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:59.273279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e473b-b626-4277-ab40-eb0e90308867 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:59.290034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:59.306471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da058268-3ef0-4783-98e1-3381db00fff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:59.307128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058268-3ef0-4783-98e1-3381db00fff0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:59.307415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058268-3ef0-4783-98e1-3381db00fff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:59.307690 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058268-3ef0-4783-98e1-3381db00fff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:59.308433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da058268-3ef0-4783-98e1-3381db00fff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:29:59.308739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da058268-3ef0-4783-98e1-3381db00fff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:59.310151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da058268-3ef0-4783-98e1-3381db00fff0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:59.318217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 577/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:59.323899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545e8c4-a3c5-4614-8905-c018cc317d2f None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:59.383097 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:59.420740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545e8c4-a3c5-4614-8905-c018cc317d2f None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:59.453032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c18d7-1ace-4887-84d5-e4b4baddfabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:59.453876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c18d7-1ace-4887-84d5-e4b4baddfabf None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:59.454158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c18d7-1ace-4887-84d5-e4b4baddfabf None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:59.454458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c18d7-1ace-4887-84d5-e4b4baddfabf None admin] PATH_INFO: `/v3/users/14e3f7a3bedd4ae187edbad73eeecebc` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:59.455623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c18d7-1ace-4887-84d5-e4b4baddfabf None admin] RBAC: Authorizing `identity:get_user(user_id=14e3f7a3bedd4ae187edbad73eeecebc)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:59.457031 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c18d7-1ace-4887-84d5-e4b4baddfabf None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:59.458661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 574/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:29:59 2022] GET /identity/v3/users/14e3f7a3bedd4ae187edbad73eeecebc => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:59.464280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da058268-3ef0-4783-98e1-3381db00fff0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:59.567256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da058268-3ef0-4783-98e1-3381db00fff0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:59.600205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3e74d-3f56-4c47-9f01-b02e9c4a6ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:59.601033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e74d-3f56-4c47-9f01-b02e9c4a6ada None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:59.601316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e74d-3f56-4c47-9f01-b02e9c4a6ada None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:59.601589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e74d-3f56-4c47-9f01-b02e9c4a6ada None admin] PATH_INFO: `/v3/projects/45f14d0502394f348dc5735239baf0c8` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:59.602765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3e74d-3f56-4c47-9f01-b02e9c4a6ada None admin] RBAC: Authorizing `identity:get_project(project_id=45f14d0502394f348dc5735239baf0c8)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:59.604174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3e74d-3f56-4c47-9f01-b02e9c4a6ada None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:59.605828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 578/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:29:59 2022] GET /identity/v3/projects/45f14d0502394f348dc5735239baf0c8 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:29:59.611482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c18d7-1ace-4887-84d5-e4b4baddfabf None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:29:59.706678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c18d7-1ace-4887-84d5-e4b4baddfabf None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:29:59.733466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:29:59.738976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772b026-41c6-444e-946b-0cb475761e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:29:59.739841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772b026-41c6-444e-946b-0cb475761e34 None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:29:59.740116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772b026-41c6-444e-946b-0cb475761e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:29:59.740385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772b026-41c6-444e-946b-0cb475761e34 None admin] PATH_INFO: `/v3/projects/45f14d0502394f348dc5735239baf0c8/users/14e3f7a3bedd4ae187edbad73eeecebc/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:29:59.742317 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772b026-41c6-444e-946b-0cb475761e34 None admin] RBAC: Authorizing `identity:create_grant(project_id=45f14d0502394f348dc5735239baf0c8, user_id=14e3f7a3bedd4ae187edbad73eeecebc, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:29:59.743710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772b026-41c6-444e-946b-0cb475761e34 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:29:59.861881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 575/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:29:59 2022] PUT /identity/v3/projects/45f14d0502394f348dc5735239baf0c8/users/14e3f7a3bedd4ae187edbad73eeecebc/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:30:02.042861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a07a-5df4-4731-980d-d02b2b8627e9 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:02.043446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a07a-5df4-4731-980d-d02b2b8627e9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:02.043446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a07a-5df4-4731-980d-d02b2b8627e9 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:02.045337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 579/1154] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:30:02.050478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a345e-92fd-42c3-a0db-9e6563f17b36 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:02.050896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a345e-92fd-42c3-a0db-9e6563f17b36 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:02.051030 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a345e-92fd-42c3-a0db-9e6563f17b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:02.067778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9b2a345e-92fd-42c3-a0db-9e6563f17b36 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:30:02.068949 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9b2a345e-92fd-42c3-a0db-9e6563f17b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:30:02.132785 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 576/1155] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:30:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:30:02.156471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9a07a-5df4-4731-980d-d02b2b8627e9 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:02.205214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:02.254597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9a07a-5df4-4731-980d-d02b2b8627e9 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:02.286467 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85022251-6646-4b02-8a9f-8b07f7cede81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:02.287236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85022251-6646-4b02-8a9f-8b07f7cede81 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:02.287516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85022251-6646-4b02-8a9f-8b07f7cede81 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:02.287782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85022251-6646-4b02-8a9f-8b07f7cede81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:02.298147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85022251-6646-4b02-8a9f-8b07f7cede81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-85022251-6646-4b02-8a9f-8b07f7cede81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:30:02.305616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:30:02.306791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:30:02.307847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 580/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:30:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:30:02.312645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a345e-92fd-42c3-a0db-9e6563f17b36 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:02.407940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a345e-92fd-42c3-a0db-9e6563f17b36 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:02.426875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:02.440038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177004a-e5dd-4711-9e4a-54f803293735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:02.440690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177004a-e5dd-4711-9e4a-54f803293735 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:02.440971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177004a-e5dd-4711-9e4a-54f803293735 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:02.441243 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177004a-e5dd-4711-9e4a-54f803293735 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:02.441978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177004a-e5dd-4711-9e4a-54f803293735 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:30:02.442305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177004a-e5dd-4711-9e4a-54f803293735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:02.443660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177004a-e5dd-4711-9e4a-54f803293735 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:02.452105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 577/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:30:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:02.457629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85022251-6646-4b02-8a9f-8b07f7cede81 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:02.553415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85022251-6646-4b02-8a9f-8b07f7cede81 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:02.561862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:02.586406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e463-9518-429f-b4e3-6aa938ff9840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:02.587262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e463-9518-429f-b4e3-6aa938ff9840 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:02.587539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e463-9518-429f-b4e3-6aa938ff9840 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:02.587813 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e463-9518-429f-b4e3-6aa938ff9840 None admin] PATH_INFO: `/v3/users/14e3f7a3bedd4ae187edbad73eeecebc` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:02.588975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e463-9518-429f-b4e3-6aa938ff9840 None admin] RBAC: Authorizing `identity:get_user(user_id=14e3f7a3bedd4ae187edbad73eeecebc)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:02.591007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e463-9518-429f-b4e3-6aa938ff9840 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:02.592661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 581/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:30:02 2022] GET /identity/v3/users/14e3f7a3bedd4ae187edbad73eeecebc => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:02.598518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177004a-e5dd-4711-9e4a-54f803293735 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:02.695648 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177004a-e5dd-4711-9e4a-54f803293735 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:02.728573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f803736-98fd-4291-965b-7370ea4fc6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:02.729206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803736-98fd-4291-965b-7370ea4fc6de None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:02.729489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803736-98fd-4291-965b-7370ea4fc6de None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:02.729765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803736-98fd-4291-965b-7370ea4fc6de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:02.777035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:02.794528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f803736-98fd-4291-965b-7370ea4fc6de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:02.795959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f803736-98fd-4291-965b-7370ea4fc6de None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:02.891188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 578/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:30:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:30:02.896873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e463-9518-429f-b4e3-6aa938ff9840 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:02.990966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e463-9518-429f-b4e3-6aa938ff9840 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:03.023651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4b939-b61e-4490-8837-9b18699a66bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:03.024501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4b939-b61e-4490-8837-9b18699a66bb None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:03.024779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4b939-b61e-4490-8837-9b18699a66bb None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:03.025052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4b939-b61e-4490-8837-9b18699a66bb None admin] PATH_INFO: `/v3/projects/45f14d0502394f348dc5735239baf0c8` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:03.026211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4b939-b61e-4490-8837-9b18699a66bb None admin] RBAC: Authorizing `identity:get_project(project_id=45f14d0502394f348dc5735239baf0c8)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:03.027657 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4b939-b61e-4490-8837-9b18699a66bb None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:03.029326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 582/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:30:02 2022] GET /identity/v3/projects/45f14d0502394f348dc5735239baf0c8 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:03.035167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f803736-98fd-4291-965b-7370ea4fc6de None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:03.112938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:03.130790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f803736-98fd-4291-965b-7370ea4fc6de None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:03.164429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869c76e-b8ef-429e-a5c2-1814b451511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:03.165078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c76e-b8ef-429e-a5c2-1814b451511f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:03.165362 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c76e-b8ef-429e-a5c2-1814b451511f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:03.165634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c76e-b8ef-429e-a5c2-1814b451511f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:03.166490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869c76e-b8ef-429e-a5c2-1814b451511f None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=45f14d0502394f348dc5735239baf0c8, user.id=14e3f7a3bedd4ae187edbad73eeecebc) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:30:03.166800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869c76e-b8ef-429e-a5c2-1814b451511f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:03.168208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869c76e-b8ef-429e-a5c2-1814b451511f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:03.174393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 579/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:30:03 2022] GET /identity/v3/role_assignments?user.id=14e3f7a3bedd4ae187edbad73eeecebc&scope.project.id=45f14d0502394f348dc5735239baf0c8&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:05.393038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50523a8-0923-43ae-aad3-6ee98798264c None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:05.393529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50523a8-0923-43ae-aad3-6ee98798264c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:05.393529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50523a8-0923-43ae-aad3-6ee98798264c None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:05.394906 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 583/1162] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:30:05.400292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b45f2-387a-4a2e-a71e-c04bcd4ffe30 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:05.400667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b45f2-387a-4a2e-a71e-c04bcd4ffe30 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:05.400856 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b45f2-387a-4a2e-a71e-c04bcd4ffe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:05.417816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-618b45f2-387a-4a2e-a71e-c04bcd4ffe30 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:30:05.419016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-618b45f2-387a-4a2e-a71e-c04bcd4ffe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:30:05.483738 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 580/1163] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:30:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:30:05.505589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50523a8-0923-43ae-aad3-6ee98798264c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:05.550809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:05.603174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50523a8-0923-43ae-aad3-6ee98798264c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:05.635317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3fb13-b181-4d2a-b529-cff45d79ef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:05.635939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3fb13-b181-4d2a-b529-cff45d79ef98 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:05.636218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3fb13-b181-4d2a-b529-cff45d79ef98 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:05.636485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3fb13-b181-4d2a-b529-cff45d79ef98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:05.699722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3fb13-b181-4d2a-b529-cff45d79ef98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:05.701086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3fb13-b181-4d2a-b529-cff45d79ef98 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:05.742022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:05.796675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 584/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:30:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:30:05.802616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b45f2-387a-4a2e-a71e-c04bcd4ffe30 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:05.897568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:05.922373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b45f2-387a-4a2e-a71e-c04bcd4ffe30 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:05.963771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434b43f-0bef-4503-adf0-588d87c1cc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:05.964824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434b43f-0bef-4503-adf0-588d87c1cc10 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:05.965102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434b43f-0bef-4503-adf0-588d87c1cc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:05.965899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434b43f-0bef-4503-adf0-588d87c1cc10 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:05.973275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434b43f-0bef-4503-adf0-588d87c1cc10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:05.974751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434b43f-0bef-4503-adf0-588d87c1cc10 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-2434b43f-0bef-4503-adf0-588d87c1cc10 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:30:05.989247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:30:05.990354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 08 06:30:05.991412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:30:05.998427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 581/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jun 8 06:30:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:30:05.998584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3fb13-b181-4d2a-b529-cff45d79ef98 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:06.102386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3fb13-b181-4d2a-b529-cff45d79ef98 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:06.145685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b80bb-bda2-483e-8ab8-1cf294b65020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:06.146400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b80bb-bda2-483e-8ab8-1cf294b65020 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:06.146689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b80bb-bda2-483e-8ab8-1cf294b65020 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:06.146951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b80bb-bda2-483e-8ab8-1cf294b65020 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:06.147677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b80bb-bda2-483e-8ab8-1cf294b65020 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:30:06.147980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b80bb-bda2-483e-8ab8-1cf294b65020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:06.149350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b80bb-bda2-483e-8ab8-1cf294b65020 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:06.159196 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 585/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jun 8 06:30:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:08.369534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5678c54-ebd3-41a9-b1c5-6fca38939988 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:08.370040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5678c54-ebd3-41a9-b1c5-6fca38939988 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:08.370155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5678c54-ebd3-41a9-b1c5-6fca38939988 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:08.371477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 582/1167] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:30:08.376566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c972951-8b46-4445-8add-aef6ebccd058 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:08.376992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c972951-8b46-4445-8add-aef6ebccd058 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:08.377120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c972951-8b46-4445-8add-aef6ebccd058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:08.393891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-3c972951-8b46-4445-8add-aef6ebccd058 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:30:08.395042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3c972951-8b46-4445-8add-aef6ebccd058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:30:08.396937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:08.459401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 586/1168] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:30:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:30:08.482377 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5678c54-ebd3-41a9-b1c5-6fca38939988 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:08.580810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5678c54-ebd3-41a9-b1c5-6fca38939988 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:08.613234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f374f-78c8-457f-a179-6f24af751351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:08.613874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f374f-78c8-457f-a179-6f24af751351 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:08.614154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f374f-78c8-457f-a179-6f24af751351 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:08.614458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f374f-78c8-457f-a179-6f24af751351 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:08.615197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f374f-78c8-457f-a179-6f24af751351 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:08.616538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f374f-78c8-457f-a179-6f24af751351 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:08.619874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:08.731967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 583/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Wed Jun 8 06:30:08 2022] POST /identity/v3/domains => generated 267 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:30:10.970025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dfab6-e565-4775-8010-a36976bf09c0 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:10.970613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dfab6-e565-4775-8010-a36976bf09c0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:10.970613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dfab6-e565-4775-8010-a36976bf09c0 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:10.971964 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 587/1170] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:30:10.977061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3f495-b62e-4401-93d1-ab3a7f4cb2c1 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:10.977423 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3f495-b62e-4401-93d1-ab3a7f4cb2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:10.977634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3f495-b62e-4401-93d1-ab3a7f4cb2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:10.994555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-1fe3f495-b62e-4401-93d1-ab3a7f4cb2c1 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:30:10.995727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1fe3f495-b62e-4401-93d1-ab3a7f4cb2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:30:11.060528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 584/1171] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:30:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:30:11.083272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dfab6-e565-4775-8010-a36976bf09c0 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:11.181326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dfab6-e565-4775-8010-a36976bf09c0 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:11.214117 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4a73e-525a-4cd5-b950-644a9fda1eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:11.215499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4a73e-525a-4cd5-b950-644a9fda1eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:11.215789 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4a73e-525a-4cd5-b950-644a9fda1eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:11.216058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4a73e-525a-4cd5-b950-644a9fda1eb7 None admin] PATH_INFO: `/v3/domains/bda60a49b3b94b988171a83e1ab39ec6` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:11.222636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:11.226622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4a73e-525a-4cd5-b950-644a9fda1eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bda60a49b3b94b988171a83e1ab39ec6)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:11.228133 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4a73e-525a-4cd5-b950-644a9fda1eb7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:11.229766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 588/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Jun 8 06:30:11 2022] GET /identity/v3/domains/bda60a49b3b94b988171a83e1ab39ec6 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:11.236421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3f495-b62e-4401-93d1-ab3a7f4cb2c1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:11.339753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3f495-b62e-4401-93d1-ab3a7f4cb2c1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:11.368222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:11.376654 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadaa41-499e-4cfa-a957-413c870757f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:11.377313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadaa41-499e-4cfa-a957-413c870757f1 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:11.377596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadaa41-499e-4cfa-a957-413c870757f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:11.377871 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadaa41-499e-4cfa-a957-413c870757f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:11.378618 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadaa41-499e-4cfa-a957-413c870757f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:11.380043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadaa41-499e-4cfa-a957-413c870757f1 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:11.462384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 585/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:30:11 2022] POST /identity/v3/projects => generated 361 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:30:13.725161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e59e0e-86e9-4975-aa31-9993af6dd6a8 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:13.725682 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e59e0e-86e9-4975-aa31-9993af6dd6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:13.725772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e59e0e-86e9-4975-aa31-9993af6dd6a8 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:13.727129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 589/1174] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:30:13.732750 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d34c3-bd2f-4243-99df-9b193121064d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:13.733151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d34c3-bd2f-4243-99df-9b193121064d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:13.733310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d34c3-bd2f-4243-99df-9b193121064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:13.750469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-706d34c3-bd2f-4243-99df-9b193121064d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:30:13.751646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-706d34c3-bd2f-4243-99df-9b193121064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:30:13.815060 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 586/1175] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:30:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:30:13.839525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e59e0e-86e9-4975-aa31-9993af6dd6a8 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:13.937693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e59e0e-86e9-4975-aa31-9993af6dd6a8 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:13.969493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbaaf70-cfb7-48e7-9955-ced06f283e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:13.970393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaaf70-cfb7-48e7-9955-ced06f283e7c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:13.970676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaaf70-cfb7-48e7-9955-ced06f283e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:13.970948 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaaf70-cfb7-48e7-9955-ced06f283e7c None admin] PATH_INFO: `/v3/domains/bda60a49b3b94b988171a83e1ab39ec6` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:13.972110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbaaf70-cfb7-48e7-9955-ced06f283e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=bda60a49b3b94b988171a83e1ab39ec6)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:13.973533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbaaf70-cfb7-48e7-9955-ced06f283e7c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:13.975216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 590/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Jun 8 06:30:13 2022] GET /identity/v3/domains/bda60a49b3b94b988171a83e1ab39ec6 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:13.981274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d34c3-bd2f-4243-99df-9b193121064d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:14.076437 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d34c3-bd2f-4243-99df-9b193121064d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:14.085965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:14.110153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a89c6e-0c5a-4d23-901f-54a91c332966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:14.110831 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89c6e-0c5a-4d23-901f-54a91c332966 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:14.111109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89c6e-0c5a-4d23-901f-54a91c332966 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:14.111380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89c6e-0c5a-4d23-901f-54a91c332966 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:14.112074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a89c6e-0c5a-4d23-901f-54a91c332966 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:14.113491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a89c6e-0c5a-4d23-901f-54a91c332966 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:14.221394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 587/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:30:13 2022] POST /identity/v3/users => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:30:16.465678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cca1d0-7276-46f0-8685-67298d387ab1 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:16.466171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cca1d0-7276-46f0-8685-67298d387ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:16.466171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cca1d0-7276-46f0-8685-67298d387ab1 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:16.467542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 591/1178] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:30:16.472857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f670-8739-445f-9434-3df74c14bfdb None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:16.473278 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f670-8739-445f-9434-3df74c14bfdb None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:16.473505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f670-8739-445f-9434-3df74c14bfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:16.490522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-1c57f670-8739-445f-9434-3df74c14bfdb None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:30:16.491703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1c57f670-8739-445f-9434-3df74c14bfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:30:16.558391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 588/1179] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:30:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:30:16.583148 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cca1d0-7276-46f0-8685-67298d387ab1 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:16.648803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:16.682514 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cca1d0-7276-46f0-8685-67298d387ab1 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:16.718355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48a96f-ce2e-406a-b4ad-c5f2ea200702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:16.719097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48a96f-ce2e-406a-b4ad-c5f2ea200702 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:16.719381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48a96f-ce2e-406a-b4ad-c5f2ea200702 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:16.719662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48a96f-ce2e-406a-b4ad-c5f2ea200702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:16.729661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48a96f-ce2e-406a-b4ad-c5f2ea200702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-9b48a96f-ce2e-406a-b4ad-c5f2ea200702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:30:16.737730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:30:16.738700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:30:16.739551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 592/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:30:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:30:16.745058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f670-8739-445f-9434-3df74c14bfdb None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:16.839257 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:16.846143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f670-8739-445f-9434-3df74c14bfdb None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:16.880590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230502-2265-46d6-bd72-a4874c0ff714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:16.881251 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230502-2265-46d6-bd72-a4874c0ff714 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:16.881540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230502-2265-46d6-bd72-a4874c0ff714 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:16.881818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230502-2265-46d6-bd72-a4874c0ff714 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:16.882613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73230502-2265-46d6-bd72-a4874c0ff714 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:30:16.882922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73230502-2265-46d6-bd72-a4874c0ff714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:16.884278 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73230502-2265-46d6-bd72-a4874c0ff714 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:16.892104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 589/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:30:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:16.897918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48a96f-ce2e-406a-b4ad-c5f2ea200702 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:17.000242 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48a96f-ce2e-406a-b4ad-c5f2ea200702 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:17.027173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:17.036700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3c82e-0574-46d0-978d-bea0676f8ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:17.039553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3c82e-0574-46d0-978d-bea0676f8ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:17.039553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3c82e-0574-46d0-978d-bea0676f8ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:17.039553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3c82e-0574-46d0-978d-bea0676f8ee4 None admin] PATH_INFO: `/v3/users/82ce66ed81af491cbe32a49f6a2e0900` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:17.051504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3c82e-0574-46d0-978d-bea0676f8ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=82ce66ed81af491cbe32a49f6a2e0900)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:17.052953 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3c82e-0574-46d0-978d-bea0676f8ee4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:17.059165 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 593/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:30:16 2022] GET /identity/v3/users/82ce66ed81af491cbe32a49f6a2e0900 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:17.060333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230502-2265-46d6-bd72-a4874c0ff714 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:17.162776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230502-2265-46d6-bd72-a4874c0ff714 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:17.200880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142da51-6d72-45a2-b508-5edb79d0286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:17.201527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142da51-6d72-45a2-b508-5edb79d0286b None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:17.201811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142da51-6d72-45a2-b508-5edb79d0286b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:17.202089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142da51-6d72-45a2-b508-5edb79d0286b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:17.228271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:17.275430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142da51-6d72-45a2-b508-5edb79d0286b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:17.276905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142da51-6d72-45a2-b508-5edb79d0286b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:17.376957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 590/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:30:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:30:17.382838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3c82e-0574-46d0-978d-bea0676f8ee4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:17.483508 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3c82e-0574-46d0-978d-bea0676f8ee4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:17.516620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f298eb-5ae4-452e-bd57-1df4099f4df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:17.517470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f298eb-5ae4-452e-bd57-1df4099f4df6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:17.517756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f298eb-5ae4-452e-bd57-1df4099f4df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:17.518030 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f298eb-5ae4-452e-bd57-1df4099f4df6 None admin] PATH_INFO: `/v3/projects/aff1fa34ea0c4d32ab743da6e1994b4c` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:17.519225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f298eb-5ae4-452e-bd57-1df4099f4df6 None admin] RBAC: Authorizing `identity:get_project(project_id=aff1fa34ea0c4d32ab743da6e1994b4c)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:17.520645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f298eb-5ae4-452e-bd57-1df4099f4df6 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:17.522360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 594/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:30:17 2022] GET /identity/v3/projects/aff1fa34ea0c4d32ab743da6e1994b4c => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:30:17.528900 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142da51-6d72-45a2-b508-5edb79d0286b None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:17.583735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:17.625911 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142da51-6d72-45a2-b508-5edb79d0286b None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:17.660337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181cd2a-f223-4c69-9a74-cca149aaeb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:17.660993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181cd2a-f223-4c69-9a74-cca149aaeb00 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:17.661270 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181cd2a-f223-4c69-9a74-cca149aaeb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:17.661550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181cd2a-f223-4c69-9a74-cca149aaeb00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:17.662420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181cd2a-f223-4c69-9a74-cca149aaeb00 None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=aff1fa34ea0c4d32ab743da6e1994b4c, user.id=82ce66ed81af491cbe32a49f6a2e0900) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:30:17.662737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181cd2a-f223-4c69-9a74-cca149aaeb00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:17.664163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181cd2a-f223-4c69-9a74-cca149aaeb00 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:17.669730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 591/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:30:17 2022] GET /identity/v3/role_assignments?user.id=82ce66ed81af491cbe32a49f6a2e0900&scope.project.id=aff1fa34ea0c4d32ab743da6e1994b4c&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:19.862709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034cd4e-1b1c-4443-b33f-631e187c524b None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:19.863297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034cd4e-1b1c-4443-b33f-631e187c524b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:19.863297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034cd4e-1b1c-4443-b33f-631e187c524b None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:19.864636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 595/1186] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:30:19.869904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ad8dd-23d9-4e07-bd51-15f78ebabfff None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:19.870355 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ad8dd-23d9-4e07-bd51-15f78ebabfff None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:19.870471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ad8dd-23d9-4e07-bd51-15f78ebabfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:19.888407 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-7f4ad8dd-23d9-4e07-bd51-15f78ebabfff None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:30:19.889581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7f4ad8dd-23d9-4e07-bd51-15f78ebabfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:30:19.953960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 592/1187] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:30:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:30:19.976088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034cd4e-1b1c-4443-b33f-631e187c524b None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:20.029099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:20.073430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034cd4e-1b1c-4443-b33f-631e187c524b None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:20.106891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f3178-752c-4b96-a85f-8f0a9f24fac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:20.107676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f3178-752c-4b96-a85f-8f0a9f24fac1 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:20.107956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f3178-752c-4b96-a85f-8f0a9f24fac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:20.108229 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f3178-752c-4b96-a85f-8f0a9f24fac1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:20.118038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f3178-752c-4b96-a85f-8f0a9f24fac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-9c2f3178-752c-4b96-a85f-8f0a9f24fac1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:30:20.125591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:30:20.126696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:30:20.127905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 596/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:30:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:30:20.132766 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ad8dd-23d9-4e07-bd51-15f78ebabfff None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:20.181286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:20.229466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ad8dd-23d9-4e07-bd51-15f78ebabfff None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:20.262000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21892f-e623-465e-829a-f7c4582f6dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:20.262684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21892f-e623-465e-829a-f7c4582f6dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:20.262967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21892f-e623-465e-829a-f7c4582f6dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:20.263240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21892f-e623-465e-829a-f7c4582f6dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:20.263980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21892f-e623-465e-829a-f7c4582f6dd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:30:20.264286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21892f-e623-465e-829a-f7c4582f6dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:20.265633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21892f-e623-465e-829a-f7c4582f6dd5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:20.273337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 593/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:30:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:20.279914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f3178-752c-4b96-a85f-8f0a9f24fac1 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:20.378008 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f3178-752c-4b96-a85f-8f0a9f24fac1 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:20.390669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:20.411290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c34f3c-42f7-47ae-9d97-cb75b6a2ace2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:20.412151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34f3c-42f7-47ae-9d97-cb75b6a2ace2 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:20.412461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34f3c-42f7-47ae-9d97-cb75b6a2ace2 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:20.412721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34f3c-42f7-47ae-9d97-cb75b6a2ace2 None admin] PATH_INFO: `/v3/users/82ce66ed81af491cbe32a49f6a2e0900` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:20.413945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c34f3c-42f7-47ae-9d97-cb75b6a2ace2 None admin] RBAC: Authorizing `identity:get_user(user_id=82ce66ed81af491cbe32a49f6a2e0900)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:20.415429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c34f3c-42f7-47ae-9d97-cb75b6a2ace2 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:20.417033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 597/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:30:20 2022] GET /identity/v3/users/82ce66ed81af491cbe32a49f6a2e0900 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:20.423007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21892f-e623-465e-829a-f7c4582f6dd5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:20.519504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21892f-e623-465e-829a-f7c4582f6dd5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:20.532693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:20.552595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d31047-85be-4f34-b69e-f3c329f6571f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:20.553546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31047-85be-4f34-b69e-f3c329f6571f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:20.553824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31047-85be-4f34-b69e-f3c329f6571f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:20.554094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31047-85be-4f34-b69e-f3c329f6571f None admin] PATH_INFO: `/v3/projects/aff1fa34ea0c4d32ab743da6e1994b4c` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:20.555285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d31047-85be-4f34-b69e-f3c329f6571f None admin] RBAC: Authorizing `identity:get_project(project_id=aff1fa34ea0c4d32ab743da6e1994b4c)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:20.556691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d31047-85be-4f34-b69e-f3c329f6571f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:20.558762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 594/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:30:20 2022] GET /identity/v3/projects/aff1fa34ea0c4d32ab743da6e1994b4c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:20.564498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c34f3c-42f7-47ae-9d97-cb75b6a2ace2 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:20.661684 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c34f3c-42f7-47ae-9d97-cb75b6a2ace2 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:20.693368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2e18-3f8a-4177-9869-5254e0edf00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:20.694261 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2e18-3f8a-4177-9869-5254e0edf00a None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:20.694560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2e18-3f8a-4177-9869-5254e0edf00a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:20.694836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2e18-3f8a-4177-9869-5254e0edf00a None admin] PATH_INFO: `/v3/projects/aff1fa34ea0c4d32ab743da6e1994b4c/users/82ce66ed81af491cbe32a49f6a2e0900/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:20.696757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e2e18-3f8a-4177-9869-5254e0edf00a None admin] RBAC: Authorizing `identity:create_grant(project_id=aff1fa34ea0c4d32ab743da6e1994b4c, user_id=82ce66ed81af491cbe32a49f6a2e0900, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:20.698172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e2e18-3f8a-4177-9869-5254e0edf00a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:20.804452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 598/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:30:20 2022] PUT /identity/v3/projects/aff1fa34ea0c4d32ab743da6e1994b4c/users/82ce66ed81af491cbe32a49f6a2e0900/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:30:23.011083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c8b12-59c7-4fa1-84d4-3bd83f2f285b None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:23.011628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c8b12-59c7-4fa1-84d4-3bd83f2f285b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:23.011722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c8b12-59c7-4fa1-84d4-3bd83f2f285b None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:23.013035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 595/1193] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:30:23.018342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc986b9-5879-4423-b3e9-ca16f210b7f5 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:23.018781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc986b9-5879-4423-b3e9-ca16f210b7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:23.018880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc986b9-5879-4423-b3e9-ca16f210b7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:23.035618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-4bc986b9-5879-4423-b3e9-ca16f210b7f5 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:30:23.036784 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-4bc986b9-5879-4423-b3e9-ca16f210b7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:30:23.069552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:23.101014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 599/1194] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:30:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:30:23.124637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c8b12-59c7-4fa1-84d4-3bd83f2f285b None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:23.223365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c8b12-59c7-4fa1-84d4-3bd83f2f285b None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:23.255145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c75c5-5f6d-44b2-8997-d2eb134daff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:23.255917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c75c5-5f6d-44b2-8997-d2eb134daff5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:23.256194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c75c5-5f6d-44b2-8997-d2eb134daff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:23.256466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c75c5-5f6d-44b2-8997-d2eb134daff5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:23.266655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c75c5-5f6d-44b2-8997-d2eb134daff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-a53c75c5-5f6d-44b2-8997-d2eb134daff5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:30:23.273971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:30:23.275083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:30:23.275959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 596/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:30:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:30:23.281649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc986b9-5879-4423-b3e9-ca16f210b7f5 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:23.376713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc986b9-5879-4423-b3e9-ca16f210b7f5 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:23.410322 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d0673-00be-4383-9c27-77229a287f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:23.410986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0673-00be-4383-9c27-77229a287f38 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:23.411266 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0673-00be-4383-9c27-77229a287f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:23.411541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0673-00be-4383-9c27-77229a287f38 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:23.412283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d0673-00be-4383-9c27-77229a287f38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:30:23.412593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d0673-00be-4383-9c27-77229a287f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:23.413948 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d0673-00be-4383-9c27-77229a287f38 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:23.421764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 600/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:30:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:23.427541 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c75c5-5f6d-44b2-8997-d2eb134daff5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:23.469058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:23.525423 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c75c5-5f6d-44b2-8997-d2eb134daff5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:23.558614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab963b4e-db81-4ceb-b063-1a9bcfa49862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:23.559469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab963b4e-db81-4ceb-b063-1a9bcfa49862 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:23.559749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab963b4e-db81-4ceb-b063-1a9bcfa49862 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:23.560018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab963b4e-db81-4ceb-b063-1a9bcfa49862 None admin] PATH_INFO: `/v3/users/82ce66ed81af491cbe32a49f6a2e0900` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:23.561188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab963b4e-db81-4ceb-b063-1a9bcfa49862 None admin] RBAC: Authorizing `identity:get_user(user_id=82ce66ed81af491cbe32a49f6a2e0900)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:23.562640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab963b4e-db81-4ceb-b063-1a9bcfa49862 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:23.564245 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 597/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jun 8 06:30:23 2022] GET /identity/v3/users/82ce66ed81af491cbe32a49f6a2e0900 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:23.570123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d0673-00be-4383-9c27-77229a287f38 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:23.602850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:23.669658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d0673-00be-4383-9c27-77229a287f38 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:23.701942 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188c5e5-f9c3-4c44-90ff-c15e400d50b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:23.702607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188c5e5-f9c3-4c44-90ff-c15e400d50b4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:23.702893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188c5e5-f9c3-4c44-90ff-c15e400d50b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:23.703171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188c5e5-f9c3-4c44-90ff-c15e400d50b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:23.768310 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188c5e5-f9c3-4c44-90ff-c15e400d50b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:23.769739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188c5e5-f9c3-4c44-90ff-c15e400d50b4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:23.797679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:23.863877 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 601/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:30:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:30:23.869786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab963b4e-db81-4ceb-b063-1a9bcfa49862 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:23.966256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab963b4e-db81-4ceb-b063-1a9bcfa49862 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:23.976028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:23.999711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f455d-312c-49fc-85a9-277187f628b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:24.000560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f455d-312c-49fc-85a9-277187f628b8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:24.000841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f455d-312c-49fc-85a9-277187f628b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:24.001114 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f455d-312c-49fc-85a9-277187f628b8 None admin] PATH_INFO: `/v3/projects/aff1fa34ea0c4d32ab743da6e1994b4c` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:24.002313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f455d-312c-49fc-85a9-277187f628b8 None admin] RBAC: Authorizing `identity:get_project(project_id=aff1fa34ea0c4d32ab743da6e1994b4c)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:24.003746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f455d-312c-49fc-85a9-277187f628b8 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:24.005425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 598/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jun 8 06:30:23 2022] GET /identity/v3/projects/aff1fa34ea0c4d32ab743da6e1994b4c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:24.012071 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188c5e5-f9c3-4c44-90ff-c15e400d50b4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:30:24.107505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188c5e5-f9c3-4c44-90ff-c15e400d50b4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:30:24.136251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:24.141957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe83e42-4344-4ac6-88ff-dc280370f76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:30:24.142649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83e42-4344-4ac6-88ff-dc280370f76c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:30:24.142934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83e42-4344-4ac6-88ff-dc280370f76c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:30:24.143212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83e42-4344-4ac6-88ff-dc280370f76c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:30:24.144139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe83e42-4344-4ac6-88ff-dc280370f76c None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=aff1fa34ea0c4d32ab743da6e1994b4c, user.id=82ce66ed81af491cbe32a49f6a2e0900) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:30:24.154654 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe83e42-4344-4ac6-88ff-dc280370f76c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:30:24.154654 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe83e42-4344-4ac6-88ff-dc280370f76c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:30:24.154654 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 602/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:30:24 2022] GET /identity/v3/role_assignments?user.id=82ce66ed81af491cbe32a49f6a2e0900&scope.project.id=aff1fa34ea0c4d32ab743da6e1994b4c&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:30:34.010038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=12 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:30:34.170366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:40.725461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822406f0-a9da-47cc-91c9-df5962150ee9 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:40.726067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822406f0-a9da-47cc-91c9-df5962150ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:40.726067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822406f0-a9da-47cc-91c9-df5962150ee9 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:40.727398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 599/1201] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:31:40.732640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdf0b8-70c8-4aa7-9438-f6754ff3e12f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:40.733028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdf0b8-70c8-4aa7-9438-f6754ff3e12f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:40.733187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdf0b8-70c8-4aa7-9438-f6754ff3e12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:40.749404 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-31cdf0b8-70c8-4aa7-9438-f6754ff3e12f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:31:40.750597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-31cdf0b8-70c8-4aa7-9438-f6754ff3e12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:31:40.816127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 603/1202] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:31:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:31:40.841306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822406f0-a9da-47cc-91c9-df5962150ee9 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:40.940219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822406f0-a9da-47cc-91c9-df5962150ee9 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:40.973803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6637a95-a695-42bb-b240-09050e197031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:40.974618 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637a95-a695-42bb-b240-09050e197031 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:40.974901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637a95-a695-42bb-b240-09050e197031 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:40.975176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6637a95-a695-42bb-b240-09050e197031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:40.987742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6637a95-a695-42bb-b240-09050e197031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:40.987742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6637a95-a695-42bb-b240-09050e197031 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-c6637a95-a695-42bb-b240-09050e197031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:31:41.004023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:41.005165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:41.011096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:31:41.011096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:31:41.011096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:41.011096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:31:41.011096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 600/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:41.011781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdf0b8-70c8-4aa7-9438-f6754ff3e12f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:41.107577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdf0b8-70c8-4aa7-9438-f6754ff3e12f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:41.136542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:41.142631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1bd82-2487-4e73-a86d-6a64d684dc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:41.143300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1bd82-2487-4e73-a86d-6a64d684dc21 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:41.143584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1bd82-2487-4e73-a86d-6a64d684dc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:41.143859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1bd82-2487-4e73-a86d-6a64d684dc21 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:41.144579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1bd82-2487-4e73-a86d-6a64d684dc21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:41.144884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1bd82-2487-4e73-a86d-6a64d684dc21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:41.146330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1bd82-2487-4e73-a86d-6a64d684dc21 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:41.157453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 604/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:41.163063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6637a95-a695-42bb-b240-09050e197031 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:41.215453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:41.259978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6637a95-a695-42bb-b240-09050e197031 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:41.293216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd23e2-dd25-4da1-9619-8aeacdc9c45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:41.293988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd23e2-dd25-4da1-9619-8aeacdc9c45b None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:41.294288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd23e2-dd25-4da1-9619-8aeacdc9c45b None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:41.299365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd23e2-dd25-4da1-9619-8aeacdc9c45b None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:41.299365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd23e2-dd25-4da1-9619-8aeacdc9c45b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:41.299365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd23e2-dd25-4da1-9619-8aeacdc9c45b None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:41.369219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 601/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jun 8 06:31:41 2022] POST /identity/v3/users => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:31:43.625023 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93834c39-a57a-45b6-a20f-0ed0289d86bc None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:43.625563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93834c39-a57a-45b6-a20f-0ed0289d86bc None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:43.625563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93834c39-a57a-45b6-a20f-0ed0289d86bc None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:43.626972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 605/1206] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:31:43.632045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79422766-21c8-41d9-9a9a-80fddc5a4582 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:43.636535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79422766-21c8-41d9-9a9a-80fddc5a4582 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:43.636535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79422766-21c8-41d9-9a9a-80fddc5a4582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:43.649167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-79422766-21c8-41d9-9a9a-80fddc5a4582 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:31:43.650378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-79422766-21c8-41d9-9a9a-80fddc5a4582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:31:43.720874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 602/1207] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:31:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:31:43.745194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93834c39-a57a-45b6-a20f-0ed0289d86bc None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:43.847604 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93834c39-a57a-45b6-a20f-0ed0289d86bc None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:43.880481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc45318-805c-409f-a5bb-1073b9bfe886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:43.881238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45318-805c-409f-a5bb-1073b9bfe886 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:43.881519 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45318-805c-409f-a5bb-1073b9bfe886 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:43.881790 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45318-805c-409f-a5bb-1073b9bfe886 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:43.892367 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc45318-805c-409f-a5bb-1073b9bfe886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-cbc45318-805c-409f-a5bb-1073b9bfe886 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:31:43.899895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:43.900993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:43.901850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 606/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:31:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:43.907167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79422766-21c8-41d9-9a9a-80fddc5a4582 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:43.945895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:44.008213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79422766-21c8-41d9-9a9a-80fddc5a4582 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:44.040934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfbb6a-db42-44d1-ae1e-6cb32075b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:44.042221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfbb6a-db42-44d1-ae1e-6cb32075b677 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:44.042531 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfbb6a-db42-44d1-ae1e-6cb32075b677 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:44.042802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfbb6a-db42-44d1-ae1e-6cb32075b677 None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:44.043567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfbb6a-db42-44d1-ae1e-6cb32075b677 None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:44.043868 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfbb6a-db42-44d1-ae1e-6cb32075b677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:44.045247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfbb6a-db42-44d1-ae1e-6cb32075b677 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:44.053090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 603/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:31:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:44.058866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc45318-805c-409f-a5bb-1073b9bfe886 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:44.109487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:44.157171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc45318-805c-409f-a5bb-1073b9bfe886 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:44.190253 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f969f6e-02da-4af7-a17d-d2ee7119bddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:44.191106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969f6e-02da-4af7-a17d-d2ee7119bddd None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:44.191410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969f6e-02da-4af7-a17d-d2ee7119bddd None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:44.191683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969f6e-02da-4af7-a17d-d2ee7119bddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:44.201461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f969f6e-02da-4af7-a17d-d2ee7119bddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:44.202960 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f969f6e-02da-4af7-a17d-d2ee7119bddd None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-4f969f6e-02da-4af7-a17d-d2ee7119bddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:31:44.220171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:44.226965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:44.227881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:31:44.227881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:31:44.227881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:44.227881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:44.227881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 607/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:44.228235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfbb6a-db42-44d1-ae1e-6cb32075b677 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:44.326586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:44.329457 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfbb6a-db42-44d1-ae1e-6cb32075b677 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:44.362557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7234-01c1-4df3-94f9-348467eb137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:44.363210 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7234-01c1-4df3-94f9-348467eb137e None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:44.363489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7234-01c1-4df3-94f9-348467eb137e None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:44.363778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7234-01c1-4df3-94f9-348467eb137e None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:44.364490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd7234-01c1-4df3-94f9-348467eb137e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:44.364788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd7234-01c1-4df3-94f9-348467eb137e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:44.366141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd7234-01c1-4df3-94f9-348467eb137e None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:44.378399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 604/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:44.384098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f969f6e-02da-4af7-a17d-d2ee7119bddd None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:44.481517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f969f6e-02da-4af7-a17d-d2ee7119bddd None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:44.483024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:44.514728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367fae1-b2f7-4953-a634-da2483504dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:44.515514 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367fae1-b2f7-4953-a634-da2483504dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:44.515795 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367fae1-b2f7-4953-a634-da2483504dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:44.516069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367fae1-b2f7-4953-a634-da2483504dc4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:44.522967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367fae1-b2f7-4953-a634-da2483504dc4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:44.524434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367fae1-b2f7-4953-a634-da2483504dc4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-4367fae1-b2f7-4953-a634-da2483504dc4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:31:44.539230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:44.540353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:44.541464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:44.541464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:44.541464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:31:44.541464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:31:44.541464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:31:44.541464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:31:44.541464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:31:44.541464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:31:44.541464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:31:44.541464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:44.541464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 608/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:44.546182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7234-01c1-4df3-94f9-348467eb137e None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:44.645179 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7234-01c1-4df3-94f9-348467eb137e None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:44.678513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e186f-5f01-43fd-941a-d2f53ff3fae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:44.679168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e186f-5f01-43fd-941a-d2f53ff3fae1 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:44.679448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e186f-5f01-43fd-941a-d2f53ff3fae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:44.679727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e186f-5f01-43fd-941a-d2f53ff3fae1 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:44.680561 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e186f-5f01-43fd-941a-d2f53ff3fae1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:44.680867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e186f-5f01-43fd-941a-d2f53ff3fae1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:44.682478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e186f-5f01-43fd-941a-d2f53ff3fae1 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:44.699731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 605/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jun 8 06:31:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:44.705474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367fae1-b2f7-4953-a634-da2483504dc4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:44.803387 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367fae1-b2f7-4953-a634-da2483504dc4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:44.837389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6ab60-9efe-4e18-9a26-5898c0d29ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:44.838042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ab60-9efe-4e18-9a26-5898c0d29ace None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:44.838359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ab60-9efe-4e18-9a26-5898c0d29ace None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:44.838637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ab60-9efe-4e18-9a26-5898c0d29ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:44.867202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:44.903356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6ab60-9efe-4e18-9a26-5898c0d29ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:44.904782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6ab60-9efe-4e18-9a26-5898c0d29ace None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:45.004148 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 609/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:31:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:31:45.009985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e186f-5f01-43fd-941a-d2f53ff3fae1 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:45.029671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:45.108689 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e186f-5f01-43fd-941a-d2f53ff3fae1 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:45.142027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52681a10-59cc-4141-b4e6-a5b8a97550d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:45.142855 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681a10-59cc-4141-b4e6-a5b8a97550d8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:45.143137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681a10-59cc-4141-b4e6-a5b8a97550d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:45.143410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681a10-59cc-4141-b4e6-a5b8a97550d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:45.153367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52681a10-59cc-4141-b4e6-a5b8a97550d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:45.157145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52681a10-59cc-4141-b4e6-a5b8a97550d8 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-52681a10-59cc-4141-b4e6-a5b8a97550d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:31:45.172427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:45.175775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:45.176894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:31:45.176894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:31:45.176894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:45.176894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:31:45.176894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 606/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:45.179390 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6ab60-9efe-4e18-9a26-5898c0d29ace None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:45.238530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:45.278146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6ab60-9efe-4e18-9a26-5898c0d29ace None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:45.312037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eece0-d3b6-4d8b-90a3-1809c593105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:45.312696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eece0-d3b6-4d8b-90a3-1809c593105e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:45.312977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eece0-d3b6-4d8b-90a3-1809c593105e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:45.313252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eece0-d3b6-4d8b-90a3-1809c593105e None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:45.313964 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eece0-d3b6-4d8b-90a3-1809c593105e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:45.314299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eece0-d3b6-4d8b-90a3-1809c593105e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:45.318361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eece0-d3b6-4d8b-90a3-1809c593105e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:45.326859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 610/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:45.332559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52681a10-59cc-4141-b4e6-a5b8a97550d8 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:45.401111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:45.430893 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52681a10-59cc-4141-b4e6-a5b8a97550d8 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:45.466292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96177a5-8965-4109-a80b-4566ae0e173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:45.467084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96177a5-8965-4109-a80b-4566ae0e173f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:45.467363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96177a5-8965-4109-a80b-4566ae0e173f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:45.467634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96177a5-8965-4109-a80b-4566ae0e173f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:45.474401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96177a5-8965-4109-a80b-4566ae0e173f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:45.475820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96177a5-8965-4109-a80b-4566ae0e173f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-c96177a5-8965-4109-a80b-4566ae0e173f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:31:45.489975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:45.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:45.492224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:31:45.492224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:31:45.492224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:31:45.492224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:31:45.492224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:31:45.492224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:31:45.492224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:31:45.492224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:31:45.492224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 607/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:45.497096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eece0-d3b6-4d8b-90a3-1809c593105e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:45.597733 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eece0-d3b6-4d8b-90a3-1809c593105e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:45.619900 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:45.631246 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263a50a-ed92-4466-ba71-3f81438db75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:45.631888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a50a-ed92-4466-ba71-3f81438db75d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:45.632191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a50a-ed92-4466-ba71-3f81438db75d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:45.632465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a50a-ed92-4466-ba71-3f81438db75d None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:45.633249 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263a50a-ed92-4466-ba71-3f81438db75d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:45.633553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263a50a-ed92-4466-ba71-3f81438db75d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:45.634988 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263a50a-ed92-4466-ba71-3f81438db75d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:45.646705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 611/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:31:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:45.653484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96177a5-8965-4109-a80b-4566ae0e173f None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:45.755186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96177a5-8965-4109-a80b-4566ae0e173f None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:45.782925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:45.788717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3e5f4-2f54-4323-84fa-f98b874afbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:45.789379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3e5f4-2f54-4323-84fa-f98b874afbea None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:45.789656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3e5f4-2f54-4323-84fa-f98b874afbea None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:45.789928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3e5f4-2f54-4323-84fa-f98b874afbea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:45.790802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3e5f4-2f54-4323-84fa-f98b874afbea None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=b1e0226354d14b9b9c4184063b2df9fe) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:45.801120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3e5f4-2f54-4323-84fa-f98b874afbea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:45.801120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3e5f4-2f54-4323-84fa-f98b874afbea None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:45.801120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 608/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:31:45 2022] GET /identity/v3/role_assignments?user.id=b1e0226354d14b9b9c4184063b2df9fe&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:48.017225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11c26-8cd6-4d6a-b2de-dd2c35cb960c None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:48.017785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11c26-8cd6-4d6a-b2de-dd2c35cb960c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:48.017785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11c26-8cd6-4d6a-b2de-dd2c35cb960c None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:48.019266 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 612/1220] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:31:48.024946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd434039-d147-4546-b483-eb4910b6ddcb None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:48.024946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd434039-d147-4546-b483-eb4910b6ddcb None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:48.025474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd434039-d147-4546-b483-eb4910b6ddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:48.041442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-fd434039-d147-4546-b483-eb4910b6ddcb None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:31:48.042650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-fd434039-d147-4546-b483-eb4910b6ddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:31:48.109410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 609/1221] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:31:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:31:48.132353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea11c26-8cd6-4d6a-b2de-dd2c35cb960c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:48.232975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea11c26-8cd6-4d6a-b2de-dd2c35cb960c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:48.265171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0957b-0dd7-4920-b067-7687c9ef24e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:48.265950 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0957b-0dd7-4920-b067-7687c9ef24e0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:48.266229 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0957b-0dd7-4920-b067-7687c9ef24e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:48.266528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0957b-0dd7-4920-b067-7687c9ef24e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:48.276329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0957b-0dd7-4920-b067-7687c9ef24e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-baf0957b-0dd7-4920-b067-7687c9ef24e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:31:48.284012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:48.285107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:48.286361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 613/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:31:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:48.291143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd434039-d147-4546-b483-eb4910b6ddcb None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:48.389031 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd434039-d147-4546-b483-eb4910b6ddcb None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:48.411441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:48.422460 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267fdf7-b4b6-4103-b96f-fd165a12dffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:48.423121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267fdf7-b4b6-4103-b96f-fd165a12dffc None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:48.424247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267fdf7-b4b6-4103-b96f-fd165a12dffc None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:48.424247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267fdf7-b4b6-4103-b96f-fd165a12dffc None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:48.424424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267fdf7-b4b6-4103-b96f-fd165a12dffc None admin] RBAC: Adding query filter params (name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:48.424678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267fdf7-b4b6-4103-b96f-fd165a12dffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:48.426032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267fdf7-b4b6-4103-b96f-fd165a12dffc None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:48.434224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 610/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:31:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:48.440028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0957b-0dd7-4920-b067-7687c9ef24e0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:48.482791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:48.537476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0957b-0dd7-4920-b067-7687c9ef24e0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:48.569436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d29390-52dc-46c0-a660-49872bf833c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:48.570216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d29390-52dc-46c0-a660-49872bf833c4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:48.570527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d29390-52dc-46c0-a660-49872bf833c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:48.570805 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d29390-52dc-46c0-a660-49872bf833c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:48.581832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d29390-52dc-46c0-a660-49872bf833c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:48.583381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d29390-52dc-46c0-a660-49872bf833c4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-76d29390-52dc-46c0-a660-49872bf833c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:31:48.601039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:48.602029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:48.603019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:31:48.603019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:31:48.603019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:48.603019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:48.603238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 614/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:48.608894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267fdf7-b4b6-4103-b96f-fd165a12dffc None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:48.708012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267fdf7-b4b6-4103-b96f-fd165a12dffc None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:48.741000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86498afa-3cad-4f6b-80f8-fd4435ab79a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:48.741651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498afa-3cad-4f6b-80f8-fd4435ab79a0 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:48.741933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498afa-3cad-4f6b-80f8-fd4435ab79a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:48.742208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498afa-3cad-4f6b-80f8-fd4435ab79a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:48.742960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86498afa-3cad-4f6b-80f8-fd4435ab79a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:48.743264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86498afa-3cad-4f6b-80f8-fd4435ab79a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:48.744645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86498afa-3cad-4f6b-80f8-fd4435ab79a0 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:48.756178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 611/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:48.761932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d29390-52dc-46c0-a660-49872bf833c4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:48.855573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:48.862074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d29390-52dc-46c0-a660-49872bf833c4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:48.894830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48709e-54f8-47d2-a8f2-b13f5ac20925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:48.895821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48709e-54f8-47d2-a8f2-b13f5ac20925 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:48.896481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48709e-54f8-47d2-a8f2-b13f5ac20925 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:48.896757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48709e-54f8-47d2-a8f2-b13f5ac20925 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:48.906715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48709e-54f8-47d2-a8f2-b13f5ac20925 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:48.908210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48709e-54f8-47d2-a8f2-b13f5ac20925 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-ad48709e-54f8-47d2-a8f2-b13f5ac20925 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:31:48.922343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:48.923540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:48.924842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:48.924842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:48.924842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:31:48.924842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:31:48.924842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:31:48.924842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:31:48.924842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:31:48.924842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:31:48.924842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:31:48.924842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:48.924842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 615/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:48.929485 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86498afa-3cad-4f6b-80f8-fd4435ab79a0 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:48.976908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:49.028624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86498afa-3cad-4f6b-80f8-fd4435ab79a0 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:49.061869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53f31a-e42d-45f2-a998-e2d5c010d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:49.062568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53f31a-e42d-45f2-a998-e2d5c010d604 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:49.062887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53f31a-e42d-45f2-a998-e2d5c010d604 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:49.063257 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53f31a-e42d-45f2-a998-e2d5c010d604 None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:49.064094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53f31a-e42d-45f2-a998-e2d5c010d604 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:49.064400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53f31a-e42d-45f2-a998-e2d5c010d604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:49.065806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53f31a-e42d-45f2-a998-e2d5c010d604 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:49.083249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 612/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jun 8 06:31:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:31:49.089449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48709e-54f8-47d2-a8f2-b13f5ac20925 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:49.188553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48709e-54f8-47d2-a8f2-b13f5ac20925 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:49.222582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e86f48-d28d-459e-b2f1-a5bba985f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:49.223370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86f48-d28d-459e-b2f1-a5bba985f669 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:49.223652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86f48-d28d-459e-b2f1-a5bba985f669 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:49.223926 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86f48-d28d-459e-b2f1-a5bba985f669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:49.234084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e86f48-d28d-459e-b2f1-a5bba985f669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:49.235543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e86f48-d28d-459e-b2f1-a5bba985f669 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-00e86f48-d28d-459e-b2f1-a5bba985f669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:31:49.252703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:49.255977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:49.257084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:31:49.257084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:31:49.257084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:49.257084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:49.257084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 616/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:49.259646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53f31a-e42d-45f2-a998-e2d5c010d604 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:49.356524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53f31a-e42d-45f2-a998-e2d5c010d604 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:49.358828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:49.390142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8995d0-923d-488b-ad49-54a24dda51d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:49.391298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8995d0-923d-488b-ad49-54a24dda51d5 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:49.391298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8995d0-923d-488b-ad49-54a24dda51d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:49.391298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8995d0-923d-488b-ad49-54a24dda51d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:49.392000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8995d0-923d-488b-ad49-54a24dda51d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:49.392306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8995d0-923d-488b-ad49-54a24dda51d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:49.393694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8995d0-923d-488b-ad49-54a24dda51d5 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:49.404785 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 613/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:49.410578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e86f48-d28d-459e-b2f1-a5bba985f669 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:49.419875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:49.509253 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e86f48-d28d-459e-b2f1-a5bba985f669 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:49.541821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda7bbb-e7cf-4ae9-8aa1-f7bafadb902d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:49.542636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda7bbb-e7cf-4ae9-8aa1-f7bafadb902d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:49.542921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda7bbb-e7cf-4ae9-8aa1-f7bafadb902d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:49.543226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda7bbb-e7cf-4ae9-8aa1-f7bafadb902d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:49.549720 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda7bbb-e7cf-4ae9-8aa1-f7bafadb902d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:49.551202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda7bbb-e7cf-4ae9-8aa1-f7bafadb902d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-5dda7bbb-e7cf-4ae9-8aa1-f7bafadb902d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:31:49.565585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:49.566672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:49.567673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:31:49.567673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:31:49.567673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:31:49.567673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:31:49.567673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:31:49.567673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:31:49.567673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:31:49.567673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:49.567673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 617/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:31:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:49.573195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8995d0-923d-488b-ad49-54a24dda51d5 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:49.672619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8995d0-923d-488b-ad49-54a24dda51d5 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:49.709113 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56be4f-1b83-4c5b-87ae-7df9f5f761fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:49.709734 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56be4f-1b83-4c5b-87ae-7df9f5f761fc None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:49.710016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56be4f-1b83-4c5b-87ae-7df9f5f761fc None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:49.710309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56be4f-1b83-4c5b-87ae-7df9f5f761fc None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:49.711085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56be4f-1b83-4c5b-87ae-7df9f5f761fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:49.711387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56be4f-1b83-4c5b-87ae-7df9f5f761fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:49.712872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56be4f-1b83-4c5b-87ae-7df9f5f761fc None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:49.724599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 614/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:31:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:49.731067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda7bbb-e7cf-4ae9-8aa1-f7bafadb902d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:49.794785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:49.827707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda7bbb-e7cf-4ae9-8aa1-f7bafadb902d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:49.860933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef08f67-bb54-4c4d-938a-4c1bf59dbc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:49.861824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef08f67-bb54-4c4d-938a-4c1bf59dbc99 None admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:49.862106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef08f67-bb54-4c4d-938a-4c1bf59dbc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:49.862412 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef08f67-bb54-4c4d-938a-4c1bf59dbc99 None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/b1e0226354d14b9b9c4184063b2df9fe/roles/be311caafffd48cfa80fbe10e110493c` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:49.877090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef08f67-bb54-4c4d-938a-4c1bf59dbc99 None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=b1e0226354d14b9b9c4184063b2df9fe, role_id=be311caafffd48cfa80fbe10e110493c)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:49.878556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef08f67-bb54-4c4d-938a-4c1bf59dbc99 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:49.981141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 618/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:31:49 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/b1e0226354d14b9b9c4184063b2df9fe/roles/be311caafffd48cfa80fbe10e110493c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:31:52.201715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48780066-7883-40ed-ba99-7b019b0634fc None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:52.202218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48780066-7883-40ed-ba99-7b019b0634fc None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:52.202340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48780066-7883-40ed-ba99-7b019b0634fc None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:52.203705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 615/1233] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:31:52.208914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2c284-34e3-40a1-9982-9f6cf25faaf0 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:52.209352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2c284-34e3-40a1-9982-9f6cf25faaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:52.209504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2c284-34e3-40a1-9982-9f6cf25faaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:52.226049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-9ba2c284-34e3-40a1-9982-9f6cf25faaf0 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:31:52.227296 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9ba2c284-34e3-40a1-9982-9f6cf25faaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:31:52.295460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 619/1234] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:31:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:31:52.319712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48780066-7883-40ed-ba99-7b019b0634fc None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:52.345044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:52.419164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48780066-7883-40ed-ba99-7b019b0634fc None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:52.453240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54f4c5-f7b7-4ccc-b75c-8a518bc1d57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:52.454010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54f4c5-f7b7-4ccc-b75c-8a518bc1d57f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:52.454324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54f4c5-f7b7-4ccc-b75c-8a518bc1d57f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:52.454601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54f4c5-f7b7-4ccc-b75c-8a518bc1d57f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:52.464527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54f4c5-f7b7-4ccc-b75c-8a518bc1d57f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-ed54f4c5-f7b7-4ccc-b75c-8a518bc1d57f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:31:52.472148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:52.473323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:31:52.474224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 616/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jun 8 06:31:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:52.479264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2c284-34e3-40a1-9982-9f6cf25faaf0 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:52.526386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:52.578175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2c284-34e3-40a1-9982-9f6cf25faaf0 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:52.612266 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106b1f3-ec44-4368-9333-9b92bd57d43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:52.613447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b1f3-ec44-4368-9333-9b92bd57d43d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:52.613966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b1f3-ec44-4368-9333-9b92bd57d43d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:52.614454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b1f3-ec44-4368-9333-9b92bd57d43d None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:52.615213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106b1f3-ec44-4368-9333-9b92bd57d43d None admin] RBAC: Adding query filter params (name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:52.615526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106b1f3-ec44-4368-9333-9b92bd57d43d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:52.620452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106b1f3-ec44-4368-9333-9b92bd57d43d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:52.625502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 620/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jun 8 06:31:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:52.631329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54f4c5-f7b7-4ccc-b75c-8a518bc1d57f None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:52.713350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:52.728080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54f4c5-f7b7-4ccc-b75c-8a518bc1d57f None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:52.763634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203ec2-81ba-4a65-a1eb-de8c3cc6618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:52.764431 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203ec2-81ba-4a65-a1eb-de8c3cc6618a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:52.764714 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203ec2-81ba-4a65-a1eb-de8c3cc6618a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:52.764992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203ec2-81ba-4a65-a1eb-de8c3cc6618a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:52.775380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21203ec2-81ba-4a65-a1eb-de8c3cc6618a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:52.776853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21203ec2-81ba-4a65-a1eb-de8c3cc6618a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-21203ec2-81ba-4a65-a1eb-de8c3cc6618a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:31:52.793934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:52.795050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:52.796383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:31:52.796383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:31:52.796383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:52.796383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:31:52.796383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 617/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:52.801188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106b1f3-ec44-4368-9333-9b92bd57d43d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:52.899628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106b1f3-ec44-4368-9333-9b92bd57d43d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:52.908196 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:52.933460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1eb9b-a63a-468c-a133-feb578d6fea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:52.934122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1eb9b-a63a-468c-a133-feb578d6fea2 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:52.934439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1eb9b-a63a-468c-a133-feb578d6fea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:52.934713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1eb9b-a63a-468c-a133-feb578d6fea2 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:52.935432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1eb9b-a63a-468c-a133-feb578d6fea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:52.935738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1eb9b-a63a-468c-a133-feb578d6fea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:52.937123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1eb9b-a63a-468c-a133-feb578d6fea2 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:52.948576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 621/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:52.954503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203ec2-81ba-4a65-a1eb-de8c3cc6618a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:53.052961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203ec2-81ba-4a65-a1eb-de8c3cc6618a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:53.085845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eebd5-2647-47e9-939a-27845e85628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:53.086742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eebd5-2647-47e9-939a-27845e85628f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:53.086998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eebd5-2647-47e9-939a-27845e85628f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:53.087272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eebd5-2647-47e9-939a-27845e85628f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:53.090515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:53.095614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eebd5-2647-47e9-939a-27845e85628f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:53.097037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eebd5-2647-47e9-939a-27845e85628f None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-d74eebd5-2647-47e9-939a-27845e85628f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:31:53.114651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:53.115927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:53.117274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:53.117274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:53.117274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:31:53.117274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:31:53.117274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:31:53.117274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:31:53.117274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:31:53.117274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:31:53.117274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:31:53.117274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:31:53.117274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 618/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:53.121779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1eb9b-a63a-468c-a133-feb578d6fea2 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:53.222449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1eb9b-a63a-468c-a133-feb578d6fea2 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:53.255669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d963c-b6c1-4431-9dfb-32308f9eb34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:53.256327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d963c-b6c1-4431-9dfb-32308f9eb34c None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:53.256608 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d963c-b6c1-4431-9dfb-32308f9eb34c None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:53.256880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d963c-b6c1-4431-9dfb-32308f9eb34c None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:53.257700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d963c-b6c1-4431-9dfb-32308f9eb34c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:53.258003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d963c-b6c1-4431-9dfb-32308f9eb34c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:53.259540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d963c-b6c1-4431-9dfb-32308f9eb34c None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:53.277057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 622/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jun 8 06:31:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:53.282723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eebd5-2647-47e9-939a-27845e85628f None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:53.387389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eebd5-2647-47e9-939a-27845e85628f None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:53.420400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8de14a-410e-46e5-818d-96de22ebdc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:53.421044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8de14a-410e-46e5-818d-96de22ebdc09 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:53.421324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8de14a-410e-46e5-818d-96de22ebdc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:53.421594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8de14a-410e-46e5-818d-96de22ebdc09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:53.481609 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:53.488244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8de14a-410e-46e5-818d-96de22ebdc09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:53.489708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8de14a-410e-46e5-818d-96de22ebdc09 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:53.586699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 619/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:31:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:31:53.593151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d963c-b6c1-4431-9dfb-32308f9eb34c None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:53.619898 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:53.689557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d963c-b6c1-4431-9dfb-32308f9eb34c None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:53.725369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb227b-aa81-49c5-9213-3306e9eddff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:53.726159 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb227b-aa81-49c5-9213-3306e9eddff5 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:53.726504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb227b-aa81-49c5-9213-3306e9eddff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:53.727055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb227b-aa81-49c5-9213-3306e9eddff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:53.737326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb227b-aa81-49c5-9213-3306e9eddff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:53.738789 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb227b-aa81-49c5-9213-3306e9eddff5 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-98eb227b-aa81-49c5-9213-3306e9eddff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:31:53.756490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:53.757556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:53.758875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:31:53.758875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:31:53.758875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:53.758875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:53.758875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 623/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:53.764043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8de14a-410e-46e5-818d-96de22ebdc09 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:53.856061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:53.864344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8de14a-410e-46e5-818d-96de22ebdc09 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:53.897927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653eba92-07ea-4254-835e-c1e48d540fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:53.898605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653eba92-07ea-4254-835e-c1e48d540fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:53.898884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653eba92-07ea-4254-835e-c1e48d540fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:53.899155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653eba92-07ea-4254-835e-c1e48d540fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:53.899927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653eba92-07ea-4254-835e-c1e48d540fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:53.900225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653eba92-07ea-4254-835e-c1e48d540fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:53.901594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653eba92-07ea-4254-835e-c1e48d540fb8 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:53.913688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 620/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:53.919454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb227b-aa81-49c5-9213-3306e9eddff5 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:53.995333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:54.016045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb227b-aa81-49c5-9213-3306e9eddff5 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:54.049664 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279e6c1-6d5e-46ed-9b5f-794a6c972d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:54.050490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279e6c1-6d5e-46ed-9b5f-794a6c972d7e None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:54.050766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279e6c1-6d5e-46ed-9b5f-794a6c972d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:54.051035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279e6c1-6d5e-46ed-9b5f-794a6c972d7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:54.058015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279e6c1-6d5e-46ed-9b5f-794a6c972d7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:54.059478 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279e6c1-6d5e-46ed-9b5f-794a6c972d7e None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-e279e6c1-6d5e-46ed-9b5f-794a6c972d7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:31:54.073976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:54.075884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:54.077644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:31:54.077644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:31:54.077644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:31:54.077644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:31:54.077644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:31:54.077644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:31:54.077644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:31:54.077644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:54.077644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 624/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:31:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:54.082864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653eba92-07ea-4254-835e-c1e48d540fb8 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:54.188013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653eba92-07ea-4254-835e-c1e48d540fb8 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:54.220643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37307c4e-c064-4370-9f71-749cb19d9ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:54.221300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37307c4e-c064-4370-9f71-749cb19d9ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:54.221590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37307c4e-c064-4370-9f71-749cb19d9ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:54.221863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37307c4e-c064-4370-9f71-749cb19d9ae6 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:54.222698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37307c4e-c064-4370-9f71-749cb19d9ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:54.223006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37307c4e-c064-4370-9f71-749cb19d9ae6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:54.224425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37307c4e-c064-4370-9f71-749cb19d9ae6 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:54.237311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 621/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:54.243548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279e6c1-6d5e-46ed-9b5f-794a6c972d7e None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:54.343836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279e6c1-6d5e-46ed-9b5f-794a6c972d7e None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:54.377080 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af18205-6631-43cc-9528-4dd8980fca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:54.377727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af18205-6631-43cc-9528-4dd8980fca42 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:54.378010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af18205-6631-43cc-9528-4dd8980fca42 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:54.378311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af18205-6631-43cc-9528-4dd8980fca42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:54.379142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af18205-6631-43cc-9528-4dd8980fca42 None admin] RBAC: Adding query filter params (role.id=be311caafffd48cfa80fbe10e110493c, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=b1e0226354d14b9b9c4184063b2df9fe) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:54.379454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af18205-6631-43cc-9528-4dd8980fca42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:54.380862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af18205-6631-43cc-9528-4dd8980fca42 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:54.386615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 625/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:31:54 2022] GET /identity/v3/role_assignments?user.id=b1e0226354d14b9b9c4184063b2df9fe&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=be311caafffd48cfa80fbe10e110493c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:56.648975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e750d2-02ca-43fe-ac16-1118f8736d19 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:56.649525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e750d2-02ca-43fe-ac16-1118f8736d19 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:56.649525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e750d2-02ca-43fe-ac16-1118f8736d19 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:56.651541 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 622/1247] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:31:56.656770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85043c-a350-4a07-9179-590e695fb526 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:56.657172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85043c-a350-4a07-9179-590e695fb526 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:56.657318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85043c-a350-4a07-9179-590e695fb526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:56.662363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:56.674017 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-1a85043c-a350-4a07-9179-590e695fb526 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:31:56.675230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-1a85043c-a350-4a07-9179-590e695fb526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:31:56.741164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 626/1248] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:31:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:31:56.765573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e750d2-02ca-43fe-ac16-1118f8736d19 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:56.783504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:56.865780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e750d2-02ca-43fe-ac16-1118f8736d19 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:56.899324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260244e-cb8c-4dd3-9cba-a8fccb2cd49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:56.900103 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260244e-cb8c-4dd3-9cba-a8fccb2cd49a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:56.900382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260244e-cb8c-4dd3-9cba-a8fccb2cd49a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:56.900683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260244e-cb8c-4dd3-9cba-a8fccb2cd49a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:56.910582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260244e-cb8c-4dd3-9cba-a8fccb2cd49a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-1260244e-cb8c-4dd3-9cba-a8fccb2cd49a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:31:56.918393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:56.919453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:31:56.920345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 623/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:31:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:56.925720 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85043c-a350-4a07-9179-590e695fb526 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:57.024227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85043c-a350-4a07-9179-590e695fb526 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:57.052590 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:57.057865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d8562-ed2a-401d-91be-986d7fdccc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:57.058559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d8562-ed2a-401d-91be-986d7fdccc5d None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:57.058846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d8562-ed2a-401d-91be-986d7fdccc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:57.059122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d8562-ed2a-401d-91be-986d7fdccc5d None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:57.059866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d8562-ed2a-401d-91be-986d7fdccc5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:57.060170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d8562-ed2a-401d-91be-986d7fdccc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:57.061521 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d8562-ed2a-401d-91be-986d7fdccc5d None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:57.069339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 627/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:31:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:57.075950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260244e-cb8c-4dd3-9cba-a8fccb2cd49a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:57.153685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:57.176378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260244e-cb8c-4dd3-9cba-a8fccb2cd49a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:57.209878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede81f-6acd-43e2-afdb-f122b4a0f5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:57.210728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede81f-6acd-43e2-afdb-f122b4a0f5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:57.211000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede81f-6acd-43e2-afdb-f122b4a0f5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:57.211276 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede81f-6acd-43e2-afdb-f122b4a0f5b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:57.222300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fede81f-6acd-43e2-afdb-f122b4a0f5b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:57.223731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fede81f-6acd-43e2-afdb-f122b4a0f5b8 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3fede81f-6acd-43e2-afdb-f122b4a0f5b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:31:57.240778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:57.241800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:57.242858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:31:57.242858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:31:57.242858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:57.242858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:31:57.242858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 624/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:57.248559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d8562-ed2a-401d-91be-986d7fdccc5d None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:57.347760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d8562-ed2a-401d-91be-986d7fdccc5d None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:57.381817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b5f65-7aba-4bde-af55-74869c2a6ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:57.382495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b5f65-7aba-4bde-af55-74869c2a6ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:57.382776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b5f65-7aba-4bde-af55-74869c2a6ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:57.383047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b5f65-7aba-4bde-af55-74869c2a6ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:57.383759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b5f65-7aba-4bde-af55-74869c2a6ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:57.384059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b5f65-7aba-4bde-af55-74869c2a6ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:57.385464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b5f65-7aba-4bde-af55-74869c2a6ad6 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:57.397135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 628/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:57.402856 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede81f-6acd-43e2-afdb-f122b4a0f5b8 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:57.502369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede81f-6acd-43e2-afdb-f122b4a0f5b8 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:57.527739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:57.535567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e33f8-f244-4f5f-97f9-b60a3e29db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:57.536356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e33f8-f244-4f5f-97f9-b60a3e29db18 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:57.536635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e33f8-f244-4f5f-97f9-b60a3e29db18 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:57.536921 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e33f8-f244-4f5f-97f9-b60a3e29db18 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:57.544782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e33f8-f244-4f5f-97f9-b60a3e29db18 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:57.546193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e33f8-f244-4f5f-97f9-b60a3e29db18 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-533e33f8-f244-4f5f-97f9-b60a3e29db18 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:31:57.560027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:57.561121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:57.562406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:57.562406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:57.562406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:31:57.562406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:31:57.562406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:31:57.562406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:31:57.562406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:31:57.562406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:31:57.562406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:31:57.562406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:31:57.562406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 625/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:57.567001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b5f65-7aba-4bde-af55-74869c2a6ad6 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:57.621337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:57.663956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b5f65-7aba-4bde-af55-74869c2a6ad6 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:57.696644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76af1b8-f43f-4a12-ac49-2de3637cd189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:57.697309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76af1b8-f43f-4a12-ac49-2de3637cd189 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:57.697594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76af1b8-f43f-4a12-ac49-2de3637cd189 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:57.697919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76af1b8-f43f-4a12-ac49-2de3637cd189 None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:57.698741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76af1b8-f43f-4a12-ac49-2de3637cd189 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:57.699052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76af1b8-f43f-4a12-ac49-2de3637cd189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:57.700802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76af1b8-f43f-4a12-ac49-2de3637cd189 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:57.720143 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 629/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jun 8 06:31:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:57.725798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e33f8-f244-4f5f-97f9-b60a3e29db18 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:57.825457 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e33f8-f244-4f5f-97f9-b60a3e29db18 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:57.860000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1febed-0145-4d44-abe3-3ec9fcabc307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:57.860656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1febed-0145-4d44-abe3-3ec9fcabc307 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:57.860976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1febed-0145-4d44-abe3-3ec9fcabc307 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:57.861213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1febed-0145-4d44-abe3-3ec9fcabc307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:57.922493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:57.934697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1febed-0145-4d44-abe3-3ec9fcabc307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:57.936148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1febed-0145-4d44-abe3-3ec9fcabc307 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:58.034510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 626/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:31:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:31:58.040257 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76af1b8-f43f-4a12-ac49-2de3637cd189 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:58.141641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76af1b8-f43f-4a12-ac49-2de3637cd189 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:58.154764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:58.175152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea131f8-faed-4b7e-9b4c-02071600d300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:58.175940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea131f8-faed-4b7e-9b4c-02071600d300 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:58.176221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea131f8-faed-4b7e-9b4c-02071600d300 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:58.176492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea131f8-faed-4b7e-9b4c-02071600d300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:58.186296 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea131f8-faed-4b7e-9b4c-02071600d300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:58.187716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea131f8-faed-4b7e-9b4c-02071600d300 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-6ea131f8-faed-4b7e-9b4c-02071600d300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:31:58.205799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:58.206997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:58.208195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:31:58.208195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:31:58.208195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:31:58.208195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:58.208195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 630/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:58.214156 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1febed-0145-4d44-abe3-3ec9fcabc307 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:58.302419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:58.314590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1febed-0145-4d44-abe3-3ec9fcabc307 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:58.347942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68866ea6-b144-4a6b-bf85-a04e74eec697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:58.348606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68866ea6-b144-4a6b-bf85-a04e74eec697 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:58.348918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68866ea6-b144-4a6b-bf85-a04e74eec697 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:58.349195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68866ea6-b144-4a6b-bf85-a04e74eec697 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:58.349917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68866ea6-b144-4a6b-bf85-a04e74eec697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:58.350226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68866ea6-b144-4a6b-bf85-a04e74eec697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:58.351626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68866ea6-b144-4a6b-bf85-a04e74eec697 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:58.363555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 627/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:58.369736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea131f8-faed-4b7e-9b4c-02071600d300 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:58.468962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea131f8-faed-4b7e-9b4c-02071600d300 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:58.502205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dfa84-cd3d-484c-ad46-0150d477edc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:58.503023 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dfa84-cd3d-484c-ad46-0150d477edc0 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:58.503307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dfa84-cd3d-484c-ad46-0150d477edc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:58.503582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dfa84-cd3d-484c-ad46-0150d477edc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:58.510880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dfa84-cd3d-484c-ad46-0150d477edc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:58.512314 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dfa84-cd3d-484c-ad46-0150d477edc0 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-a46dfa84-cd3d-484c-ad46-0150d477edc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:31:58.525994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:31:58.527002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:31:58.527951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:31:58.527951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:31:58.527951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:31:58.527951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:31:58.527951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:31:58.527951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:31:58.527951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:31:58.527951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:31:58.527951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 631/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:31:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:31:58.533107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68866ea6-b144-4a6b-bf85-a04e74eec697 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:58.633810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68866ea6-b144-4a6b-bf85-a04e74eec697 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:58.666880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a8641-b90c-4c01-8ca0-a6aa0b7abbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:58.667533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a8641-b90c-4c01-8ca0-a6aa0b7abbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:58.667813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a8641-b90c-4c01-8ca0-a6aa0b7abbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:58.668087 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a8641-b90c-4c01-8ca0-a6aa0b7abbb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:58.668878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a8641-b90c-4c01-8ca0-a6aa0b7abbb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:58.669223 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a8641-b90c-4c01-8ca0-a6aa0b7abbb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:58.670712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a8641-b90c-4c01-8ca0-a6aa0b7abbb9 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:58.682967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 628/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:31:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:31:58.689012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dfa84-cd3d-484c-ad46-0150d477edc0 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:31:58.715926 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:31:58.788973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dfa84-cd3d-484c-ad46-0150d477edc0 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:31:58.820952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db44d13-1abc-4bd6-8132-c28ffe286b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:31:58.821602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db44d13-1abc-4bd6-8132-c28ffe286b67 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:31:58.821885 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db44d13-1abc-4bd6-8132-c28ffe286b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:31:58.822160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db44d13-1abc-4bd6-8132-c28ffe286b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:31:58.823570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db44d13-1abc-4bd6-8132-c28ffe286b67 None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=b1e0226354d14b9b9c4184063b2df9fe) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:31:58.823888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db44d13-1abc-4bd6-8132-c28ffe286b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:31:58.825582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db44d13-1abc-4bd6-8132-c28ffe286b67 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:31:58.831340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 632/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:31:58 2022] GET /identity/v3/role_assignments?user.id=b1e0226354d14b9b9c4184063b2df9fe&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:01.037854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71753d-cfa2-41d7-88e5-34b1b386b084 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:01.038448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71753d-cfa2-41d7-88e5-34b1b386b084 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:01.038448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71753d-cfa2-41d7-88e5-34b1b386b084 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:01.039796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 629/1261] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:32:01.045522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9a7c3-87de-4ca6-915e-13673331127f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:01.045904 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9a7c3-87de-4ca6-915e-13673331127f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:01.046083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9a7c3-87de-4ca6-915e-13673331127f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:01.063438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c8b9a7c3-87de-4ca6-915e-13673331127f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:32:01.064605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c8b9a7c3-87de-4ca6-915e-13673331127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:32:01.130918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 633/1262] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:32:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:32:01.152886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71753d-cfa2-41d7-88e5-34b1b386b084 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:01.163776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:01.253059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71753d-cfa2-41d7-88e5-34b1b386b084 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:01.285900 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f28f4e-5ff4-4fd6-b5f2-c2131e5a418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:01.286713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f28f4e-5ff4-4fd6-b5f2-c2131e5a418f None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:01.286997 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f28f4e-5ff4-4fd6-b5f2-c2131e5a418f None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:01.287271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f28f4e-5ff4-4fd6-b5f2-c2131e5a418f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:01.298510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f28f4e-5ff4-4fd6-b5f2-c2131e5a418f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-c7f28f4e-5ff4-4fd6-b5f2-c2131e5a418f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:32:01.306186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:01.307342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:32:01.308296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 630/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:32:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:01.313568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9a7c3-87de-4ca6-915e-13673331127f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:01.331905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:01.410150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9a7c3-87de-4ca6-915e-13673331127f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:01.444373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707b731-389b-4df5-8897-90d870205031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:01.445087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707b731-389b-4df5-8897-90d870205031 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:01.445373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707b731-389b-4df5-8897-90d870205031 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:01.445670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707b731-389b-4df5-8897-90d870205031 None admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:01.446435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707b731-389b-4df5-8897-90d870205031 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:01.446745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707b731-389b-4df5-8897-90d870205031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:01.448189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707b731-389b-4df5-8897-90d870205031 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:01.456527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 634/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:32:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:01.462522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f28f4e-5ff4-4fd6-b5f2-c2131e5a418f None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:01.529080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:01.561501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f28f4e-5ff4-4fd6-b5f2-c2131e5a418f None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:01.595534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b3d66-1283-4dc7-809b-d4af0e96f3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:01.596321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b3d66-1283-4dc7-809b-d4af0e96f3bf None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:01.596602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b3d66-1283-4dc7-809b-d4af0e96f3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:01.596876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b3d66-1283-4dc7-809b-d4af0e96f3bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:01.607909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b3d66-1283-4dc7-809b-d4af0e96f3bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:01.609340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b3d66-1283-4dc7-809b-d4af0e96f3bf None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-b61b3d66-1283-4dc7-809b-d4af0e96f3bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:32:01.625708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:01.626799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:01.628063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:32:01.628063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:32:01.628063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:32:01.628063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:32:01.628063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 631/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:01.632681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707b731-389b-4df5-8897-90d870205031 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:01.713946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:01.732803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707b731-389b-4df5-8897-90d870205031 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:01.766617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f835eeb-40bd-4285-a486-64a26b26cc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:01.767292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f835eeb-40bd-4285-a486-64a26b26cc8a None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:01.767835 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f835eeb-40bd-4285-a486-64a26b26cc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:01.768171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f835eeb-40bd-4285-a486-64a26b26cc8a None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:01.769151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f835eeb-40bd-4285-a486-64a26b26cc8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:01.769483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f835eeb-40bd-4285-a486-64a26b26cc8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:01.771333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f835eeb-40bd-4285-a486-64a26b26cc8a None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:01.783360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 635/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:32:01.788957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b3d66-1283-4dc7-809b-d4af0e96f3bf None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:01.886699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b3d66-1283-4dc7-809b-d4af0e96f3bf None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:01.906326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:01.921041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dd25b-d834-4f13-af9a-febdf6061f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:01.921843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dd25b-d834-4f13-af9a-febdf6061f73 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:01.922125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dd25b-d834-4f13-af9a-febdf6061f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:01.922427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dd25b-d834-4f13-af9a-febdf6061f73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:01.929895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dd25b-d834-4f13-af9a-febdf6061f73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:01.931360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dd25b-d834-4f13-af9a-febdf6061f73 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-5f8dd25b-d834-4f13-af9a-febdf6061f73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:32:01.945238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:01.946371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:01.948195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:01.948195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:01.948195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:32:01.948195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:32:01.948195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:32:01.948195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:32:01.948195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:32:01.948195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:32:01.948195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:32:01.948195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:32:01.948195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 632/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:32:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:01.952999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f835eeb-40bd-4285-a486-64a26b26cc8a None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:02.052413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f835eeb-40bd-4285-a486-64a26b26cc8a None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:02.086365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a4444-99cd-4921-9ac6-74106678a0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:02.087066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a4444-99cd-4921-9ac6-74106678a0af None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:02.087354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a4444-99cd-4921-9ac6-74106678a0af None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:02.087630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a4444-99cd-4921-9ac6-74106678a0af None admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:02.088492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a4444-99cd-4921-9ac6-74106678a0af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:02.088803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a4444-99cd-4921-9ac6-74106678a0af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:02.090213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a4444-99cd-4921-9ac6-74106678a0af None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:02.098825 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:02.107968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 636/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jun 8 06:32:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:32:02.113520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dd25b-d834-4f13-af9a-febdf6061f73 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:02.216144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dd25b-d834-4f13-af9a-febdf6061f73 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:02.249127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9c6b5-2207-498f-ba15-b79270af068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:02.249908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9c6b5-2207-498f-ba15-b79270af068a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:02.250191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9c6b5-2207-498f-ba15-b79270af068a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:02.250493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9c6b5-2207-498f-ba15-b79270af068a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:02.262303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9c6b5-2207-498f-ba15-b79270af068a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:02.263774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9c6b5-2207-498f-ba15-b79270af068a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-3ea9c6b5-2207-498f-ba15-b79270af068a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:32:02.280661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:02.282418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:02.284203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:32:02.284203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:32:02.284203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:32:02.284203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:32:02.284203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 633/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:02.287579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a4444-99cd-4921-9ac6-74106678a0af None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:02.387018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a4444-99cd-4921-9ac6-74106678a0af None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:02.420715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00563967-f015-40b9-96fa-2c7daba7fadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:02.421304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00563967-f015-40b9-96fa-2c7daba7fadd None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:02.421582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00563967-f015-40b9-96fa-2c7daba7fadd None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:02.421852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00563967-f015-40b9-96fa-2c7daba7fadd None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:02.422594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00563967-f015-40b9-96fa-2c7daba7fadd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:02.422895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00563967-f015-40b9-96fa-2c7daba7fadd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:02.424342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00563967-f015-40b9-96fa-2c7daba7fadd None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:02.435863 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 637/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:02.441496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9c6b5-2207-498f-ba15-b79270af068a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:02.473605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:02.539705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9c6b5-2207-498f-ba15-b79270af068a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:02.572343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40f8d5-0ad2-4723-895e-85bf94b96a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:02.573121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40f8d5-0ad2-4723-895e-85bf94b96a72 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:02.573403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40f8d5-0ad2-4723-895e-85bf94b96a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:02.573680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40f8d5-0ad2-4723-895e-85bf94b96a72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:02.580405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40f8d5-0ad2-4723-895e-85bf94b96a72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:02.581830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40f8d5-0ad2-4723-895e-85bf94b96a72 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-8c40f8d5-0ad2-4723-895e-85bf94b96a72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:32:02.595612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:02.596698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:02.597941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:32:02.597941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:32:02.597941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:32:02.597941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:32:02.597941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:32:02.597941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:32:02.597941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:32:02.597941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:32:02.597941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 634/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:02.602603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00563967-f015-40b9-96fa-2c7daba7fadd None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:02.661871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:02.703300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00563967-f015-40b9-96fa-2c7daba7fadd None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:02.736573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde9b30-9faa-4a33-96a6-12fa38c291f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:02.737233 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde9b30-9faa-4a33-96a6-12fa38c291f8 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:02.737525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde9b30-9faa-4a33-96a6-12fa38c291f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:02.737800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde9b30-9faa-4a33-96a6-12fa38c291f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:02.738623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde9b30-9faa-4a33-96a6-12fa38c291f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:02.738933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde9b30-9faa-4a33-96a6-12fa38c291f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:02.740355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde9b30-9faa-4a33-96a6-12fa38c291f8 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:02.752180 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 638/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:32:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:02.758075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40f8d5-0ad2-4723-895e-85bf94b96a72 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:02.847223 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:02.856123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40f8d5-0ad2-4723-895e-85bf94b96a72 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:02.890430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4627ff9-99ff-4b08-b2ea-85fbfbec7fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:02.891321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627ff9-99ff-4b08-b2ea-85fbfbec7fbe None admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:02.891599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627ff9-99ff-4b08-b2ea-85fbfbec7fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:02.891895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627ff9-99ff-4b08-b2ea-85fbfbec7fbe None admin] PATH_INFO: `/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/b1e0226354d14b9b9c4184063b2df9fe/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:02.893850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4627ff9-99ff-4b08-b2ea-85fbfbec7fbe None admin] RBAC: Authorizing `identity:create_grant(project_id=58bfdd3959af4837be6e8a4a1894fa43, user_id=b1e0226354d14b9b9c4184063b2df9fe, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:02.895315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4627ff9-99ff-4b08-b2ea-85fbfbec7fbe None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:03.053714 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 635/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jun 8 06:32:02 2022] PUT /identity/v3/projects/58bfdd3959af4837be6e8a4a1894fa43/users/b1e0226354d14b9b9c4184063b2df9fe/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:32:05.268224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1ac3-78ad-44ac-a2f4-173f4630d69e None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:05.268811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1ac3-78ad-44ac-a2f4-173f4630d69e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:05.268811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1ac3-78ad-44ac-a2f4-173f4630d69e None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:05.270306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 639/1274] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:32:05.275565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b0cc-3273-4337-9fa2-5904cf6444a6 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:05.275990 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b0cc-3273-4337-9fa2-5904cf6444a6 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:05.276143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b0cc-3273-4337-9fa2-5904cf6444a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:05.292175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-0419b0cc-3273-4337-9fa2-5904cf6444a6 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:32:05.293453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0419b0cc-3273-4337-9fa2-5904cf6444a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:32:05.361494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 636/1275] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:32:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 06:32:05.385336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e1ac3-78ad-44ac-a2f4-173f4630d69e None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:05.486098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e1ac3-78ad-44ac-a2f4-173f4630d69e None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:05.506765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:05.524760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c32b2-18d4-475c-96e5-054de1ac2bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:05.525569 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c32b2-18d4-475c-96e5-054de1ac2bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:05.525848 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c32b2-18d4-475c-96e5-054de1ac2bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:05.526120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c32b2-18d4-475c-96e5-054de1ac2bf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:05.537685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c32b2-18d4-475c-96e5-054de1ac2bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-d81c32b2-18d4-475c-96e5-054de1ac2bf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 06:32:05.546135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:05.547302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:05.548231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 640/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jun 8 06:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 06:32:05.553486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419b0cc-3273-4337-9fa2-5904cf6444a6 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:05.643536 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:05.669252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419b0cc-3273-4337-9fa2-5904cf6444a6 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:05.705973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5ed85-284f-4d51-b24c-33d510266dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:05.706694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ed85-284f-4d51-b24c-33d510266dbd None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:05.706977 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ed85-284f-4d51-b24c-33d510266dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:05.707252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ed85-284f-4d51-b24c-33d510266dbd None admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:05.708017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5ed85-284f-4d51-b24c-33d510266dbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:05.708326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5ed85-284f-4d51-b24c-33d510266dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:05.709821 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5ed85-284f-4d51-b24c-33d510266dbd None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:05.724025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 637/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jun 8 06:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:05.725342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c32b2-18d4-475c-96e5-054de1ac2bf7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:05.839414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c32b2-18d4-475c-96e5-054de1ac2bf7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:05.873737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424820f-810d-4dd8-a63b-8165c65a9bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:05.874574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424820f-810d-4dd8-a63b-8165c65a9bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:05.874856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424820f-810d-4dd8-a63b-8165c65a9bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:05.875128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424820f-810d-4dd8-a63b-8165c65a9bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:05.885764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424820f-810d-4dd8-a63b-8165c65a9bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:05.887220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424820f-810d-4dd8-a63b-8165c65a9bd4 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-5424820f-810d-4dd8-a63b-8165c65a9bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:32:05.904605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:05.905611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:05.910518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:32:05.910518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:32:05.910518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:32:05.910518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:05.910518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 641/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:05.912029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5ed85-284f-4d51-b24c-33d510266dbd None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:06.013978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5ed85-284f-4d51-b24c-33d510266dbd None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:06.047301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119759e-8fac-4b33-8cfa-53a8e4c84259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:06.048006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119759e-8fac-4b33-8cfa-53a8e4c84259 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:06.048330 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119759e-8fac-4b33-8cfa-53a8e4c84259 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:06.048608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119759e-8fac-4b33-8cfa-53a8e4c84259 None admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:06.049382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119759e-8fac-4b33-8cfa-53a8e4c84259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:06.049688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119759e-8fac-4b33-8cfa-53a8e4c84259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:06.051086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119759e-8fac-4b33-8cfa-53a8e4c84259 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:06.063393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 638/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:06.069071 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424820f-810d-4dd8-a63b-8165c65a9bd4 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:06.099956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:06.171841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424820f-810d-4dd8-a63b-8165c65a9bd4 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:06.205009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a19a7-b537-4477-8c63-9fca849691c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:06.205800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a19a7-b537-4477-8c63-9fca849691c7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:06.206084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a19a7-b537-4477-8c63-9fca849691c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:06.206392 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a19a7-b537-4477-8c63-9fca849691c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:06.214317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a19a7-b537-4477-8c63-9fca849691c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:06.215747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a19a7-b537-4477-8c63-9fca849691c7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-065a19a7-b537-4477-8c63-9fca849691c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 06:32:06.229788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:06.231534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:06.232832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:06.232832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:06.232832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 06:32:06.232832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 06:32:06.232832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 06:32:06.232832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 06:32:06.232832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 06:32:06.232832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 06:32:06.232832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 06:32:06.232832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:06.232832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 642/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:32:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:06.236817 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119759e-8fac-4b33-8cfa-53a8e4c84259 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:06.240560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:06.334433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119759e-8fac-4b33-8cfa-53a8e4c84259 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:06.367742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159822fe-81c3-4782-b0ad-e932ed08e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:06.368343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159822fe-81c3-4782-b0ad-e932ed08e02a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:06.368628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159822fe-81c3-4782-b0ad-e932ed08e02a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:06.368905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159822fe-81c3-4782-b0ad-e932ed08e02a None admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:06.369769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159822fe-81c3-4782-b0ad-e932ed08e02a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:06.370078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159822fe-81c3-4782-b0ad-e932ed08e02a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:06.371535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159822fe-81c3-4782-b0ad-e932ed08e02a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:06.388716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 639/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jun 8 06:32:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:06.394476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a19a7-b537-4477-8c63-9fca849691c7 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:06.489161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:06.499544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a19a7-b537-4477-8c63-9fca849691c7 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:06.533327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072397d7-0f66-4beb-b31d-579e2ebeb416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:06.534024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072397d7-0f66-4beb-b31d-579e2ebeb416 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:06.534309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072397d7-0f66-4beb-b31d-579e2ebeb416 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:06.534593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072397d7-0f66-4beb-b31d-579e2ebeb416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:06.605931 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072397d7-0f66-4beb-b31d-579e2ebeb416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:06.607503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072397d7-0f66-4beb-b31d-579e2ebeb416 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:06.696087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:06.706859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 643/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jun 8 06:32:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 06:32:06.712704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159822fe-81c3-4782-b0ad-e932ed08e02a None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:06.772839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:06.809889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159822fe-81c3-4782-b0ad-e932ed08e02a None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:06.843312 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30694951-c00b-4424-9e15-aa4361005b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:06.844089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30694951-c00b-4424-9e15-aa4361005b65 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:06.844366 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30694951-c00b-4424-9e15-aa4361005b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:06.844636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30694951-c00b-4424-9e15-aa4361005b65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:06.854854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30694951-c00b-4424-9e15-aa4361005b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:06.856264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30694951-c00b-4424-9e15-aa4361005b65 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-30694951-c00b-4424-9e15-aa4361005b65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 06:32:06.874910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:06.875808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:06.876830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 06:32:06.876830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 06:32:06.876830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 06:32:06.876830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:32:06.876830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 640/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:06.881844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072397d7-0f66-4beb-b31d-579e2ebeb416 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:06.980303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072397d7-0f66-4beb-b31d-579e2ebeb416 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:07.141856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08afa1d-f3ad-4ddc-b81a-1bf91a3e57a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:07.142675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08afa1d-f3ad-4ddc-b81a-1bf91a3e57a6 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:07.142959 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08afa1d-f3ad-4ddc-b81a-1bf91a3e57a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:07.143230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08afa1d-f3ad-4ddc-b81a-1bf91a3e57a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:07.144060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08afa1d-f3ad-4ddc-b81a-1bf91a3e57a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:07.144358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08afa1d-f3ad-4ddc-b81a-1bf91a3e57a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:07.145709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08afa1d-f3ad-4ddc-b81a-1bf91a3e57a6 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:07.157574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 644/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jun 8 06:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:07.163411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30694951-c00b-4424-9e15-aa4361005b65 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:07.261244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30694951-c00b-4424-9e15-aa4361005b65 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:07.274734 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:07.294816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc6ea7-d54e-487e-9288-6309979d4ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:07.295594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc6ea7-d54e-487e-9288-6309979d4ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:07.295879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc6ea7-d54e-487e-9288-6309979d4ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:07.296157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc6ea7-d54e-487e-9288-6309979d4ac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:07.302649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc6ea7-d54e-487e-9288-6309979d4ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:07.304075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc6ea7-d54e-487e-9288-6309979d4ac8 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-03cc6ea7-d54e-487e-9288-6309979d4ac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 06:32:07.317834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:07.321244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:07.322399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 06:32:07.322399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 06:32:07.322399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 06:32:07.322399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 06:32:07.322399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 06:32:07.322399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 06:32:07.322399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 06:32:07.322399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 06:32:07.322399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 641/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jun 8 06:32:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:07.325236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08afa1d-f3ad-4ddc-b81a-1bf91a3e57a6 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:07.374250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:07.421998 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08afa1d-f3ad-4ddc-b81a-1bf91a3e57a6 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:07.454469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6554c-db03-47b3-9add-f08fa852a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:07.455125 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6554c-db03-47b3-9add-f08fa852a120 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:07.455412 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6554c-db03-47b3-9add-f08fa852a120 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:07.455689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6554c-db03-47b3-9add-f08fa852a120 None admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:07.456470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6554c-db03-47b3-9add-f08fa852a120 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:07.456780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6554c-db03-47b3-9add-f08fa852a120 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:07.458192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6554c-db03-47b3-9add-f08fa852a120 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:07.470323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 645/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jun 8 06:32:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:07.476426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc6ea7-d54e-487e-9288-6309979d4ac8 None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:07.574396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc6ea7-d54e-487e-9288-6309979d4ac8 None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:07.609038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cee8dd-4e3d-479f-90d4-37cde1b8e7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:07.609687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee8dd-4e3d-479f-90d4-37cde1b8e7ff None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:07.609971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee8dd-4e3d-479f-90d4-37cde1b8e7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:07.610274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee8dd-4e3d-479f-90d4-37cde1b8e7ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:07.611109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cee8dd-4e3d-479f-90d4-37cde1b8e7ff None admin] RBAC: Adding query filter params (role.id=ac92b450c3944b7293c9140d40a45c00, scope.project.id=58bfdd3959af4837be6e8a4a1894fa43, user.id=b1e0226354d14b9b9c4184063b2df9fe) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:07.611423 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cee8dd-4e3d-479f-90d4-37cde1b8e7ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:07.612889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cee8dd-4e3d-479f-90d4-37cde1b8e7ff None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:07.618666 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 642/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jun 8 06:32:07 2022] GET /identity/v3/role_assignments?user.id=b1e0226354d14b9b9c4184063b2df9fe&scope.project.id=58bfdd3959af4837be6e8a4a1894fa43&role.id=ac92b450c3944b7293c9140d40a45c00 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:09.872562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcc3e2-522f-40e1-b3ba-086ffdaca840 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:09.873116 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcc3e2-522f-40e1-b3ba-086ffdaca840 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:09.873116 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcc3e2-522f-40e1-b3ba-086ffdaca840 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:09.875731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 646/1288] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:32:09.880250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e343d77-9f20-4035-852c-68ef5edfb508 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:09.880630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e343d77-9f20-4035-852c-68ef5edfb508 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:09.880814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e343d77-9f20-4035-852c-68ef5edfb508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:09.907152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-0e343d77-9f20-4035-852c-68ef5edfb508 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:32:09.908351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0e343d77-9f20-4035-852c-68ef5edfb508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:32:09.938918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:09.975530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 643/1289] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:32:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:32:10.000387 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcc3e2-522f-40e1-b3ba-086ffdaca840 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:10.100128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcc3e2-522f-40e1-b3ba-086ffdaca840 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:10.110883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:10.134155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef326936-6401-4c79-b557-eac681603d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:10.135039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326936-6401-4c79-b557-eac681603d11 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:10.135326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326936-6401-4c79-b557-eac681603d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:10.135596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326936-6401-4c79-b557-eac681603d11 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:10.136251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef326936-6401-4c79-b557-eac681603d11 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:10.137606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef326936-6401-4c79-b557-eac681603d11 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-ef326936-6401-4c79-b557-eac681603d11 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:10.149935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:10.152722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:10.153744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 647/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jun 8 06:32:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:10.157704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e343d77-9f20-4035-852c-68ef5edfb508 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:10.258799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e343d77-9f20-4035-852c-68ef5edfb508 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:10.292157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52ff69-a67b-4319-abc5-e7a05805ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:10.292809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52ff69-a67b-4319-abc5-e7a05805ddfa None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:10.293096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52ff69-a67b-4319-abc5-e7a05805ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:10.293386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52ff69-a67b-4319-abc5-e7a05805ddfa None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:10.294080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52ff69-a67b-4319-abc5-e7a05805ddfa None admin] RBAC: Adding query filter params (name=placement) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:10.294412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52ff69-a67b-4319-abc5-e7a05805ddfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:10.295758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52ff69-a67b-4319-abc5-e7a05805ddfa None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:10.300511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 644/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Jun 8 06:32:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:10.306295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef326936-6401-4c79-b557-eac681603d11 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:10.402591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef326936-6401-4c79-b557-eac681603d11 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:10.434674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66799e4-aa94-4899-87ba-e13f6d1cfd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:10.435314 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66799e4-aa94-4899-87ba-e13f6d1cfd59 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:10.435591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66799e4-aa94-4899-87ba-e13f6d1cfd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:10.435859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66799e4-aa94-4899-87ba-e13f6d1cfd59 None admin] PATH_INFO: `/v3/services` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:10.436571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66799e4-aa94-4899-87ba-e13f6d1cfd59 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:10.436871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66799e4-aa94-4899-87ba-e13f6d1cfd59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:10.438211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66799e4-aa94-4899-87ba-e13f6d1cfd59 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:10.442501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 648/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Jun 8 06:32:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:12.658891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbf5ca-0148-42e4-a9e5-a99de467da93 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:12.659530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbf5ca-0148-42e4-a9e5-a99de467da93 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:12.659530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbf5ca-0148-42e4-a9e5-a99de467da93 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:12.660830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 645/1293] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:32:12.666050 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097274-6802-4f44-b469-829fd9a5f455 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:12.666500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097274-6802-4f44-b469-829fd9a5f455 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:12.666638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097274-6802-4f44-b469-829fd9a5f455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:12.683327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-85097274-6802-4f44-b469-829fd9a5f455 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:32:12.685842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-85097274-6802-4f44-b469-829fd9a5f455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:32:12.713260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:12.748612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 649/1294] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:32:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:32:12.771402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbf5ca-0148-42e4-a9e5-a99de467da93 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:12.801553 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:12.871082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbf5ca-0148-42e4-a9e5-a99de467da93 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:12.903537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0645b-c6d6-4e4d-93c7-5c3203a844e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:12.904190 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0645b-c6d6-4e4d-93c7-5c3203a844e6 None admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:12.904470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0645b-c6d6-4e4d-93c7-5c3203a844e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:12.904746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0645b-c6d6-4e4d-93c7-5c3203a844e6 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:12.905462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0645b-c6d6-4e4d-93c7-5c3203a844e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:12.906852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0645b-c6d6-4e4d-93c7-5c3203a844e6 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:12.979417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 646/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jun 8 06:32:12 2022] POST /identity/v3/services => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:32:15.219791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075faa-6b54-44cd-987c-e57187b756ee None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:15.220331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075faa-6b54-44cd-987c-e57187b756ee None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:15.220331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075faa-6b54-44cd-987c-e57187b756ee None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:15.221709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 650/1296] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:32:15.227198 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f42cf9-d8f9-4276-a57e-24fad4af3574 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:15.227621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f42cf9-d8f9-4276-a57e-24fad4af3574 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:15.227793 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f42cf9-d8f9-4276-a57e-24fad4af3574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:15.245358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-81f42cf9-d8f9-4276-a57e-24fad4af3574 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:32:15.246573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-81f42cf9-d8f9-4276-a57e-24fad4af3574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:32:15.317188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 647/1297] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:32:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:32:15.346031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01075faa-6b54-44cd-987c-e57187b756ee None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:15.453287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01075faa-6b54-44cd-987c-e57187b756ee None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:15.489198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094efd59-c9cd-4487-807a-f57878eb4442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:15.490521 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094efd59-c9cd-4487-807a-f57878eb4442 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:15.491029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094efd59-c9cd-4487-807a-f57878eb4442 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:15.491532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094efd59-c9cd-4487-807a-f57878eb4442 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:15.492400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094efd59-c9cd-4487-807a-f57878eb4442 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:15.493755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094efd59-c9cd-4487-807a-f57878eb4442 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-094efd59-c9cd-4487-807a-f57878eb4442 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:15.510662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:15.519972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:15.520983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 651/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jun 8 06:32:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:15.521777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f42cf9-d8f9-4276-a57e-24fad4af3574 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:15.536859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:15.615650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f42cf9-d8f9-4276-a57e-24fad4af3574 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:15.648602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810217a-c5b4-4ff3-addf-3a06d900412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:15.649252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810217a-c5b4-4ff3-addf-3a06d900412c None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:15.649531 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810217a-c5b4-4ff3-addf-3a06d900412c None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:15.649809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810217a-c5b4-4ff3-addf-3a06d900412c None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:15.651073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810217a-c5b4-4ff3-addf-3a06d900412c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:15.651376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810217a-c5b4-4ff3-addf-3a06d900412c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:15.652822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810217a-c5b4-4ff3-addf-3a06d900412c None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:15.657833 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 648/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Jun 8 06:32:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:15.663847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094efd59-c9cd-4487-807a-f57878eb4442 None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:15.694990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:15.762495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094efd59-c9cd-4487-807a-f57878eb4442 None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:15.800071 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7c6b2-6190-4d8f-920d-d2a949556df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:15.800744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7c6b2-6190-4d8f-920d-d2a949556df7 None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:15.801033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7c6b2-6190-4d8f-920d-d2a949556df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:15.801309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7c6b2-6190-4d8f-920d-d2a949556df7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:15.802113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7c6b2-6190-4d8f-920d-d2a949556df7 None admin] RBAC: Adding query filter params (interface=public, service_id=7ce7262e425a47d7b48acc1664acdd98, region_id=RegionOne) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:15.802459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7c6b2-6190-4d8f-920d-d2a949556df7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:15.803831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7c6b2-6190-4d8f-920d-d2a949556df7 None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:15.809172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 652/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jun 8 06:32:15 2022] GET /identity/v3/endpoints?service_id=7ce7262e425a47d7b48acc1664acdd98&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:15.814937 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810217a-c5b4-4ff3-addf-3a06d900412c None admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:15.896258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:15.914285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810217a-c5b4-4ff3-addf-3a06d900412c None admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:15.946711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058a588-3ee2-4f23-917a-348bc1f7be99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:15.947880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058a588-3ee2-4f23-917a-348bc1f7be99 None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:15.948173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058a588-3ee2-4f23-917a-348bc1f7be99 None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:15.948436 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058a588-3ee2-4f23-917a-348bc1f7be99 None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:15.949116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058a588-3ee2-4f23-917a-348bc1f7be99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:15.950772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058a588-3ee2-4f23-917a-348bc1f7be99 None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:15.957310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 649/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jun 8 06:32:15 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:32:18.186712 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e200038-4aa8-4f81-bec4-0c7797c251e9 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:18.187221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e200038-4aa8-4f81-bec4-0c7797c251e9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:18.187329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e200038-4aa8-4f81-bec4-0c7797c251e9 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:18.188631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 653/1302] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:32:18.193753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7c08e-1600-42c9-869b-4fed3f3ba596 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:18.194223 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7c08e-1600-42c9-869b-4fed3f3ba596 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:18.194539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7c08e-1600-42c9-869b-4fed3f3ba596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:18.210951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-33a7c08e-1600-42c9-869b-4fed3f3ba596 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:32:18.212155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-33a7c08e-1600-42c9-869b-4fed3f3ba596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:32:18.277151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 650/1303] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:32:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 06:32:18.300913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e200038-4aa8-4f81-bec4-0c7797c251e9 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:18.393952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:18.400383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e200038-4aa8-4f81-bec4-0c7797c251e9 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:18.432907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ecb6f-a126-4db3-9343-104a9007119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:18.433687 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ecb6f-a126-4db3-9343-104a9007119b None admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:18.434002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ecb6f-a126-4db3-9343-104a9007119b None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:18.434301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ecb6f-a126-4db3-9343-104a9007119b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:18.434948 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ecb6f-a126-4db3-9343-104a9007119b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:18.436301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ecb6f-a126-4db3-9343-104a9007119b None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application [None req-f97ecb6f-a126-4db3-9343-104a9007119b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 06:32:18.447868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 06:32:18.449087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application with Lock( Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self._enter() Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application return self.creator() Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application created_value = creator( Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: ERROR keystone.server.flask.application Jun 08 06:32:18.450594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 654/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jun 8 06:32:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 06:32:18.455502 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7c08e-1600-42c9-869b-4fed3f3ba596 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:18.530445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:18.552383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7c08e-1600-42c9-869b-4fed3f3ba596 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:18.584322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185cd59-40a2-4cd3-8920-b3101173985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:18.585028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185cd59-40a2-4cd3-8920-b3101173985a None admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:18.585281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185cd59-40a2-4cd3-8920-b3101173985a None admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:18.585549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185cd59-40a2-4cd3-8920-b3101173985a None admin] PATH_INFO: `/v3/services` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:18.586266 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185cd59-40a2-4cd3-8920-b3101173985a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:32:18.586576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185cd59-40a2-4cd3-8920-b3101173985a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:18.588421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185cd59-40a2-4cd3-8920-b3101173985a None admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:18.593437 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 651/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Jun 8 06:32:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:32:18.599229 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ecb6f-a126-4db3-9343-104a9007119b None admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:32:18.695861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ecb6f-a126-4db3-9343-104a9007119b None admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:32:18.728889 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c11e1-bbd4-426b-9e8a-75f77164439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:32:18.729533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c11e1-bbd4-426b-9e8a-75f77164439f None admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:32:18.729815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c11e1-bbd4-426b-9e8a-75f77164439f None admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:32:18.730089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c11e1-bbd4-426b-9e8a-75f77164439f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:32:18.730854 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c11e1-bbd4-426b-9e8a-75f77164439f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:32:18.732200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c11e1-bbd4-426b-9e8a-75f77164439f None admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:32:18.804075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 655/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jun 8 06:32:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:32:28.604316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=30 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:32:28.799685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:37:56.391737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f0028-48a8-4e44-86b3-08b658981989 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:37:56.392335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f0028-48a8-4e44-86b3-08b658981989 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:37:56.392335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f0028-48a8-4e44-86b3-08b658981989 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:37:56.394521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 652/1307] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:37:56.401470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a0d77-3fcc-4b45-9bbf-885435ad2c68 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:37:56.401470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a0d77-3fcc-4b45-9bbf-885435ad2c68 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:37:56.401470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a0d77-3fcc-4b45-9bbf-885435ad2c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:37:56.473781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-b38a0d77-3fcc-4b45-9bbf-885435ad2c68 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:37:56.475029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b38a0d77-3fcc-4b45-9bbf-885435ad2c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:37:56.602604 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 656/1308] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:37:56.654837 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aba9fd-d38e-46bc-80a0-15597ef0a772 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:37:56.655454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aba9fd-d38e-46bc-80a0-15597ef0a772 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:37:56.655916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aba9fd-d38e-46bc-80a0-15597ef0a772 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:37:56.657738 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 653/1309] 10.222.0.40 () {54 vars in 964 bytes} [Wed Jun 8 06:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:37:56.667184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840945bf-710a-4bba-b511-38634a56b219 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:37:56.667876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840945bf-710a-4bba-b511-38634a56b219 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:37:56.668364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840945bf-710a-4bba-b511-38634a56b219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:37:56.754505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-840945bf-710a-4bba-b511-38634a56b219 None None] MFA Rules not processed for user `11838a2908884cc79df912b3b2199564`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:37:56.756069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-840945bf-710a-4bba-b511-38634a56b219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:37:56.782063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:37:56.841537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 657/1310] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Jun 8 06:37:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:37:56.851279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aba9fd-d38e-46bc-80a0-15597ef0a772 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:37:56.853685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-85aba9fd-d38e-46bc-80a0-15597ef0a772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:37:56.973904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aba9fd-d38e-46bc-80a0-15597ef0a772 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:37:57.050645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8dde-4cbc-4544-abf2-43b79b3c198d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:37:57.051598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8dde-4cbc-4544-abf2-43b79b3c198d service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:37:57.052027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8dde-4cbc-4544-abf2-43b79b3c198d service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:37:57.052447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8dde-4cbc-4544-abf2-43b79b3c198d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:37:57.054568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-42bd8dde-4cbc-4544-abf2-43b79b3c198d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:37:57.110425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:37:57.173073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd8dde-4cbc-4544-abf2-43b79b3c198d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:37:57.174666 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd8dde-4cbc-4544-abf2-43b79b3c198d service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:37:57.209666 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 654/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:37:59.756559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ebdb9-9470-4930-ac22-31dcc2965cc8 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:37:59.757100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ebdb9-9470-4930-ac22-31dcc2965cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:37:59.757100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ebdb9-9470-4930-ac22-31dcc2965cc8 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:37:59.758673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 658/1312] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:37:59.763791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f025277-857d-49f9-a599-c4ca1ed7b1e8 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:37:59.764187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f025277-857d-49f9-a599-c4ca1ed7b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:37:59.764379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f025277-857d-49f9-a599-c4ca1ed7b1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:37:59.850985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-6f025277-857d-49f9-a599-c4ca1ed7b1e8 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:37:59.852317 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-6f025277-857d-49f9-a599-c4ca1ed7b1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:37:59.958321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 655/1313] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:37:59.994555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ebdb9-9470-4930-ac22-31dcc2965cc8 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:37:59.996091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3b6ebdb9-9470-4930-ac22-31dcc2965cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:00.113978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ebdb9-9470-4930-ac22-31dcc2965cc8 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:00.188962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:00.192054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80cba0-b27e-48fe-ab02-fcdb41cc79fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:00.192658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80cba0-b27e-48fe-ab02-fcdb41cc79fe service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:00.192935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80cba0-b27e-48fe-ab02-fcdb41cc79fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:00.193204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80cba0-b27e-48fe-ab02-fcdb41cc79fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:00.194922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0b80cba0-b27e-48fe-ab02-fcdb41cc79fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:00.306963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80cba0-b27e-48fe-ab02-fcdb41cc79fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:00.308394 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80cba0-b27e-48fe-ab02-fcdb41cc79fe service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:00.327909 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 659/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:03.085471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d92e8-7d96-44f7-abc7-78df078bc048 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:03.085994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d92e8-7d96-44f7-abc7-78df078bc048 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:03.085994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d92e8-7d96-44f7-abc7-78df078bc048 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:03.087343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 656/1315] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:03.092728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19710a-d9cf-4c64-9578-e73f2dd6c7ff None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:03.093172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19710a-d9cf-4c64-9578-e73f2dd6c7ff None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:03.093267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19710a-d9cf-4c64-9578-e73f2dd6c7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:03.156860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-7f19710a-d9cf-4c64-9578-e73f2dd6c7ff None None] MFA Rules not processed for user `a347ea4ea5a0424b8b080b3702d8ee75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:03.158066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-7f19710a-d9cf-4c64-9578-e73f2dd6c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:03.209189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:03.252333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 660/1316] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:03.306564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bceac-3801-40bb-be67-53da1ba23183 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:03.306846 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bceac-3801-40bb-be67-53da1ba23183 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:03.307117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bceac-3801-40bb-be67-53da1ba23183 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:03.308497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 657/1317] 10.222.0.40 () {54 vars in 964 bytes} [Wed Jun 8 06:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:03.314413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f0bee-0af3-41cf-9dda-a776e0a079a0 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:03.314701 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f0bee-0af3-41cf-9dda-a776e0a079a0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:03.314976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f0bee-0af3-41cf-9dda-a776e0a079a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:03.394172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c33f0bee-0af3-41cf-9dda-a776e0a079a0 None None] MFA Rules not processed for user `11838a2908884cc79df912b3b2199564`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:03.395395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c33f0bee-0af3-41cf-9dda-a776e0a079a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:03.468794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 661/1318] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Jun 8 06:38:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:03.477924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bceac-3801-40bb-be67-53da1ba23183 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:03.479479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-da8bceac-3801-40bb-be67-53da1ba23183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:03.489110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:03.582323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bceac-3801-40bb-be67-53da1ba23183 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:03.653990 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d39cc1-755c-4755-b4fb-9cba034d21b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:03.654593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39cc1-755c-4755-b4fb-9cba034d21b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:03.654876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39cc1-755c-4755-b4fb-9cba034d21b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:03.655150 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39cc1-755c-4755-b4fb-9cba034d21b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:03.656795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-46d39cc1-755c-4755-b4fb-9cba034d21b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:03.718385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:03.763612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d39cc1-755c-4755-b4fb-9cba034d21b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:03.765024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d39cc1-755c-4755-b4fb-9cba034d21b7 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:03.783442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 658/1319] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:07.164163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbeb77-c699-4130-9fc7-3ce8798234e2 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:07.164652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbeb77-c699-4130-9fc7-3ce8798234e2 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:07.164744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbeb77-c699-4130-9fc7-3ce8798234e2 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:07.166076 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 662/1320] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:07.171370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420063f-f760-44a3-b814-ebe5a7b75c36 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:07.171806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420063f-f760-44a3-b814-ebe5a7b75c36 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:07.171933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420063f-f760-44a3-b814-ebe5a7b75c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:07.236874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-1420063f-f760-44a3-b814-ebe5a7b75c36 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:07.238704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1420063f-f760-44a3-b814-ebe5a7b75c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:07.331452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 659/1321] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:07.370183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbeb77-c699-4130-9fc7-3ce8798234e2 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:07.371732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-70fbeb77-c699-4130-9fc7-3ce8798234e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:07.420302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:07.472710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbeb77-c699-4130-9fc7-3ce8798234e2 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:07.544325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f450c-25ab-4af8-9737-839cc7f875e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:07.544960 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f450c-25ab-4af8-9737-839cc7f875e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:07.545240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f450c-25ab-4af8-9737-839cc7f875e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:07.545518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f450c-25ab-4af8-9737-839cc7f875e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:07.547178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0e4f450c-25ab-4af8-9737-839cc7f875e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:07.640439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:07.653447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f450c-25ab-4af8-9737-839cc7f875e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:07.654895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f450c-25ab-4af8-9737-839cc7f875e0 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:07.673007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 663/1322] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:10.855323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f38d73-7c0d-4a63-8b04-57e90a794e3e None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:10.855853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f38d73-7c0d-4a63-8b04-57e90a794e3e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:10.855946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f38d73-7c0d-4a63-8b04-57e90a794e3e None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:10.857250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 660/1323] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:10.862802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac850e99-b16c-4b4b-912a-d2c137e15c70 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:10.865990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac850e99-b16c-4b4b-912a-d2c137e15c70 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:10.865990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac850e99-b16c-4b4b-912a-d2c137e15c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:10.931737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-ac850e99-b16c-4b4b-912a-d2c137e15c70 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:10.933001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ac850e99-b16c-4b4b-912a-d2c137e15c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:11.034953 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 664/1324] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:11.070360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f38d73-7c0d-4a63-8b04-57e90a794e3e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:11.071957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a3f38d73-7c0d-4a63-8b04-57e90a794e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:11.091767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:11.177602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f38d73-7c0d-4a63-8b04-57e90a794e3e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:11.251645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ea43d-c695-42a6-b146-56910ea09c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:11.252299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ea43d-c695-42a6-b146-56910ea09c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:11.253079 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ea43d-c695-42a6-b146-56910ea09c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:11.253352 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ea43d-c695-42a6-b146-56910ea09c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:11.255056 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8e4ea43d-c695-42a6-b146-56910ea09c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:11.326742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:11.370481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ea43d-c695-42a6-b146-56910ea09c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:11.372255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ea43d-c695-42a6-b146-56910ea09c36 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:11.393490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 661/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:13.707630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520657a4-a84d-4740-a09d-2774b9aa52e9 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:13.708222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520657a4-a84d-4740-a09d-2774b9aa52e9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:13.708222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520657a4-a84d-4740-a09d-2774b9aa52e9 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:13.709566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 665/1326] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:13.714926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd835ba-5da4-40c2-a045-9d3808aeb8fe None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:13.715350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd835ba-5da4-40c2-a045-9d3808aeb8fe None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:13.715583 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd835ba-5da4-40c2-a045-9d3808aeb8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:13.781880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5dd835ba-5da4-40c2-a045-9d3808aeb8fe None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:13.783115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5dd835ba-5da4-40c2-a045-9d3808aeb8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:13.880370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 662/1327] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:13.915955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520657a4-a84d-4740-a09d-2774b9aa52e9 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:13.917552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-520657a4-a84d-4740-a09d-2774b9aa52e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:13.977947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:14.020623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520657a4-a84d-4740-a09d-2774b9aa52e9 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:14.092844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdfd75-199d-4f62-9d30-75489f2d2c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:14.093487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdfd75-199d-4f62-9d30-75489f2d2c78 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:14.093770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdfd75-199d-4f62-9d30-75489f2d2c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:14.094037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdfd75-199d-4f62-9d30-75489f2d2c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:14.095734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-80cdfd75-199d-4f62-9d30-75489f2d2c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:14.207504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:14.209763 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdfd75-199d-4f62-9d30-75489f2d2c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:14.211225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdfd75-199d-4f62-9d30-75489f2d2c78 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:14.237624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 666/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:16.531239 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21307e2d-057d-457a-b9cd-b152e5e4d533 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:16.531764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21307e2d-057d-457a-b9cd-b152e5e4d533 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:16.531764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21307e2d-057d-457a-b9cd-b152e5e4d533 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:16.533297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 663/1329] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:16.538278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811824c-cd28-4cfd-82f6-42458ad8b726 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:16.538675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811824c-cd28-4cfd-82f6-42458ad8b726 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:16.538835 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811824c-cd28-4cfd-82f6-42458ad8b726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:16.603529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0811824c-cd28-4cfd-82f6-42458ad8b726 None None] MFA Rules not processed for user `a347ea4ea5a0424b8b080b3702d8ee75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:16.604709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0811824c-cd28-4cfd-82f6-42458ad8b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:16.699915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 667/1330] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:16.740491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21307e2d-057d-457a-b9cd-b152e5e4d533 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:16.742078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-21307e2d-057d-457a-b9cd-b152e5e4d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:16.773404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:16.849481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21307e2d-057d-457a-b9cd-b152e5e4d533 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:16.922491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493b46f-0ba8-415d-8689-208eff3ac46b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:16.923139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b46f-0ba8-415d-8689-208eff3ac46b service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:16.923417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b46f-0ba8-415d-8689-208eff3ac46b service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:16.923688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b46f-0ba8-415d-8689-208eff3ac46b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:16.925928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5493b46f-0ba8-415d-8689-208eff3ac46b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:17.002855 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:17.034294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493b46f-0ba8-415d-8689-208eff3ac46b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:17.035720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493b46f-0ba8-415d-8689-208eff3ac46b service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:17.053762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 664/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:19.686145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dae7d-5209-4d1c-bf6c-1e5ff607a3b4 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:19.686753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dae7d-5209-4d1c-bf6c-1e5ff607a3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:19.686753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dae7d-5209-4d1c-bf6c-1e5ff607a3b4 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:19.688105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 668/1332] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:19.694468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca8396-cfa0-4307-974e-ea0a57f29bcd None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:19.694924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca8396-cfa0-4307-974e-ea0a57f29bcd None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:19.695010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca8396-cfa0-4307-974e-ea0a57f29bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:19.760642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b1ca8396-cfa0-4307-974e-ea0a57f29bcd None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:19.761841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b1ca8396-cfa0-4307-974e-ea0a57f29bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:19.858336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 665/1333] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:19.894366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dae7d-5209-4d1c-bf6c-1e5ff607a3b4 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:19.895886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-647dae7d-5209-4d1c-bf6c-1e5ff607a3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:19.966091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:20.000348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dae7d-5209-4d1c-bf6c-1e5ff607a3b4 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:20.072741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026995f-aa7c-4b0e-a70b-2a788c0832dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:20.073385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026995f-aa7c-4b0e-a70b-2a788c0832dd service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:20.073667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026995f-aa7c-4b0e-a70b-2a788c0832dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:20.073941 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026995f-aa7c-4b0e-a70b-2a788c0832dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:20.075867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a026995f-aa7c-4b0e-a70b-2a788c0832dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:20.182115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026995f-aa7c-4b0e-a70b-2a788c0832dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:20.183567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026995f-aa7c-4b0e-a70b-2a788c0832dd service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:20.193802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:20.202559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 669/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:22.483764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c7955-c2ac-482d-b67a-1a315eeebec7 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:22.484295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c7955-c2ac-482d-b67a-1a315eeebec7 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:22.484383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c7955-c2ac-482d-b67a-1a315eeebec7 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:22.485690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 666/1335] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:22.491520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f39a1-ee02-446c-8e60-171a902906af None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:22.491917 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f39a1-ee02-446c-8e60-171a902906af None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:22.492070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f39a1-ee02-446c-8e60-171a902906af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:22.555572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-fc8f39a1-ee02-446c-8e60-171a902906af None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:22.556741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fc8f39a1-ee02-446c-8e60-171a902906af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:22.650699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 670/1336] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:22.690029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c7955-c2ac-482d-b67a-1a315eeebec7 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:22.691603 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-006c7955-c2ac-482d-b67a-1a315eeebec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:22.745038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:22.938332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c7955-c2ac-482d-b67a-1a315eeebec7 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:23.011817 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71cc2e-6dd5-4dde-99ba-fbcc895a210b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:23.012403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71cc2e-6dd5-4dde-99ba-fbcc895a210b service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:23.012680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71cc2e-6dd5-4dde-99ba-fbcc895a210b service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:23.012947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71cc2e-6dd5-4dde-99ba-fbcc895a210b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:23.014644 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-bc71cc2e-6dd5-4dde-99ba-fbcc895a210b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:23.093827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:23.119781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71cc2e-6dd5-4dde-99ba-fbcc895a210b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:23.121194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71cc2e-6dd5-4dde-99ba-fbcc895a210b service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:23.139165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 667/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:25.939144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9203-66ac-419a-9561-653f87a57235 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:25.940190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9203-66ac-419a-9561-653f87a57235 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:25.940190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9203-66ac-419a-9561-653f87a57235 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:25.941579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 671/1338] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:25.946961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b4d2a-c2a6-4943-a7c9-2d3cca3f04ee None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:25.947347 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b4d2a-c2a6-4943-a7c9-2d3cca3f04ee None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:25.947514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b4d2a-c2a6-4943-a7c9-2d3cca3f04ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:26.010143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-259b4d2a-c2a6-4943-a7c9-2d3cca3f04ee None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:26.011347 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-259b4d2a-c2a6-4943-a7c9-2d3cca3f04ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:26.104411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 668/1339] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:26.139744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d9203-66ac-419a-9561-653f87a57235 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:26.141296 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a00d9203-66ac-419a-9561-653f87a57235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:26.215710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:26.241989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d9203-66ac-419a-9561-653f87a57235 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:26.313629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57271b-8298-4267-ae41-3f3f90f19b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:26.314289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57271b-8298-4267-ae41-3f3f90f19b66 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:26.315109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57271b-8298-4267-ae41-3f3f90f19b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:26.315382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57271b-8298-4267-ae41-3f3f90f19b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:26.317005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fe57271b-8298-4267-ae41-3f3f90f19b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:26.429976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57271b-8298-4267-ae41-3f3f90f19b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:26.431424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57271b-8298-4267-ae41-3f3f90f19b66 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:26.450037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 672/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:30.927732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062f1b-b99a-43b0-af7a-03843693952a None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:30.928285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062f1b-b99a-43b0-af7a-03843693952a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:30.928285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062f1b-b99a-43b0-af7a-03843693952a None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:30.929638 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 669/1341] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:30.934964 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d405f-7a6e-4f9c-bb37-80dc125aba5a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:30.935351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d405f-7a6e-4f9c-bb37-80dc125aba5a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:30.935527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d405f-7a6e-4f9c-bb37-80dc125aba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:30.942108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:31.006035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-8a2d405f-7a6e-4f9c-bb37-80dc125aba5a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:31.007223 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8a2d405f-7a6e-4f9c-bb37-80dc125aba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:31.110137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 673/1342] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:31.148955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0062f1b-b99a-43b0-af7a-03843693952a None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:31.151079 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d0062f1b-b99a-43b0-af7a-03843693952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:31.200922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:31.247853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0062f1b-b99a-43b0-af7a-03843693952a None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:31.251457 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119c31b-57bf-47cc-bbd5-eb1b1dde1c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:31.252137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119c31b-57bf-47cc-bbd5-eb1b1dde1c54 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:31.252417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119c31b-57bf-47cc-bbd5-eb1b1dde1c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:31.252689 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119c31b-57bf-47cc-bbd5-eb1b1dde1c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:31.261788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119c31b-57bf-47cc-bbd5-eb1b1dde1c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:31.263239 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119c31b-57bf-47cc-bbd5-eb1b1dde1c54 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:31.272622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 670/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:34.446718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1671-ec40-46a2-a1c6-7cbca1a87486 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:34.447230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1671-ec40-46a2-a1c6-7cbca1a87486 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:34.447230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1671-ec40-46a2-a1c6-7cbca1a87486 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:34.448551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 674/1344] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:34.453922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd086f-2dc0-4b4e-9990-4fdf3437588e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:34.454323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd086f-2dc0-4b4e-9990-4fdf3437588e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:34.454507 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd086f-2dc0-4b4e-9990-4fdf3437588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:34.482016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c6dd086f-2dc0-4b4e-9990-4fdf3437588e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:34.483240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c6dd086f-2dc0-4b4e-9990-4fdf3437588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:34.558763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 671/1345] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:34.596537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa1671-ec40-46a2-a1c6-7cbca1a87486 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:34.598280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d2fa1671-ec40-46a2-a1c6-7cbca1a87486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:34.611737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa1671-ec40-46a2-a1c6-7cbca1a87486 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:34.615289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba48d6-4b89-403f-b049-e5dd8116a348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:34.615918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba48d6-4b89-403f-b049-e5dd8116a348 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:34.616197 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba48d6-4b89-403f-b049-e5dd8116a348 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:34.616471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba48d6-4b89-403f-b049-e5dd8116a348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:34.625727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba48d6-4b89-403f-b049-e5dd8116a348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:34.627215 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba48d6-4b89-403f-b049-e5dd8116a348 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:34.637707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 675/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:39.392446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d298b5-30ce-4dc2-8f2f-220c90bca192 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:39.393025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d298b5-30ce-4dc2-8f2f-220c90bca192 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:39.393025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d298b5-30ce-4dc2-8f2f-220c90bca192 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:39.394630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 672/1347] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:39.399771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2d6eb-57a2-4e8e-b7c1-eccd1343356d None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:39.400159 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2d6eb-57a2-4e8e-b7c1-eccd1343356d None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:39.400444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2d6eb-57a2-4e8e-b7c1-eccd1343356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:39.418782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-58d2d6eb-57a2-4e8e-b7c1-eccd1343356d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:39.419961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-58d2d6eb-57a2-4e8e-b7c1-eccd1343356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:39.427767 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 676/1348] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:39.466787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d298b5-30ce-4dc2-8f2f-220c90bca192 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:39.477478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d298b5-30ce-4dc2-8f2f-220c90bca192 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:39.481088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6b871-3c5b-4f57-b2a9-e43195a38390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:39.481857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6b871-3c5b-4f57-b2a9-e43195a38390 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:39.482204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6b871-3c5b-4f57-b2a9-e43195a38390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:39.482629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6b871-3c5b-4f57-b2a9-e43195a38390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:39.491770 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6b871-3c5b-4f57-b2a9-e43195a38390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:39.493252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6b871-3c5b-4f57-b2a9-e43195a38390 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:39.503206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 673/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:44.817364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007a520-18d4-4aa7-92da-bc2ce51c4b9f None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:44.817916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007a520-18d4-4aa7-92da-bc2ce51c4b9f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:44.818222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007a520-18d4-4aa7-92da-bc2ce51c4b9f None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:44.824062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 677/1350] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:38:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:44.838611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb137ec-f3fa-43b4-a877-0806a8546417 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:44.847543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb137ec-f3fa-43b4-a877-0806a8546417 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:44.847543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb137ec-f3fa-43b4-a877-0806a8546417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:44.999327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-0fb137ec-f3fa-43b4-a877-0806a8546417 None None] MFA Rules not processed for user `b1e0226354d14b9b9c4184063b2df9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:45.001057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0fb137ec-f3fa-43b4-a877-0806a8546417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:45.072020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:45.230254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 674/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:38:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:49.272147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711939-2e7b-4636-a548-527f607f7c52 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:49.273038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711939-2e7b-4636-a548-527f607f7c52 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:49.273315 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711939-2e7b-4636-a548-527f607f7c52 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:49.274899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 678/1352] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:49.279838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf90a1-d40a-49e3-b3dc-aaa10d89b144 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:49.280277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf90a1-d40a-49e3-b3dc-aaa10d89b144 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:49.280385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf90a1-d40a-49e3-b3dc-aaa10d89b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:49.300326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-71bf90a1-d40a-49e3-b3dc-aaa10d89b144 None None] MFA Rules not processed for user `b1e0226354d14b9b9c4184063b2df9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:49.301743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-71bf90a1-d40a-49e3-b3dc-aaa10d89b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:49.310422 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 675/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:38:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:49.413638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=72 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:38:50.991398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ed4a-9141-4726-8be2-2c01cb11b9ce None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:50.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ed4a-9141-4726-8be2-2c01cb11b9ce None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:50.992088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ed4a-9141-4726-8be2-2c01cb11b9ce None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:50.993434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 679/1354] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:50.999431 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cf462-3284-4f63-871e-4bc68c24cf83 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:51.000052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cf462-3284-4f63-871e-4bc68c24cf83 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:51.000052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cf462-3284-4f63-871e-4bc68c24cf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:51.019876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-914cf462-3284-4f63-871e-4bc68c24cf83 None None] MFA Rules not processed for user `b1e0226354d14b9b9c4184063b2df9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:51.021105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-914cf462-3284-4f63-871e-4bc68c24cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:51.029829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 676/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:38:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:54.808174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f575ee-e22d-4a38-9ef8-67ea74f962bf None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:54.808614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f575ee-e22d-4a38-9ef8-67ea74f962bf None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:54.809095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f575ee-e22d-4a38-9ef8-67ea74f962bf None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:54.810760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 680/1356] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:54.816756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40f827-6510-4c7a-bd4e-6cf7fd6023af None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:54.817169 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40f827-6510-4c7a-bd4e-6cf7fd6023af None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:54.817308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40f827-6510-4c7a-bd4e-6cf7fd6023af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:54.837365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-dd40f827-6510-4c7a-bd4e-6cf7fd6023af None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:54.838772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-dd40f827-6510-4c7a-bd4e-6cf7fd6023af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:54.846755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 677/1357] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:54.910482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ad7a-a762-40b1-a164-0e3fd4bbb48d None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:54.910811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ad7a-a762-40b1-a164-0e3fd4bbb48d None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:54.911461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ad7a-a762-40b1-a164-0e3fd4bbb48d None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:54.913033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 681/1358] 10.222.0.40 () {54 vars in 961 bytes} [Wed Jun 8 06:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:54.924773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbee7a-fedd-4950-b367-a13b95a10807 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:54.926203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbee7a-fedd-4950-b367-a13b95a10807 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:54.927430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbee7a-fedd-4950-b367-a13b95a10807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:54.980487 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-60dbee7a-fedd-4950-b367-a13b95a10807 None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:54.982675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-60dbee7a-fedd-4950-b367-a13b95a10807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:55.076043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 678/1359] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Jun 8 06:38:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:38:55.084028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ad7a-a762-40b1-a164-0e3fd4bbb48d None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:55.100866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ad7a-a762-40b1-a164-0e3fd4bbb48d None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:55.106537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9773126-617f-4a70-8a4e-7f61df94c894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:55.107280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9773126-617f-4a70-8a4e-7f61df94c894 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:55.107633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9773126-617f-4a70-8a4e-7f61df94c894 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:55.108164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9773126-617f-4a70-8a4e-7f61df94c894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:55.117316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9773126-617f-4a70-8a4e-7f61df94c894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:55.119009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9773126-617f-4a70-8a4e-7f61df94c894 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:55.133045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 682/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:38:57.595667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd202f74-81e1-46b8-ba42-73e761b59833 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:57.596215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd202f74-81e1-46b8-ba42-73e761b59833 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:57.596215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd202f74-81e1-46b8-ba42-73e761b59833 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:57.597816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 679/1361] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:38:57.603062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47508e-6cfd-4c6d-b70d-9c5ffc147909 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:57.603487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47508e-6cfd-4c6d-b70d-9c5ffc147909 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:57.603655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47508e-6cfd-4c6d-b70d-9c5ffc147909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:57.623070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-7c47508e-6cfd-4c6d-b70d-9c5ffc147909 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:38:57.624383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-7c47508e-6cfd-4c6d-b70d-9c5ffc147909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:38:57.632287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 683/1362] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:38:57.677180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd202f74-81e1-46b8-ba42-73e761b59833 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:38:57.691672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd202f74-81e1-46b8-ba42-73e761b59833 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:38:57.697402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e7f98-c9b4-454c-9c5a-0abf89a72682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:38:57.698045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e7f98-c9b4-454c-9c5a-0abf89a72682 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:38:57.698361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e7f98-c9b4-454c-9c5a-0abf89a72682 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:38:57.698640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e7f98-c9b4-454c-9c5a-0abf89a72682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:38:57.707557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e7f98-c9b4-454c-9c5a-0abf89a72682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:38:57.709119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e7f98-c9b4-454c-9c5a-0abf89a72682 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:38:57.719151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 680/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:00.457934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a07f-c0d9-4ec2-ad65-60001f8a037e None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:00.458803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a07f-c0d9-4ec2-ad65-60001f8a037e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:00.459084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a07f-c0d9-4ec2-ad65-60001f8a037e None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:00.460517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 684/1364] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:00.466076 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85ed34-3ebf-4f90-b169-a4a463d8b5c9 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:00.466559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85ed34-3ebf-4f90-b169-a4a463d8b5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:00.466654 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85ed34-3ebf-4f90-b169-a4a463d8b5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:00.486630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5b85ed34-3ebf-4f90-b169-a4a463d8b5c9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:00.487811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5b85ed34-3ebf-4f90-b169-a4a463d8b5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:00.496036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 681/1365] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:00.541518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daeead-4244-4ce6-954e-381e97fcb71f None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:00.541949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daeead-4244-4ce6-954e-381e97fcb71f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:00.542370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daeead-4244-4ce6-954e-381e97fcb71f None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:00.543833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 685/1366] 10.222.0.40 () {54 vars in 961 bytes} [Wed Jun 8 06:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:00.549853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db230dc-4cc2-4b48-bb75-53b61264bb90 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:00.550214 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db230dc-4cc2-4b48-bb75-53b61264bb90 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:00.550543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db230dc-4cc2-4b48-bb75-53b61264bb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:00.568239 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-1db230dc-4cc2-4b48-bb75-53b61264bb90 None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:00.569442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1db230dc-4cc2-4b48-bb75-53b61264bb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:00.578991 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 682/1367] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Jun 8 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:00.586896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89daeead-4244-4ce6-954e-381e97fcb71f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:00.602260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89daeead-4244-4ce6-954e-381e97fcb71f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:00.607897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2048bcd-b5e1-4702-8628-cdb01ef10b63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:00.608528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2048bcd-b5e1-4702-8628-cdb01ef10b63 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:00.608809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2048bcd-b5e1-4702-8628-cdb01ef10b63 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:00.609082 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2048bcd-b5e1-4702-8628-cdb01ef10b63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:00.618067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2048bcd-b5e1-4702-8628-cdb01ef10b63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:00.619663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2048bcd-b5e1-4702-8628-cdb01ef10b63 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:00.628894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 686/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:03.162071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63528-d0cb-4fd8-a522-be6fd8ed3154 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:03.162637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63528-d0cb-4fd8-a522-be6fd8ed3154 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:03.162637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63528-d0cb-4fd8-a522-be6fd8ed3154 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:03.164001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 683/1369] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:03.169390 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441c78f-a6e6-4493-b246-ab5f7147676e None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:03.169802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441c78f-a6e6-4493-b246-ab5f7147676e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:03.169946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441c78f-a6e6-4493-b246-ab5f7147676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:03.188954 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c441c78f-a6e6-4493-b246-ab5f7147676e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:03.190319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c441c78f-a6e6-4493-b246-ab5f7147676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:03.195040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298cac-6a51-4270-9ff3-e166d0ce00c3 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:03.195326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298cac-6a51-4270-9ff3-e166d0ce00c3 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:03.195602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298cac-6a51-4270-9ff3-e166d0ce00c3 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:03.196985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 684/1370] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:39:03.202283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 687/1371] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:03.202414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914028-91cc-48ed-8566-997e00289816 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:03.202574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914028-91cc-48ed-8566-997e00289816 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:03.203063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914028-91cc-48ed-8566-997e00289816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:03.222885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-d4914028-91cc-48ed-8566-997e00289816 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:03.224623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d4914028-91cc-48ed-8566-997e00289816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:03.234171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 685/1372] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:03.244641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441c78f-a6e6-4493-b246-ab5f7147676e None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:03.258029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441c78f-a6e6-4493-b246-ab5f7147676e None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:03.263349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240728a1-2b10-4302-b648-f73801867778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:03.263995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240728a1-2b10-4302-b648-f73801867778 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:03.264272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240728a1-2b10-4302-b648-f73801867778 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:03.264540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240728a1-2b10-4302-b648-f73801867778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:03.273933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240728a1-2b10-4302-b648-f73801867778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:03.275731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240728a1-2b10-4302-b648-f73801867778 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:03.286273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 688/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:39:03.554435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1859-9f2b-499c-97fb-cb5dfe010826 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:03.554772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1859-9f2b-499c-97fb-cb5dfe010826 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:03.555114 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1859-9f2b-499c-97fb-cb5dfe010826 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:03.556540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 686/1374] 10.222.0.40 () {54 vars in 963 bytes} [Wed Jun 8 06:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:03.562086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b2560-1088-4dcb-a7a6-20c5c4b0e53b None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:03.562502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b2560-1088-4dcb-a7a6-20c5c4b0e53b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:03.563334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b2560-1088-4dcb-a7a6-20c5c4b0e53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:03.620073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-f20b2560-1088-4dcb-a7a6-20c5c4b0e53b None None] MFA Rules not processed for user `8c060a0a42824aa589135ea357165268`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:03.621309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f20b2560-1088-4dcb-a7a6-20c5c4b0e53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:03.692606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 689/1375] 10.222.0.40 () {58 vars in 1060 bytes} [Wed Jun 8 06:39:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:03.700076 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1859-9f2b-499c-97fb-cb5dfe010826 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:03.712469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1859-9f2b-499c-97fb-cb5dfe010826 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:03.716513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ac526-d050-497e-958a-d952736b8160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:03.717100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ac526-d050-497e-958a-d952736b8160 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:03.717572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ac526-d050-497e-958a-d952736b8160 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:03.717863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ac526-d050-497e-958a-d952736b8160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:03.729455 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ac526-d050-497e-958a-d952736b8160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:03.730943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ac526-d050-497e-958a-d952736b8160 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:03.741152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 687/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:05.731375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76fda5-6d32-47d7-a9af-7beb8f211a44 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:05.731906 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76fda5-6d32-47d7-a9af-7beb8f211a44 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:05.731906 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76fda5-6d32-47d7-a9af-7beb8f211a44 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:05.733272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 690/1377] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:05.740014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0945d-b88e-4cec-8ae6-bafc9aaf8119 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:05.740568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0945d-b88e-4cec-8ae6-bafc9aaf8119 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:05.740568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0945d-b88e-4cec-8ae6-bafc9aaf8119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:05.748298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:39:05.759400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-88e0945d-b88e-4cec-8ae6-bafc9aaf8119 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:05.760753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-88e0945d-b88e-4cec-8ae6-bafc9aaf8119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:05.768947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 688/1378] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:05.814538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76fda5-6d32-47d7-a9af-7beb8f211a44 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:05.829701 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76fda5-6d32-47d7-a9af-7beb8f211a44 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:05.835339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f1c3f-2bbf-4c09-a2e6-df8336411987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:05.836011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f1c3f-2bbf-4c09-a2e6-df8336411987 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:05.836298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f1c3f-2bbf-4c09-a2e6-df8336411987 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:05.836576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f1c3f-2bbf-4c09-a2e6-df8336411987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:05.846284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f1c3f-2bbf-4c09-a2e6-df8336411987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:05.847943 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f1c3f-2bbf-4c09-a2e6-df8336411987 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:05.858497 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 691/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:08.260496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec59d9-d057-4aed-b880-bd1151b1cdc0 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:08.261027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec59d9-d057-4aed-b880-bd1151b1cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:08.261149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec59d9-d057-4aed-b880-bd1151b1cdc0 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:08.262965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 689/1380] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:08.268860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3465f6-bc80-4b41-a8b6-5cb94f5a85ff None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:08.269612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3465f6-bc80-4b41-a8b6-5cb94f5a85ff None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:08.270073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3465f6-bc80-4b41-a8b6-5cb94f5a85ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:08.289265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-ff3465f6-bc80-4b41-a8b6-5cb94f5a85ff None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:08.290768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ff3465f6-bc80-4b41-a8b6-5cb94f5a85ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:08.314907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 692/1381] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:39:08.344073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec59d9-d057-4aed-b880-bd1151b1cdc0 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:08.359201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec59d9-d057-4aed-b880-bd1151b1cdc0 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:08.365550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041d83a-8f12-4b02-ac48-36cd16908784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:08.366530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041d83a-8f12-4b02-ac48-36cd16908784 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:08.366996 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041d83a-8f12-4b02-ac48-36cd16908784 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:08.367421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041d83a-8f12-4b02-ac48-36cd16908784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:08.378264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041d83a-8f12-4b02-ac48-36cd16908784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:08.380026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041d83a-8f12-4b02-ac48-36cd16908784 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:08.390191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 690/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:10.810228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c0fcb-e497-4beb-b02a-da32c4ad9656 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:10.811273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c0fcb-e497-4beb-b02a-da32c4ad9656 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:10.811785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c0fcb-e497-4beb-b02a-da32c4ad9656 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:10.817450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 693/1383] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:10.818924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371255f-6c58-4ad3-8c7c-27e7ce4654cf None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:10.819336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371255f-6c58-4ad3-8c7c-27e7ce4654cf None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:10.819564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371255f-6c58-4ad3-8c7c-27e7ce4654cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:10.838839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-3371255f-6c58-4ad3-8c7c-27e7ce4654cf None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:10.840137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3371255f-6c58-4ad3-8c7c-27e7ce4654cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:10.849275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 691/1384] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:10.891215 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c0fcb-e497-4beb-b02a-da32c4ad9656 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:10.907414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c0fcb-e497-4beb-b02a-da32c4ad9656 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:10.912818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dc77d-adb5-432c-b058-7410b61942fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:10.913452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dc77d-adb5-432c-b058-7410b61942fe service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:10.913727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dc77d-adb5-432c-b058-7410b61942fe service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:10.914169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dc77d-adb5-432c-b058-7410b61942fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:10.923068 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dc77d-adb5-432c-b058-7410b61942fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:10.924632 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dc77d-adb5-432c-b058-7410b61942fe service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:10.934190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 694/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:13.494600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c1927-dd99-4e51-ae0c-a4e755866268 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:13.495139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c1927-dd99-4e51-ae0c-a4e755866268 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:13.495250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c1927-dd99-4e51-ae0c-a4e755866268 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:13.496981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 692/1386] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:13.503468 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8faeb1-60d9-4a04-9d19-5cc24e1ec33f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:13.503877 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8faeb1-60d9-4a04-9d19-5cc24e1ec33f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:13.504037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8faeb1-60d9-4a04-9d19-5cc24e1ec33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:13.522221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-fa8faeb1-60d9-4a04-9d19-5cc24e1ec33f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:13.523424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fa8faeb1-60d9-4a04-9d19-5cc24e1ec33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:13.532073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 695/1387] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:13.576555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c1927-dd99-4e51-ae0c-a4e755866268 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:13.592024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c1927-dd99-4e51-ae0c-a4e755866268 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:13.597597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b083806-5c93-4b8f-9a75-710bcc848111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:13.598254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083806-5c93-4b8f-9a75-710bcc848111 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:13.598552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083806-5c93-4b8f-9a75-710bcc848111 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:13.598847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083806-5c93-4b8f-9a75-710bcc848111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:13.607034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b083806-5c93-4b8f-9a75-710bcc848111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:13.608656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b083806-5c93-4b8f-9a75-710bcc848111 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:13.618973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 693/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:16.613790 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26952d4b-d970-4243-b126-12929c8c6760 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:16.614409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26952d4b-d970-4243-b126-12929c8c6760 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:16.614580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26952d4b-d970-4243-b126-12929c8c6760 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:16.616382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 696/1389] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:16.622853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec799e-bf24-423e-bef8-ad3966a731bd None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:16.623295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec799e-bf24-423e-bef8-ad3966a731bd None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:16.623397 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec799e-bf24-423e-bef8-ad3966a731bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:16.641765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-1dec799e-bf24-423e-bef8-ad3966a731bd None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:16.642998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1dec799e-bf24-423e-bef8-ad3966a731bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:16.650903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 694/1390] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:16.695567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26952d4b-d970-4243-b126-12929c8c6760 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:16.710497 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26952d4b-d970-4243-b126-12929c8c6760 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:16.715972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870c109-728f-4fa0-8f3c-7bca114b3c63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:16.716610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c109-728f-4fa0-8f3c-7bca114b3c63 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:16.716902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c109-728f-4fa0-8f3c-7bca114b3c63 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:16.717178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c109-728f-4fa0-8f3c-7bca114b3c63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:16.725400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870c109-728f-4fa0-8f3c-7bca114b3c63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:16.727023 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870c109-728f-4fa0-8f3c-7bca114b3c63 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:16.737140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 697/1391] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:19.187970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbf7f0-38a2-41a7-992d-229d280f9b29 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:19.188595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbf7f0-38a2-41a7-992d-229d280f9b29 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:19.188595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbf7f0-38a2-41a7-992d-229d280f9b29 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:19.189882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 695/1392] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:19.195403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a41c13-0a2e-4d8c-8999-0181e222210a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:19.195855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a41c13-0a2e-4d8c-8999-0181e222210a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:19.195965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a41c13-0a2e-4d8c-8999-0181e222210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:19.214103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-32a41c13-0a2e-4d8c-8999-0181e222210a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:19.215295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-32a41c13-0a2e-4d8c-8999-0181e222210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:19.222984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 698/1393] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:19.268799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbf7f0-38a2-41a7-992d-229d280f9b29 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:19.283070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbf7f0-38a2-41a7-992d-229d280f9b29 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:19.288356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926f6f3-17da-4d3f-a7fb-6e86f3db2525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:19.288989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926f6f3-17da-4d3f-a7fb-6e86f3db2525 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:19.289255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926f6f3-17da-4d3f-a7fb-6e86f3db2525 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:19.289524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926f6f3-17da-4d3f-a7fb-6e86f3db2525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:19.297405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926f6f3-17da-4d3f-a7fb-6e86f3db2525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:19.298987 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926f6f3-17da-4d3f-a7fb-6e86f3db2525 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:19.308146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 696/1394] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:19.935894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf9470-8abb-4ea8-902c-263911aa87b9 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:19.936183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf9470-8abb-4ea8-902c-263911aa87b9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:19.936463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf9470-8abb-4ea8-902c-263911aa87b9 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:19.938382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 699/1395] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:19.943684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c5c7e-3292-4361-9b26-3107f0fcf9b9 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:19.944046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c5c7e-3292-4361-9b26-3107f0fcf9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:19.944331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c5c7e-3292-4361-9b26-3107f0fcf9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:19.963055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-713c5c7e-3292-4361-9b26-3107f0fcf9b9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:19.964258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-713c5c7e-3292-4361-9b26-3107f0fcf9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:19.972244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 697/1396] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:20.028566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a4341-c53c-4026-b14c-4a70f6c9a3e2 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:20.028883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a4341-c53c-4026-b14c-4a70f6c9a3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:20.029163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a4341-c53c-4026-b14c-4a70f6c9a3e2 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:20.030591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 700/1397] 10.222.0.40 () {54 vars in 962 bytes} [Wed Jun 8 06:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:20.035865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a97f8-79ec-4054-999d-2907b49e9cb3 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:20.036159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a97f8-79ec-4054-999d-2907b49e9cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:20.036437 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a97f8-79ec-4054-999d-2907b49e9cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:20.085275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9f1a97f8-79ec-4054-999d-2907b49e9cb3 None None] MFA Rules not processed for user `5498a6912a08408d9ea30920faceee7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:20.086492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9f1a97f8-79ec-4054-999d-2907b49e9cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:20.152807 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 698/1398] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Jun 8 06:39:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:20.160336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a4341-c53c-4026-b14c-4a70f6c9a3e2 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:20.165602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=90 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:39:20.171499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a4341-c53c-4026-b14c-4a70f6c9a3e2 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:20.175068 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d3791-ed5a-4125-9adf-f7ed2655318e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5498a6912a08408d9ea30920faceee7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:20.178736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d3791-ed5a-4125-9adf-f7ed2655318e service glance] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:20.178736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d3791-ed5a-4125-9adf-f7ed2655318e service glance] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:20.178736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d3791-ed5a-4125-9adf-f7ed2655318e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:20.185239 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d3791-ed5a-4125-9adf-f7ed2655318e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:20.186821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d3791-ed5a-4125-9adf-f7ed2655318e service glance] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:20.197553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 701/1399] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:20.841776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090c9bd-cad2-4385-bdf2-e5b78a30388a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:20.842229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090c9bd-cad2-4385-bdf2-e5b78a30388a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:20.842852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090c9bd-cad2-4385-bdf2-e5b78a30388a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:20.892400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-d090c9bd-cad2-4385-bdf2-e5b78a30388a None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:20.893595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d090c9bd-cad2-4385-bdf2-e5b78a30388a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:20.939370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:39:20.958795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 699/1400] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:39:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:21.000570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546400d-f424-4c60-879e-48c0addb3344 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:21.000860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546400d-f424-4c60-879e-48c0addb3344 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:21.001323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546400d-f424-4c60-879e-48c0addb3344 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:21.002745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 702/1401] 10.222.0.40 () {54 vars in 942 bytes} [Wed Jun 8 06:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:21.009041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810a28-ed9a-43e0-a501-87f05e96e39a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:21.011434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810a28-ed9a-43e0-a501-87f05e96e39a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:21.011434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810a28-ed9a-43e0-a501-87f05e96e39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:21.057762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-2a810a28-ed9a-43e0-a501-87f05e96e39a None None] MFA Rules not processed for user `2130fd9eb8464e95a4fb24083c36427a`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:21.059000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2a810a28-ed9a-43e0-a501-87f05e96e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:21.135147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 700/1402] 10.222.0.40 () {58 vars in 1039 bytes} [Wed Jun 8 06:39:21 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:39:21.144528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546400d-f424-4c60-879e-48c0addb3344 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:21.159213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546400d-f424-4c60-879e-48c0addb3344 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:21.164151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a96636-f407-47a1-9de5-50b8e4a68bde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:21.164794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96636-f407-47a1-9de5-50b8e4a68bde service swift] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:21.165082 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96636-f407-47a1-9de5-50b8e4a68bde service swift] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:21.165363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96636-f407-47a1-9de5-50b8e4a68bde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:21.174318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a96636-f407-47a1-9de5-50b8e4a68bde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:21.176030 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a96636-f407-47a1-9de5-50b8e4a68bde service swift] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:21.184736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 703/1403] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:39:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:39:21.738551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568bac2-00a6-429c-9d33-995d44955658 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:21.738839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568bac2-00a6-429c-9d33-995d44955658 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:21.739112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568bac2-00a6-429c-9d33-995d44955658 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:21.740474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 701/1404] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:21.745657 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b166fe-b170-41ac-b03b-18961b7abafc None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:21.746147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b166fe-b170-41ac-b03b-18961b7abafc None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:21.746344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b166fe-b170-41ac-b03b-18961b7abafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:21.764259 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-85b166fe-b170-41ac-b03b-18961b7abafc None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:21.765968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-85b166fe-b170-41ac-b03b-18961b7abafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:21.773934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 704/1405] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:21.816807 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568bac2-00a6-429c-9d33-995d44955658 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:21.831933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568bac2-00a6-429c-9d33-995d44955658 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:21.838200 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f49681-809e-409b-9092-3fd70d437c85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:21.838982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f49681-809e-409b-9092-3fd70d437c85 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:21.839376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f49681-809e-409b-9092-3fd70d437c85 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:21.839709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f49681-809e-409b-9092-3fd70d437c85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:21.850821 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f49681-809e-409b-9092-3fd70d437c85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:21.852205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f49681-809e-409b-9092-3fd70d437c85 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:21.862089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 702/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:24.372344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a9b8b-f27f-42a3-8756-94c956b820e4 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:24.372881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a9b8b-f27f-42a3-8756-94c956b820e4 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:24.372881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a9b8b-f27f-42a3-8756-94c956b820e4 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:24.374273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 705/1407] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:24.380082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed25c5-4448-49f2-af16-33db7e1aa658 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:24.380506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed25c5-4448-49f2-af16-33db7e1aa658 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:24.380634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed25c5-4448-49f2-af16-33db7e1aa658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:24.402593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-38ed25c5-4448-49f2-af16-33db7e1aa658 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:24.403711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-38ed25c5-4448-49f2-af16-33db7e1aa658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:24.412909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 703/1408] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:39:24.459224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a9b8b-f27f-42a3-8756-94c956b820e4 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:24.475375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a9b8b-f27f-42a3-8756-94c956b820e4 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:24.481184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c564ac9-8abc-4806-8aad-78e486bf30ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:24.481936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564ac9-8abc-4806-8aad-78e486bf30ca service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:24.482276 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564ac9-8abc-4806-8aad-78e486bf30ca service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:24.482561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564ac9-8abc-4806-8aad-78e486bf30ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:24.492732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c564ac9-8abc-4806-8aad-78e486bf30ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:24.494346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c564ac9-8abc-4806-8aad-78e486bf30ca service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:24.504237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 706/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:34.397091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=59 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:39:34.499772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=20 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:39:45.773925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51cdfb-c478-45cc-ba97-812e8f5d7ad8 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:45.774496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51cdfb-c478-45cc-ba97-812e8f5d7ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:45.774631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51cdfb-c478-45cc-ba97-812e8f5d7ad8 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:45.775890 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 704/1410] 10.222.0.40 () {54 vars in 918 bytes} [Wed Jun 8 06:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:45.781028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db873-0384-4a91-a6a3-1d934b7ea2c1 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:45.781435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db873-0384-4a91-a6a3-1d934b7ea2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:45.781584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db873-0384-4a91-a6a3-1d934b7ea2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:45.800637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-754db873-0384-4a91-a6a3-1d934b7ea2c1 None None] MFA Rules not processed for user `b1e0226354d14b9b9c4184063b2df9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:45.801824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-754db873-0384-4a91-a6a3-1d934b7ea2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:45.810144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 707/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jun 8 06:39:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:39:45.824625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfdac8-6284-4417-96a9-86b808e5120b None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:45.824916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfdac8-6284-4417-96a9-86b808e5120b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:45.825450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfdac8-6284-4417-96a9-86b808e5120b None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:45.826825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 705/1412] 10.222.0.40 () {54 vars in 918 bytes} [Wed Jun 8 06:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:45.831433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a158b47-3921-4f3a-ae6d-b70708fe2717 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:45.831723 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a158b47-3921-4f3a-ae6d-b70708fe2717 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:45.832003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a158b47-3921-4f3a-ae6d-b70708fe2717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:45.849287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-3a158b47-3921-4f3a-ae6d-b70708fe2717 None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:45.850505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3a158b47-3921-4f3a-ae6d-b70708fe2717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:45.859983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 708/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jun 8 06:39:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:39:48.552997 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc4e73-4d03-4286-a0cf-d25cafa6d426 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:48.553547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc4e73-4d03-4286-a0cf-d25cafa6d426 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:48.553547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc4e73-4d03-4286-a0cf-d25cafa6d426 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:48.554895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:48.560086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83ef8-d7df-4530-a558-b6d976d090ab None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:48.560517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83ef8-d7df-4530-a558-b6d976d090ab None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:48.560622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83ef8-d7df-4530-a558-b6d976d090ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:48.579512 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-81a83ef8-d7df-4530-a558-b6d976d090ab None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:48.580697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-81a83ef8-d7df-4530-a558-b6d976d090ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:48.588763 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:48.631413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc4e73-4d03-4286-a0cf-d25cafa6d426 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:48.646121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc4e73-4d03-4286-a0cf-d25cafa6d426 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:48.651450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bb246-ea3a-40f3-9071-c72ae67ee6a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:48.652189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bb246-ea3a-40f3-9071-c72ae67ee6a4 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:48.652476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bb246-ea3a-40f3-9071-c72ae67ee6a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:48.652751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bb246-ea3a-40f3-9071-c72ae67ee6a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:48.660870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bb246-ea3a-40f3-9071-c72ae67ee6a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:48.662488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bb246-ea3a-40f3-9071-c72ae67ee6a4 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:48.671693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 707/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:49.657058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d23c23-9c0b-4ce7-bf6f-d42dedb62279 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:49.657610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d23c23-9c0b-4ce7-bf6f-d42dedb62279 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:49.657610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d23c23-9c0b-4ce7-bf6f-d42dedb62279 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:49.659052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:49.663819 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755792c-d60f-4b39-94aa-f3aa22202ec1 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:49.664224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755792c-d60f-4b39-94aa-f3aa22202ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:49.664368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755792c-d60f-4b39-94aa-f3aa22202ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:49.681760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a755792c-d60f-4b39-94aa-f3aa22202ec1 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:49.683027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a755792c-d60f-4b39-94aa-f3aa22202ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:49.690579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:49.848555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d23c23-9c0b-4ce7-bf6f-d42dedb62279 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:49.862770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d23c23-9c0b-4ce7-bf6f-d42dedb62279 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:49.868114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41848558-b3bc-400e-8e51-da3a58c735da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:49.869703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41848558-b3bc-400e-8e51-da3a58c735da service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:49.869703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41848558-b3bc-400e-8e51-da3a58c735da service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:49.869703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41848558-b3bc-400e-8e51-da3a58c735da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:49.877776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41848558-b3bc-400e-8e51-da3a58c735da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:49.879376 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41848558-b3bc-400e-8e51-da3a58c735da service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:49.888819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 711/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:50.806648 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f1090-1361-437a-9fd1-c5c37e1b692c None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:50.807198 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f1090-1361-437a-9fd1-c5c37e1b692c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:50.807198 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f1090-1361-437a-9fd1-c5c37e1b692c None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:50.808549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:50.813589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddd374-876d-47a7-ad85-b5fb609908cf None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:50.814003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddd374-876d-47a7-ad85-b5fb609908cf None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:50.814156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddd374-876d-47a7-ad85-b5fb609908cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:50.833096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-87ddd374-876d-47a7-ad85-b5fb609908cf None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:50.836419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-87ddd374-876d-47a7-ad85-b5fb609908cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:50.842050 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:50.996710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f1090-1361-437a-9fd1-c5c37e1b692c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:51.010771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f1090-1361-437a-9fd1-c5c37e1b692c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:51.016715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d96f9e-f4c9-48ef-940b-d92383ad8db6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:51.018059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d96f9e-f4c9-48ef-940b-d92383ad8db6 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:51.018059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d96f9e-f4c9-48ef-940b-d92383ad8db6 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:51.018059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d96f9e-f4c9-48ef-940b-d92383ad8db6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:51.025936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d96f9e-f4c9-48ef-940b-d92383ad8db6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:51.027549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d96f9e-f4c9-48ef-940b-d92383ad8db6 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:51.037460 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 710/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:51.976851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd606462-51bb-4119-89ac-8fcada4ce949 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:51.977472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd606462-51bb-4119-89ac-8fcada4ce949 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:51.977472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd606462-51bb-4119-89ac-8fcada4ce949 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:51.978831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:51.984250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb534-6257-4e47-b85b-943d749e51cb None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:51.984683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb534-6257-4e47-b85b-943d749e51cb None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:51.984799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb534-6257-4e47-b85b-943d749e51cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:52.002939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-612cb534-6257-4e47-b85b-943d749e51cb None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:52.004117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-612cb534-6257-4e47-b85b-943d749e51cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:52.011744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:52.161165 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd606462-51bb-4119-89ac-8fcada4ce949 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:52.175842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd606462-51bb-4119-89ac-8fcada4ce949 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:52.181154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2454199-e224-4128-93ff-e41114f91ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:52.181778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454199-e224-4128-93ff-e41114f91ffd service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:52.182060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454199-e224-4128-93ff-e41114f91ffd service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:52.182372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454199-e224-4128-93ff-e41114f91ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:52.190350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2454199-e224-4128-93ff-e41114f91ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:52.191918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2454199-e224-4128-93ff-e41114f91ffd service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:52.201339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 714/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:53.098264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744f3b0-364d-4933-9885-8c3e4b08f232 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:53.098799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744f3b0-364d-4933-9885-8c3e4b08f232 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:53.098799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744f3b0-364d-4933-9885-8c3e4b08f232 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:53.100168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:53.105291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e6ba3-7985-4c15-9a60-9a0b577d4440 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:53.105665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e6ba3-7985-4c15-9a60-9a0b577d4440 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:53.105849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e6ba3-7985-4c15-9a60-9a0b577d4440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:53.124482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a85e6ba3-7985-4c15-9a60-9a0b577d4440 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:53.125597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a85e6ba3-7985-4c15-9a60-9a0b577d4440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:53.133457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:53.285082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744f3b0-364d-4933-9885-8c3e4b08f232 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:53.299178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744f3b0-364d-4933-9885-8c3e4b08f232 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:53.304450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325723c9-3ff4-4c99-8b78-1feee50983d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:53.310301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325723c9-3ff4-4c99-8b78-1feee50983d4 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:53.310301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325723c9-3ff4-4c99-8b78-1feee50983d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:53.310301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325723c9-3ff4-4c99-8b78-1feee50983d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:53.313746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325723c9-3ff4-4c99-8b78-1feee50983d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:53.315334 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325723c9-3ff4-4c99-8b78-1feee50983d4 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:53.324646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 713/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:54.241580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ef25-9dd7-4784-8877-c580350d2fd6 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:54.242127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ef25-9dd7-4784-8877-c580350d2fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:54.242256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ef25-9dd7-4784-8877-c580350d2fd6 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:54.243599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:54.248976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e305e5-54fc-40a0-8dbb-f787f53e3887 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:54.249358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e305e5-54fc-40a0-8dbb-f787f53e3887 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:54.249518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e305e5-54fc-40a0-8dbb-f787f53e3887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:54.267126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-95e305e5-54fc-40a0-8dbb-f787f53e3887 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:54.268300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-95e305e5-54fc-40a0-8dbb-f787f53e3887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:54.275888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:54.423424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001ef25-9dd7-4784-8877-c580350d2fd6 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:54.437390 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001ef25-9dd7-4784-8877-c580350d2fd6 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:54.442666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68fce6-3d96-433d-840d-a5938284ae56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:54.443293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fce6-3d96-433d-840d-a5938284ae56 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:54.443592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fce6-3d96-433d-840d-a5938284ae56 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:54.443846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fce6-3d96-433d-840d-a5938284ae56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:54.454910 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68fce6-3d96-433d-840d-a5938284ae56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:54.456479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68fce6-3d96-433d-840d-a5938284ae56 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:54.465765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 717/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:55.391715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff673cf1-289a-49a6-bdac-ee3709a47abe None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:55.392232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff673cf1-289a-49a6-bdac-ee3709a47abe None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:55.392232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff673cf1-289a-49a6-bdac-ee3709a47abe None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:55.393518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:39:55.398327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbca4-60de-4015-9b39-2b030a1f8c16 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:55.398752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbca4-60de-4015-9b39-2b030a1f8c16 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:55.398878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbca4-60de-4015-9b39-2b030a1f8c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:55.416307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-9e8dbca4-60de-4015-9b39-2b030a1f8c16 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:55.417474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9e8dbca4-60de-4015-9b39-2b030a1f8c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:55.425079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:55.576351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff673cf1-289a-49a6-bdac-ee3709a47abe None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:55.590645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff673cf1-289a-49a6-bdac-ee3709a47abe None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:55.595998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b45f0-d9b6-4902-bf2b-a237311336d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:55.596627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b45f0-d9b6-4902-bf2b-a237311336d9 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:55.596907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b45f0-d9b6-4902-bf2b-a237311336d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:55.597183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b45f0-d9b6-4902-bf2b-a237311336d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:55.605305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b45f0-d9b6-4902-bf2b-a237311336d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:55.606919 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b45f0-d9b6-4902-bf2b-a237311336d9 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:55.617252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 716/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:56.522183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646ad1-eec4-4bcb-a726-9e6731fdbf4c None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:56.522783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646ad1-eec4-4bcb-a726-9e6731fdbf4c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:56.522783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646ad1-eec4-4bcb-a726-9e6731fdbf4c None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:56.524244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:56.530022 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cbc03-b35c-4f7c-a4b2-74891a0d767e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:56.534421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cbc03-b35c-4f7c-a4b2-74891a0d767e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:56.534421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cbc03-b35c-4f7c-a4b2-74891a0d767e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:56.548413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-fe4cbc03-b35c-4f7c-a4b2-74891a0d767e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:56.549597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-fe4cbc03-b35c-4f7c-a4b2-74891a0d767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:56.557423 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:56.711874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4646ad1-eec4-4bcb-a726-9e6731fdbf4c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:56.726044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4646ad1-eec4-4bcb-a726-9e6731fdbf4c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:56.731471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10780e4-39a8-4c48-8544-f2b4e6b33743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:56.732126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10780e4-39a8-4c48-8544-f2b4e6b33743 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:56.732393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10780e4-39a8-4c48-8544-f2b4e6b33743 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:56.732670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10780e4-39a8-4c48-8544-f2b4e6b33743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:56.740783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10780e4-39a8-4c48-8544-f2b4e6b33743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:56.742373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10780e4-39a8-4c48-8544-f2b4e6b33743 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:56.752181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 720/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:57.636623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5327d0-c2b2-4746-8ea2-45b933114191 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:57.637182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5327d0-c2b2-4746-8ea2-45b933114191 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:57.637182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5327d0-c2b2-4746-8ea2-45b933114191 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:57.638588 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:57.644421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4726977-2381-4d12-84bf-4044ab26ee30 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:57.644834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4726977-2381-4d12-84bf-4044ab26ee30 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:57.644968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4726977-2381-4d12-84bf-4044ab26ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:57.662332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a4726977-2381-4d12-84bf-4044ab26ee30 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:57.663511 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a4726977-2381-4d12-84bf-4044ab26ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:39:57.671128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:39:57.819137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5327d0-c2b2-4746-8ea2-45b933114191 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:39:57.833522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5327d0-c2b2-4746-8ea2-45b933114191 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:39:57.838797 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d9271-5e5c-45d8-a1a5-6cb8c830b012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:39:57.839426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d9271-5e5c-45d8-a1a5-6cb8c830b012 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:57.839711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d9271-5e5c-45d8-a1a5-6cb8c830b012 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:57.839980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d9271-5e5c-45d8-a1a5-6cb8c830b012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:57.847897 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d9271-5e5c-45d8-a1a5-6cb8c830b012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:39:57.849435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d9271-5e5c-45d8-a1a5-6cb8c830b012 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:39:57.859105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 719/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:39:59.968717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876f6cf-159e-48dc-b194-16b775a23605 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:59.969290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876f6cf-159e-48dc-b194-16b775a23605 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:59.969290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876f6cf-159e-48dc-b194-16b775a23605 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:59.970659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:39:59.975936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc39840-a0fd-4fd2-a6ea-adc312cd959e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:39:59.976325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc39840-a0fd-4fd2-a6ea-adc312cd959e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:39:59.976486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc39840-a0fd-4fd2-a6ea-adc312cd959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:39:59.994695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-4cc39840-a0fd-4fd2-a6ea-adc312cd959e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:39:59.995894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4cc39840-a0fd-4fd2-a6ea-adc312cd959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:00.003699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:00.041935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876f6cf-159e-48dc-b194-16b775a23605 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:00.052450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876f6cf-159e-48dc-b194-16b775a23605 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:00.055880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5743b-6aad-432c-ab4f-abaf968ff740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:00.056498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5743b-6aad-432c-ab4f-abaf968ff740 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:00.056777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5743b-6aad-432c-ab4f-abaf968ff740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:00.057046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5743b-6aad-432c-ab4f-abaf968ff740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:00.065627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5743b-6aad-432c-ab4f-abaf968ff740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:00.067066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5743b-6aad-432c-ab4f-abaf968ff740 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:00.077416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 723/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:40:02.449941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5c89-baf3-4e9b-9459-3ee39fba1efd None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:02.450743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5c89-baf3-4e9b-9459-3ee39fba1efd None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:02.450743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5c89-baf3-4e9b-9459-3ee39fba1efd None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:02.452118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:02.457392 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db01847-4393-4e5a-918c-d364e5891371 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:02.457803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db01847-4393-4e5a-918c-d364e5891371 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:02.457948 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db01847-4393-4e5a-918c-d364e5891371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:02.475424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0db01847-4393-4e5a-918c-d364e5891371 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:02.476592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0db01847-4393-4e5a-918c-d364e5891371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:02.484656 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:02.522844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f5c89-baf3-4e9b-9459-3ee39fba1efd None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:02.533404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f5c89-baf3-4e9b-9459-3ee39fba1efd None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:02.536896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1ebe7-516a-4a88-b323-5685b1a321de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:02.537525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1ebe7-516a-4a88-b323-5685b1a321de service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:02.537808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1ebe7-516a-4a88-b323-5685b1a321de service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:02.538081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1ebe7-516a-4a88-b323-5685b1a321de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:02.547387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1ebe7-516a-4a88-b323-5685b1a321de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:02.548787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1ebe7-516a-4a88-b323-5685b1a321de service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:02.557968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 722/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:40:05.167474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bcc68-5b00-4efb-9402-86138647b0ed None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:05.167474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bcc68-5b00-4efb-9402-86138647b0ed None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:05.167474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bcc68-5b00-4efb-9402-86138647b0ed None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:05.167474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:05.168180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90864c06-ea1d-4006-814f-c4a9090359d5 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:05.168180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90864c06-ea1d-4006-814f-c4a9090359d5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:05.168180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90864c06-ea1d-4006-814f-c4a9090359d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:05.179562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-90864c06-ea1d-4006-814f-c4a9090359d5 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:05.180752 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-90864c06-ea1d-4006-814f-c4a9090359d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:05.188935 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:05.227120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bcc68-5b00-4efb-9402-86138647b0ed None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:05.237683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bcc68-5b00-4efb-9402-86138647b0ed None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:05.241344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc13f-dfd2-4c8a-8fb5-894feb032c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:05.242005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc13f-dfd2-4c8a-8fb5-894feb032c8f service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:05.242329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc13f-dfd2-4c8a-8fb5-894feb032c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:05.242609 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc13f-dfd2-4c8a-8fb5-894feb032c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:05.252066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc13f-dfd2-4c8a-8fb5-894feb032c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:05.253483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc13f-dfd2-4c8a-8fb5-894feb032c8f service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:05.262788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 726/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:40:07.614999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399e0a7-2d6a-4427-a24c-99535971f0ff None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:07.615539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399e0a7-2d6a-4427-a24c-99535971f0ff None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:07.615539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399e0a7-2d6a-4427-a24c-99535971f0ff None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:07.616963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:07.622072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920f5be-aa3e-4d59-aa47-5f51a95b1813 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:07.622509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920f5be-aa3e-4d59-aa47-5f51a95b1813 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:07.622723 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920f5be-aa3e-4d59-aa47-5f51a95b1813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:07.640384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e920f5be-aa3e-4d59-aa47-5f51a95b1813 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:07.641553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e920f5be-aa3e-4d59-aa47-5f51a95b1813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:07.649108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:07.687732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399e0a7-2d6a-4427-a24c-99535971f0ff None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:07.698166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399e0a7-2d6a-4427-a24c-99535971f0ff None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:07.701872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdff71a-6c90-4640-8b5d-f7c2235fc831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:07.702528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff71a-6c90-4640-8b5d-f7c2235fc831 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:07.702809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff71a-6c90-4640-8b5d-f7c2235fc831 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:07.703078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff71a-6c90-4640-8b5d-f7c2235fc831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:07.711889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdff71a-6c90-4640-8b5d-f7c2235fc831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:07.713296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdff71a-6c90-4640-8b5d-f7c2235fc831 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:07.722621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 725/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:40:09.995553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1608c2-ae76-478d-a252-134342269929 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:09.996160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1608c2-ae76-478d-a252-134342269929 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:09.996160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1608c2-ae76-478d-a252-134342269929 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:09.997557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:10.002801 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6a80-e42f-445e-b5ea-dca3353d9f97 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:10.003230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6a80-e42f-445e-b5ea-dca3353d9f97 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:10.003356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6a80-e42f-445e-b5ea-dca3353d9f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:10.021037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-43af6a80-e42f-445e-b5ea-dca3353d9f97 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:10.022206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-43af6a80-e42f-445e-b5ea-dca3353d9f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:10.030731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:10.067201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1608c2-ae76-478d-a252-134342269929 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:10.078593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1608c2-ae76-478d-a252-134342269929 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:10.082080 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044df1c6-b09d-491f-8e56-48bb88f60025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:10.082747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df1c6-b09d-491f-8e56-48bb88f60025 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:10.083038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df1c6-b09d-491f-8e56-48bb88f60025 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:10.083317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df1c6-b09d-491f-8e56-48bb88f60025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:10.092827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044df1c6-b09d-491f-8e56-48bb88f60025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:10.094261 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044df1c6-b09d-491f-8e56-48bb88f60025 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:10.103633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 729/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:40:12.392804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7017b-2376-4da2-826d-be5e7ab1bd05 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:12.393335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7017b-2376-4da2-826d-be5e7ab1bd05 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:12.393335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7017b-2376-4da2-826d-be5e7ab1bd05 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:12.394694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:12.400007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11467dc-67ec-42c3-88f3-d59562caf6f2 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:12.400433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11467dc-67ec-42c3-88f3-d59562caf6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:12.400570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11467dc-67ec-42c3-88f3-d59562caf6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:12.418498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e11467dc-67ec-42c3-88f3-d59562caf6f2 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:12.419721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e11467dc-67ec-42c3-88f3-d59562caf6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:12.427495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:12.465700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7017b-2376-4da2-826d-be5e7ab1bd05 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:12.476196 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7017b-2376-4da2-826d-be5e7ab1bd05 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:12.479713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af128f-2ca3-49a5-94dc-ccbaa72869d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:12.480340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af128f-2ca3-49a5-94dc-ccbaa72869d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:12.480623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af128f-2ca3-49a5-94dc-ccbaa72869d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:12.480897 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af128f-2ca3-49a5-94dc-ccbaa72869d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:12.489628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af128f-2ca3-49a5-94dc-ccbaa72869d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:12.491067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af128f-2ca3-49a5-94dc-ccbaa72869d2 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:12.500871 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 728/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:40:14.774311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93161a-8ef9-4f9e-9ed8-760452d6e33f None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:14.774852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93161a-8ef9-4f9e-9ed8-760452d6e33f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:14.774852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93161a-8ef9-4f9e-9ed8-760452d6e33f None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:14.776246 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:14.782424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d8e80-26a8-4f50-bae9-bff5973c3c74 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:14.782900 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d8e80-26a8-4f50-bae9-bff5973c3c74 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:14.782999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d8e80-26a8-4f50-bae9-bff5973c3c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:14.788943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=70 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:40:14.802027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-df1d8e80-26a8-4f50-bae9-bff5973c3c74 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:14.803235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-df1d8e80-26a8-4f50-bae9-bff5973c3c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:14.810925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:14.848653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93161a-8ef9-4f9e-9ed8-760452d6e33f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:14.854150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=73 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:40:14.860540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93161a-8ef9-4f9e-9ed8-760452d6e33f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:14.864123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906269-9c76-4b12-9745-fbfe68d6cd41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:14.864751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906269-9c76-4b12-9745-fbfe68d6cd41 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:14.865032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906269-9c76-4b12-9745-fbfe68d6cd41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:14.865304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906269-9c76-4b12-9745-fbfe68d6cd41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:14.874143 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906269-9c76-4b12-9745-fbfe68d6cd41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:14.875674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906269-9c76-4b12-9745-fbfe68d6cd41 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:14.888556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 732/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:40:17.160573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae7c0-a17a-4d5e-9e4f-bf53b2752e4e None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:17.161018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae7c0-a17a-4d5e-9e4f-bf53b2752e4e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:17.161126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae7c0-a17a-4d5e-9e4f-bf53b2752e4e None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:17.162520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:17.167701 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc2afb-0992-4654-800d-d187440f4f7f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:17.168093 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc2afb-0992-4654-800d-d187440f4f7f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:17.168279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc2afb-0992-4654-800d-d187440f4f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:17.186181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-9ffc2afb-0992-4654-800d-d187440f4f7f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:17.187393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9ffc2afb-0992-4654-800d-d187440f4f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:17.195101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:17.231776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ae7c0-a17a-4d5e-9e4f-bf53b2752e4e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:17.242109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ae7c0-a17a-4d5e-9e4f-bf53b2752e4e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:17.245540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9973e0e-09ce-44b6-ac28-ac3915af497e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:17.246159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9973e0e-09ce-44b6-ac28-ac3915af497e service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:17.246476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9973e0e-09ce-44b6-ac28-ac3915af497e service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:17.246743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9973e0e-09ce-44b6-ac28-ac3915af497e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:17.255833 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9973e0e-09ce-44b6-ac28-ac3915af497e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:17.257228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9973e0e-09ce-44b6-ac28-ac3915af497e service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:17.266965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 731/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:40:19.502132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9449f05-6bf4-4b44-8eba-f0439e7c80f0 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:19.502669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9449f05-6bf4-4b44-8eba-f0439e7c80f0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:19.502669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9449f05-6bf4-4b44-8eba-f0439e7c80f0 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:19.504043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:19.509429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ee96c-1a39-4bf7-b756-1f34307de6ac None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:19.509876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ee96c-1a39-4bf7-b756-1f34307de6ac None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:19.509980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ee96c-1a39-4bf7-b756-1f34307de6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:19.527806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-bb3ee96c-1a39-4bf7-b756-1f34307de6ac None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:19.529600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-bb3ee96c-1a39-4bf7-b756-1f34307de6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:19.537234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:19.572508 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9449f05-6bf4-4b44-8eba-f0439e7c80f0 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:19.583641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9449f05-6bf4-4b44-8eba-f0439e7c80f0 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:19.587060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ab7f0-bac5-4e35-9def-f08f16db0506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:19.587713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab7f0-bac5-4e35-9def-f08f16db0506 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:19.587991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab7f0-bac5-4e35-9def-f08f16db0506 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:19.588272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab7f0-bac5-4e35-9def-f08f16db0506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:19.597436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ab7f0-bac5-4e35-9def-f08f16db0506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:19.598865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ab7f0-bac5-4e35-9def-f08f16db0506 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:19.607935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 735/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:40:21.868253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbf9ca-2e84-4e44-a4dd-50d3c4f05841 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:21.869109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbf9ca-2e84-4e44-a4dd-50d3c4f05841 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:21.869326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbf9ca-2e84-4e44-a4dd-50d3c4f05841 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:21.870955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:21.877051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7c989-289d-485d-b110-5b320017fb1f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:21.877528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7c989-289d-485d-b110-5b320017fb1f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:21.877681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7c989-289d-485d-b110-5b320017fb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:21.895163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-67e7c989-289d-485d-b110-5b320017fb1f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:21.896343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-67e7c989-289d-485d-b110-5b320017fb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:21.904009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:21.940540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbf9ca-2e84-4e44-a4dd-50d3c4f05841 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:21.951354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbf9ca-2e84-4e44-a4dd-50d3c4f05841 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:21.954884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa9ef-97b3-41f0-b59c-83696c266424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:21.955545 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa9ef-97b3-41f0-b59c-83696c266424 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:21.955829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa9ef-97b3-41f0-b59c-83696c266424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:21.956102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa9ef-97b3-41f0-b59c-83696c266424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:21.964981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaa9ef-97b3-41f0-b59c-83696c266424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:21.966453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaa9ef-97b3-41f0-b59c-83696c266424 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:21.975970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 734/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:40:31.890122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=17 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:40:31.971838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=17 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:40:53.741205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2550dc-69ca-4711-aa1b-f25ac42cfaf6 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:53.741802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2550dc-69ca-4711-aa1b-f25ac42cfaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:53.741802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2550dc-69ca-4711-aa1b-f25ac42cfaf6 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:53.743190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 737/1471] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:53.748511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef557e4b-14d3-4845-9d40-8f3eb3c2a2a0 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:53.749091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef557e4b-14d3-4845-9d40-8f3eb3c2a2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:53.749091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef557e4b-14d3-4845-9d40-8f3eb3c2a2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:53.766953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ef557e4b-14d3-4845-9d40-8f3eb3c2a2a0 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:53.768145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ef557e4b-14d3-4845-9d40-8f3eb3c2a2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:53.775843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 735/1472] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:53.823916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073120a1-dc5b-4c04-af0e-eb1904f10ccf None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:53.824210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073120a1-dc5b-4c04-af0e-eb1904f10ccf None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:53.824495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073120a1-dc5b-4c04-af0e-eb1904f10ccf None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:53.826174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 738/1473] 10.222.0.40 () {54 vars in 962 bytes} [Wed Jun 8 06:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:53.831035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb1b93-2f10-46a9-9d67-06a3516d92a8 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:53.831360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb1b93-2f10-46a9-9d67-06a3516d92a8 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:53.831635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb1b93-2f10-46a9-9d67-06a3516d92a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:53.849556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-75cb1b93-2f10-46a9-9d67-06a3516d92a8 None None] MFA Rules not processed for user `5498a6912a08408d9ea30920faceee7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:53.850760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-75cb1b93-2f10-46a9-9d67-06a3516d92a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:53.857651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 736/1474] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Jun 8 06:40:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:53.864557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073120a1-dc5b-4c04-af0e-eb1904f10ccf None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:53.875264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073120a1-dc5b-4c04-af0e-eb1904f10ccf None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:53.878793 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3385f9f-f1a6-4dd2-9e60-0be05d448a95 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5498a6912a08408d9ea30920faceee7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:53.879414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3385f9f-f1a6-4dd2-9e60-0be05d448a95 service glance] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:53.879700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3385f9f-f1a6-4dd2-9e60-0be05d448a95 service glance] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:53.879979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3385f9f-f1a6-4dd2-9e60-0be05d448a95 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:53.889067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3385f9f-f1a6-4dd2-9e60-0be05d448a95 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:53.890523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3385f9f-f1a6-4dd2-9e60-0be05d448a95 service glance] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:53.899891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 739/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:40:56.201923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323256-859b-46a6-a116-67a320ffe140 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:56.202468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323256-859b-46a6-a116-67a320ffe140 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:56.202566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323256-859b-46a6-a116-67a320ffe140 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:56.203851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 737/1476] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:56.209125 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d1ff-6d86-4f94-b609-ec9db6eec979 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:56.209534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d1ff-6d86-4f94-b609-ec9db6eec979 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:56.209695 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d1ff-6d86-4f94-b609-ec9db6eec979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:56.227472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-75c8d1ff-6d86-4f94-b609-ec9db6eec979 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:56.228643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-75c8d1ff-6d86-4f94-b609-ec9db6eec979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:56.236248 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 740/1477] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:56.259376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323256-859b-46a6-a116-67a320ffe140 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:56.272339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323256-859b-46a6-a116-67a320ffe140 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:56.277078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd4125-a07c-4377-bd13-737cb089893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:56.277717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd4125-a07c-4377-bd13-737cb089893d admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:56.277997 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd4125-a07c-4377-bd13-737cb089893d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:56.278300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd4125-a07c-4377-bd13-737cb089893d admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:56.279035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd4125-a07c-4377-bd13-737cb089893d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:56.280778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: WARNING py.warnings [None req-83dd4125-a07c-4377-bd13-737cb089893d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:40:56.280778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: warnings.warn(msg) Jun 08 06:40:56.280778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: Jun 08 06:40:56.281901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd4125-a07c-4377-bd13-737cb089893d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:56.302159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 738/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jun 8 06:40:56 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:40:58.573156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712c577-5cd7-4565-9e05-c2578914ec94 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:58.574186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712c577-5cd7-4565-9e05-c2578914ec94 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:58.574186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712c577-5cd7-4565-9e05-c2578914ec94 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:58.575802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 741/1479] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:40:58.581010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2740599-80f5-45c4-b56f-74aa5a431c39 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:58.581425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2740599-80f5-45c4-b56f-74aa5a431c39 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:58.581581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2740599-80f5-45c4-b56f-74aa5a431c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:58.600023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-e2740599-80f5-45c4-b56f-74aa5a431c39 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:40:58.601871 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e2740599-80f5-45c4-b56f-74aa5a431c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:40:58.609182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 739/1480] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:40:58.653830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712c577-5cd7-4565-9e05-c2578914ec94 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:40:58.668192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712c577-5cd7-4565-9e05-c2578914ec94 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:40:58.673660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8289ea1-1d0e-45fc-90a8-764b75d59396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:40:58.674447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8289ea1-1d0e-45fc-90a8-764b75d59396 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:40:58.674747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8289ea1-1d0e-45fc-90a8-764b75d59396 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:40:58.675007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8289ea1-1d0e-45fc-90a8-764b75d59396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:40:58.683270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8289ea1-1d0e-45fc-90a8-764b75d59396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:40:58.684843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8289ea1-1d0e-45fc-90a8-764b75d59396 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:40:58.694194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 742/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:41:01.093686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886862e-918c-438f-a016-7e6460ddb804 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:01.094230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886862e-918c-438f-a016-7e6460ddb804 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:01.094230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886862e-918c-438f-a016-7e6460ddb804 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:01.095647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 740/1482] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:41:01.100954 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bfa2b-3a1a-464c-8228-1d2add56b43e None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:01.101373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bfa2b-3a1a-464c-8228-1d2add56b43e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:01.101510 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bfa2b-3a1a-464c-8228-1d2add56b43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:01.118810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-6a4bfa2b-3a1a-464c-8228-1d2add56b43e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:41:01.119986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6a4bfa2b-3a1a-464c-8228-1d2add56b43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:41:01.127819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 743/1483] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:41:01.164897 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886862e-918c-438f-a016-7e6460ddb804 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:41:01.175676 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886862e-918c-438f-a016-7e6460ddb804 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:41:01.179270 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ca6c9-fedc-428a-97db-365ee277925e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:41:01.179901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ca6c9-fedc-428a-97db-365ee277925e service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:01.180186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ca6c9-fedc-428a-97db-365ee277925e service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:01.180462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ca6c9-fedc-428a-97db-365ee277925e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:01.189881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ca6c9-fedc-428a-97db-365ee277925e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:41:01.191356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ca6c9-fedc-428a-97db-365ee277925e service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:41:01.201513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 741/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:41:03.459975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d3eef-0289-4ec4-bf68-837b3681be06 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:03.460566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d3eef-0289-4ec4-bf68-837b3681be06 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:03.460566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d3eef-0289-4ec4-bf68-837b3681be06 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:03.461905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 744/1485] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:41:03.467610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93448e4-0965-44d6-9a87-3dd0f8495c1d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:03.468055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93448e4-0965-44d6-9a87-3dd0f8495c1d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:03.468153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93448e4-0965-44d6-9a87-3dd0f8495c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:03.486374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-f93448e4-0965-44d6-9a87-3dd0f8495c1d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:41:03.487569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f93448e4-0965-44d6-9a87-3dd0f8495c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:41:03.495277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 742/1486] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:41:03.531952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d3eef-0289-4ec4-bf68-837b3681be06 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:41:03.543310 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d3eef-0289-4ec4-bf68-837b3681be06 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:41:03.546830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1fcaa-bef4-4f49-a3d0-c0209690f1c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:41:03.547459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1fcaa-bef4-4f49-a3d0-c0209690f1c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:03.547741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1fcaa-bef4-4f49-a3d0-c0209690f1c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:03.548015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1fcaa-bef4-4f49-a3d0-c0209690f1c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:03.556772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1fcaa-bef4-4f49-a3d0-c0209690f1c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:41:03.558231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1fcaa-bef4-4f49-a3d0-c0209690f1c6 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:41:03.568010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 745/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:41:05.885000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d970112-8083-4e45-bc2c-779294d9b25b None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:05.885596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d970112-8083-4e45-bc2c-779294d9b25b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:05.885596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d970112-8083-4e45-bc2c-779294d9b25b None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:05.887522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 743/1488] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:41:05.893063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511cadc-f5ae-49ca-b16f-90f353680326 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:05.893501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511cadc-f5ae-49ca-b16f-90f353680326 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:05.893596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511cadc-f5ae-49ca-b16f-90f353680326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:05.912744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a511cadc-f5ae-49ca-b16f-90f353680326 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:41:05.913946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a511cadc-f5ae-49ca-b16f-90f353680326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:41:05.921766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 746/1489] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:41:05.962399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d970112-8083-4e45-bc2c-779294d9b25b None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:41:05.973271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d970112-8083-4e45-bc2c-779294d9b25b None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:41:05.976782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309bd64-d87c-4e19-abfd-ed2a305a49a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:41:05.977411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309bd64-d87c-4e19-abfd-ed2a305a49a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:05.977693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309bd64-d87c-4e19-abfd-ed2a305a49a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:05.977966 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309bd64-d87c-4e19-abfd-ed2a305a49a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:05.987048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309bd64-d87c-4e19-abfd-ed2a305a49a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:41:05.988458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309bd64-d87c-4e19-abfd-ed2a305a49a7 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:41:05.998320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 744/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:41:08.657880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd5e15-4696-47f3-9748-5ffc25650def None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:08.658552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd5e15-4696-47f3-9748-5ffc25650def None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:08.658552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd5e15-4696-47f3-9748-5ffc25650def None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:08.659894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 747/1491] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jun 8 06:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:41:08.665258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dcd07-ce78-4ffd-8944-c324c3115e55 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:08.665684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dcd07-ce78-4ffd-8944-c324c3115e55 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:08.665816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dcd07-ce78-4ffd-8944-c324c3115e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:08.683642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9c9dcd07-ce78-4ffd-8944-c324c3115e55 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:41:08.684822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9c9dcd07-ce78-4ffd-8944-c324c3115e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:41:08.693012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 745/1492] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jun 8 06:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:41:08.734557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd5e15-4696-47f3-9748-5ffc25650def None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:41:08.746637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd5e15-4696-47f3-9748-5ffc25650def None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:41:08.750617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c30879-c530-43da-bcae-8d961993621b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:41:08.751333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c30879-c530-43da-bcae-8d961993621b service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:41:08.751709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c30879-c530-43da-bcae-8d961993621b service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:41:08.752055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c30879-c530-43da-bcae-8d961993621b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:41:08.763157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c30879-c530-43da-bcae-8d961993621b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:41:08.764819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c30879-c530-43da-bcae-8d961993621b service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:41:08.775217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 748/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:41:18.678080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=33 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:41:18.770595 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=33 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:43:04.957285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feedf8e-b30a-4783-958d-eb64d20d069c None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:04.957886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feedf8e-b30a-4783-958d-eb64d20d069c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:04.957886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feedf8e-b30a-4783-958d-eb64d20d069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:04.975971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-3feedf8e-b30a-4783-958d-eb64d20d069c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:43:04.977162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3feedf8e-b30a-4783-958d-eb64d20d069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:43:04.986493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 746/1494] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:43:04.994189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef03f-b0ba-4b49-8d06-e70383f3c81f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:04.994676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef03f-b0ba-4b49-8d06-e70383f3c81f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:04.994775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef03f-b0ba-4b49-8d06-e70383f3c81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.012234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-8b8ef03f-b0ba-4b49-8d06-e70383f3c81f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:43:05.013427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8b8ef03f-b0ba-4b49-8d06-e70383f3c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:43:05.021139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 749/1495] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:43:05.025365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feedf8e-b30a-4783-958d-eb64d20d069c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:43:05.035435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feedf8e-b30a-4783-958d-eb64d20d069c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:43:05.039918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e1b25-42d8-4430-8257-6830acd0ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:43:05.043467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e1b25-42d8-4430-8257-6830acd0ee85 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.043467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e1b25-42d8-4430-8257-6830acd0ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.043467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e1b25-42d8-4430-8257-6830acd0ee85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.043467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e1b25-42d8-4430-8257-6830acd0ee85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:43:05.043467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e1b25-42d8-4430-8257-6830acd0ee85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:43:05.043896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: WARNING py.warnings [None req-615e1b25-42d8-4430-8257-6830acd0ee85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:43:05.043896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: warnings.warn(msg) Jun 08 06:43:05.043896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: Jun 08 06:43:05.044136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e1b25-42d8-4430-8257-6830acd0ee85 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:43:05.056360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 747/1496] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:43:05.064547 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ef03f-b0ba-4b49-8d06-e70383f3c81f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:43:05.073434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ef03f-b0ba-4b49-8d06-e70383f3c81f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:43:05.078089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ba80-4bf9-4945-abb0-09cc169466cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:43:05.078764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ba80-4bf9-4945-abb0-09cc169466cf admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.079043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ba80-4bf9-4945-abb0-09cc169466cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.079312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ba80-4bf9-4945-abb0-09cc169466cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.079985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ba80-4bf9-4945-abb0-09cc169466cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:43:05.081681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: WARNING py.warnings [None req-f072ba80-4bf9-4945-abb0-09cc169466cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:43:05.081681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: warnings.warn(msg) Jun 08 06:43:05.081681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: Jun 08 06:43:05.082884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ba80-4bf9-4945-abb0-09cc169466cf admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:43:05.179867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 750/1497] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:43:05 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:43:05.184079 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e1b25-42d8-4430-8257-6830acd0ee85 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:43:05.193846 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e1b25-42d8-4430-8257-6830acd0ee85 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:43:05.248570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a2333-1e44-45d9-8e77-8fee0de5d93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:43:05.249161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2333-1e44-45d9-8e77-8fee0de5d93a admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.249442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2333-1e44-45d9-8e77-8fee0de5d93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.249713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2333-1e44-45d9-8e77-8fee0de5d93a admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.250471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a2333-1e44-45d9-8e77-8fee0de5d93a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:43:05.251470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: WARNING py.warnings [None req-cd5a2333-1e44-45d9-8e77-8fee0de5d93a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:43:05.251470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: warnings.warn(msg) Jun 08 06:43:05.251470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: Jun 08 06:43:05.252651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a2333-1e44-45d9-8e77-8fee0de5d93a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:43:05.332249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 748/1498] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:43:05 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:43:05.336312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ba80-4bf9-4945-abb0-09cc169466cf admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:43:05.347240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ba80-4bf9-4945-abb0-09cc169466cf admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:43:05.351751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6b09b-b41e-45ce-8c26-1c5d7554bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:43:05.352442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6b09b-b41e-45ce-8c26-1c5d7554bfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.352702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6b09b-b41e-45ce-8c26-1c5d7554bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.352938 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6b09b-b41e-45ce-8c26-1c5d7554bfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.353680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6b09b-b41e-45ce-8c26-1c5d7554bfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:43:05.354722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: WARNING py.warnings [None req-66e6b09b-b41e-45ce-8c26-1c5d7554bfd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:43:05.354722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: warnings.warn(msg) Jun 08 06:43:05.354722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: Jun 08 06:43:05.355594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6b09b-b41e-45ce-8c26-1c5d7554bfd2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:43:05.368358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 751/1499] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:43:05.372144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a2333-1e44-45d9-8e77-8fee0de5d93a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:43:05.381874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a2333-1e44-45d9-8e77-8fee0de5d93a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:43:05.386294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578518c-d1f9-4f7f-8663-e48efc1c3a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:43:05.386940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578518c-d1f9-4f7f-8663-e48efc1c3a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.387321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578518c-d1f9-4f7f-8663-e48efc1c3a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.387598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578518c-d1f9-4f7f-8663-e48efc1c3a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.388841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578518c-d1f9-4f7f-8663-e48efc1c3a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:43:05.389832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: WARNING py.warnings [None req-5578518c-d1f9-4f7f-8663-e48efc1c3a6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:43:05.389832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: warnings.warn(msg) Jun 08 06:43:05.389832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: Jun 08 06:43:05.390728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578518c-d1f9-4f7f-8663-e48efc1c3a6b admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:43:05.403573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 749/1500] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:43:05.407992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6b09b-b41e-45ce-8c26-1c5d7554bfd2 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:43:05.417804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6b09b-b41e-45ce-8c26-1c5d7554bfd2 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:43:05.422435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb49b37-eba5-4fb6-b241-fccecf31dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:43:05.423304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb49b37-eba5-4fb6-b241-fccecf31dbf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.423589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb49b37-eba5-4fb6-b241-fccecf31dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.423867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb49b37-eba5-4fb6-b241-fccecf31dbf7 admin admin] PATH_INFO: `/v3/projects/77242fd49f9d4895a6612f4865ff6083/users/2c565f27165343f89f359620745c0458/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.438006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb49b37-eba5-4fb6-b241-fccecf31dbf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77242fd49f9d4895a6612f4865ff6083, user_id=2c565f27165343f89f359620745c0458, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:43:05.439066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: WARNING py.warnings [None req-2bb49b37-eba5-4fb6-b241-fccecf31dbf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:43:05.439066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: warnings.warn(msg) Jun 08 06:43:05.439066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: Jun 08 06:43:05.440980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb49b37-eba5-4fb6-b241-fccecf31dbf7 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:43:05.503441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 752/1501] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:43:05 2022] PUT /identity/v3/projects/77242fd49f9d4895a6612f4865ff6083/users/2c565f27165343f89f359620745c0458/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:43:05.516242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859221c-b980-4fc0-afe9-21867feb5fa4 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.516535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859221c-b980-4fc0-afe9-21867feb5fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.516813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859221c-b980-4fc0-afe9-21867feb5fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.543490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-6859221c-b980-4fc0-afe9-21867feb5fa4 None None] MFA Rules not processed for user `2c565f27165343f89f359620745c0458`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:43:05.544695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-6859221c-b980-4fc0-afe9-21867feb5fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:43:05.608883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 750/1502] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:43:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:43:05.622120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef8a6-ea37-4cc5-9df4-af702641ac44 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.622947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef8a6-ea37-4cc5-9df4-af702641ac44 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.623231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef8a6-ea37-4cc5-9df4-af702641ac44 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.624628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 753/1503] 10.222.0.40 () {54 vars in 963 bytes} [Wed Jun 8 06:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:43:05.629599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bbb9b-44ca-4527-9717-65fabd8522c5 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.629890 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bbb9b-44ca-4527-9717-65fabd8522c5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.630167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bbb9b-44ca-4527-9717-65fabd8522c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.648540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b65bbb9b-44ca-4527-9717-65fabd8522c5 None None] MFA Rules not processed for user `8c060a0a42824aa589135ea357165268`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:43:05.649731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b65bbb9b-44ca-4527-9717-65fabd8522c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:43:05.692268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:43:05.699713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 751/1504] 10.222.0.40 () {58 vars in 1060 bytes} [Wed Jun 8 06:43:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:43:05.707864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ef8a6-ea37-4cc5-9df4-af702641ac44 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:43:05.718200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ef8a6-ea37-4cc5-9df4-af702641ac44 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:43:05.721903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51757325-54f9-491f-b8ce-8080db72c314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:43:05.722566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51757325-54f9-491f-b8ce-8080db72c314 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.722851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51757325-54f9-491f-b8ce-8080db72c314 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.723129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51757325-54f9-491f-b8ce-8080db72c314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.731486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51757325-54f9-491f-b8ce-8080db72c314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:43:05.732991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51757325-54f9-491f-b8ce-8080db72c314 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:43:05.741754 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 754/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:43:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:43:05.784351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42935f2-7547-48ee-a18e-e03c38db5cac None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.784642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42935f2-7547-48ee-a18e-e03c38db5cac None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.784921 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42935f2-7547-48ee-a18e-e03c38db5cac None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.786281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 752/1506] 10.222.0.40 () {52 vars in 829 bytes} [Wed Jun 8 06:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:43:05.789823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51757325-54f9-491f-b8ce-8080db72c314 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:43:05.851518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51757325-54f9-491f-b8ce-8080db72c314 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:43:05.856085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:43:05.857047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:05.857328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:05.857600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] PATH_INFO: `/v3/users/2c565f27165343f89f359620745c0458` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:05.858841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c565f27165343f89f359620745c0458)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:43:05.863137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: WARNING py.warnings [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:43:05.863137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: warnings.warn(msg) Jun 08 06:43:05.863137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: Jun 08 06:43:05.863137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:43:06.150127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c565f27165343f89f359620745c0458'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:43:06.150762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c565f27165343f89f359620745c0458'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:43:06.218127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c565f27165343f89f359620745c0458'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:43:06.236354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c565f27165343f89f359620745c0458'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:43:06.244357 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:43:06.248821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c565f27165343f89f359620745c0458'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:43:06.254893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 755/1507] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:43:05 2022] DELETE /identity/v3/users/2c565f27165343f89f359620745c0458 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:43:06.259527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730d49-cbbe-4463-ac18-a85976d9b252 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:06.260005 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730d49-cbbe-4463-ac18-a85976d9b252 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:06.260116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730d49-cbbe-4463-ac18-a85976d9b252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:06.277992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-09730d49-cbbe-4463-ac18-a85976d9b252 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:43:06.279875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-09730d49-cbbe-4463-ac18-a85976d9b252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:43:06.337289 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 753/1508] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:43:06.346767 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:43:06.348147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:43:06.404485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272e82a-16b4-40db-8c2a-b882b6edb891 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:43:06.407967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3b9f6-b333-407e-b18d-907142b3a0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:43:06.408599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b9f6-b333-407e-b18d-907142b3a0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:06.408879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b9f6-b333-407e-b18d-907142b3a0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:06.409152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b9f6-b333-407e-b18d-907142b3a0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:06.417835 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3b9f6-b333-407e-b18d-907142b3a0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:43:06.419309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3b9f6-b333-407e-b18d-907142b3a0e6 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:43:06.428442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 756/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:43:07.019726 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730d49-cbbe-4463-ac18-a85976d9b252 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:43:07.022413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-09730d49-cbbe-4463-ac18-a85976d9b252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:43:07.033793 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730d49-cbbe-4463-ac18-a85976d9b252 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:43:07.038612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:43:07.039530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:43:07.039816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:43:07.040090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] PATH_INFO: `/v3/projects/77242fd49f9d4895a6612f4865ff6083` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:43:07.041280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=77242fd49f9d4895a6612f4865ff6083)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:43:07.042332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: WARNING py.warnings [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:43:07.042332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: warnings.warn(msg) Jun 08 06:43:07.042332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: Jun 08 06:43:07.043556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:43:07.149032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77242fd49f9d4895a6612f4865ff6083', 'request_id': 'req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:43:07.223465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77242fd49f9d4895a6612f4865ff6083', 'request_id': 'req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:43:07.237511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77242fd49f9d4895a6612f4865ff6083', 'request_id': 'req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:43:07.248144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] The token cache is being invalidate because project 77242fd49f9d4895a6612f4865ff6083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:43:07.248427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:43:07.249063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6bf38fa9-9fc2-4a87-a3c0-9604a5535fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:43:07.250830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 754/1510] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:43:07 2022] DELETE /identity/v3/projects/77242fd49f9d4895a6612f4865ff6083 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:43:16.424454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=29 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:43:17.245227 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:44:40.548933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115da1-a41c-4e8a-93a3-30fd3e30a722 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:40.549489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115da1-a41c-4e8a-93a3-30fd3e30a722 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:40.549489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115da1-a41c-4e8a-93a3-30fd3e30a722 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:40.551609 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:44:40.556595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf228-7f71-4a14-979a-06c2bc1e6f62 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:40.557036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf228-7f71-4a14-979a-06c2bc1e6f62 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:40.557162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf228-7f71-4a14-979a-06c2bc1e6f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:40.576007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-917cf228-7f71-4a14-979a-06c2bc1e6f62 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:44:40.577209 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-917cf228-7f71-4a14-979a-06c2bc1e6f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:44:40.634058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:44:40.808028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd115da1-a41c-4e8a-93a3-30fd3e30a722 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:44:40.809888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fd115da1-a41c-4e8a-93a3-30fd3e30a722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:44:40.883815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd115da1-a41c-4e8a-93a3-30fd3e30a722 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:44:40.889346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19348c56-654a-454a-92c8-a97fb847e4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:44:40.889995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19348c56-654a-454a-92c8-a97fb847e4b3 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:40.890304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19348c56-654a-454a-92c8-a97fb847e4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:40.890582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19348c56-654a-454a-92c8-a97fb847e4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:40.898669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19348c56-654a-454a-92c8-a97fb847e4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:44:40.900234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19348c56-654a-454a-92c8-a97fb847e4b3 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:44:40.910025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 758/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:44:41.503736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbb3ac-96dc-44be-81c5-0faacac27db5 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:41.503942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbb3ac-96dc-44be-81c5-0faacac27db5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:41.504520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbb3ac-96dc-44be-81c5-0faacac27db5 None None] PATH_INFO: `/v3` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:41.505830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 756/1514] 10.222.0.41 () {54 vars in 925 bytes} [Wed Jun 8 06:44:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:44:41.512021 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6f4f-225d-4445-9f72-c47a0fba1a35 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:41.512316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6f4f-225d-4445-9f72-c47a0fba1a35 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:41.513148 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6f4f-225d-4445-9f72-c47a0fba1a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:41.531043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-548c6f4f-225d-4445-9f72-c47a0fba1a35 None None] MFA Rules not processed for user `b1e0226354d14b9b9c4184063b2df9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:44:41.532286 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-548c6f4f-225d-4445-9f72-c47a0fba1a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:44:41.595225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 759/1515] 10.222.0.41 () {58 vars in 1015 bytes} [Wed Jun 8 06:44:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:44:41.785682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593f713-01ec-4141-b857-993e56ae7c9c None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:41.786230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593f713-01ec-4141-b857-993e56ae7c9c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:41.786230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593f713-01ec-4141-b857-993e56ae7c9c None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:41.787536 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 757/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:44:41.792152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4e990-5adb-4921-8191-8b86d0334c88 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:41.792437 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4e990-5adb-4921-8191-8b86d0334c88 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:41.792709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4e990-5adb-4921-8191-8b86d0334c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:41.812244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-aff4e990-5adb-4921-8191-8b86d0334c88 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:44:41.813493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-aff4e990-5adb-4921-8191-8b86d0334c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:44:41.821426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 760/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:44:41.970537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593f713-01ec-4141-b857-993e56ae7c9c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:44:41.985546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593f713-01ec-4141-b857-993e56ae7c9c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:44:41.991028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fbdf0-1d1e-4157-a3e3-4865297b44fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:44:41.991659 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fbdf0-1d1e-4157-a3e3-4865297b44fe service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:41.991942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fbdf0-1d1e-4157-a3e3-4865297b44fe service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:41.992215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fbdf0-1d1e-4157-a3e3-4865297b44fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:42.001832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fbdf0-1d1e-4157-a3e3-4865297b44fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:44:42.003865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fbdf0-1d1e-4157-a3e3-4865297b44fe service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:44:42.013135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 758/1518] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:44:50.656947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfcce0-8f9c-4a7e-915c-030f13f210c8 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:50.657537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfcce0-8f9c-4a7e-915c-030f13f210c8 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:50.657537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfcce0-8f9c-4a7e-915c-030f13f210c8 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:50.658909 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 761/1519] 10.222.0.40 () {54 vars in 960 bytes} [Wed Jun 8 06:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:44:50.663916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655f94a-d086-49c5-9484-3e4c74b67b40 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:50.664291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655f94a-d086-49c5-9484-3e4c74b67b40 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:50.664462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655f94a-d086-49c5-9484-3e4c74b67b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:50.684390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9655f94a-d086-49c5-9484-3e4c74b67b40 None None] MFA Rules not processed for user `b1e0226354d14b9b9c4184063b2df9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:44:50.685624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9655f94a-d086-49c5-9484-3e4c74b67b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:44:50.693857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 759/1520] 10.222.0.40 () {58 vars in 1057 bytes} [Wed Jun 8 06:44:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:44:50.702046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfcce0-8f9c-4a7e-915c-030f13f210c8 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:44:50.715328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfcce0-8f9c-4a7e-915c-030f13f210c8 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:44:50.720144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c17a3-a468-4602-9325-8c5a90e7c2d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:44:50.720776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c17a3-a468-4602-9325-8c5a90e7c2d5 service placement] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:50.721059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c17a3-a468-4602-9325-8c5a90e7c2d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:50.721335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c17a3-a468-4602-9325-8c5a90e7c2d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:50.729433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c17a3-a468-4602-9325-8c5a90e7c2d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:44:50.731122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c17a3-a468-4602-9325-8c5a90e7c2d5 service placement] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:44:50.740576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 762/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:44:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:44:53.275003 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29613a8f-9a59-4390-90e4-5ee9320abacf None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:53.275556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29613a8f-9a59-4390-90e4-5ee9320abacf None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:53.275657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29613a8f-9a59-4390-90e4-5ee9320abacf None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:53.277017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:44:53.282314 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f9116-2dba-401e-9f69-f922eec34ffd None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:53.282761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f9116-2dba-401e-9f69-f922eec34ffd None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:53.282871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f9116-2dba-401e-9f69-f922eec34ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:53.303517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-862f9116-2dba-401e-9f69-f922eec34ffd None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:44:53.304721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-862f9116-2dba-401e-9f69-f922eec34ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:44:53.312681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:44:53.469002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29613a8f-9a59-4390-90e4-5ee9320abacf None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:44:53.483206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29613a8f-9a59-4390-90e4-5ee9320abacf None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:44:53.488500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393cbec-ff70-4951-ae5f-598577bd10fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:44:53.489123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393cbec-ff70-4951-ae5f-598577bd10fb service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:53.489404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393cbec-ff70-4951-ae5f-598577bd10fb service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:53.489675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393cbec-ff70-4951-ae5f-598577bd10fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:53.498133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393cbec-ff70-4951-ae5f-598577bd10fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:44:53.499776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393cbec-ff70-4951-ae5f-598577bd10fb service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:44:53.509126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 761/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:44:54.379044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe92e1a-ff9b-4522-a15f-4219ee0febd0 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:54.379624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe92e1a-ff9b-4522-a15f-4219ee0febd0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:54.379624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe92e1a-ff9b-4522-a15f-4219ee0febd0 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:54.380979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 06:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:44:54.385635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb4882-99ce-4fa5-98a4-a1227f9f7c41 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:54.386075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb4882-99ce-4fa5-98a4-a1227f9f7c41 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:54.386193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb4882-99ce-4fa5-98a4-a1227f9f7c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:54.405970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a6fb4882-99ce-4fa5-98a4-a1227f9f7c41 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:44:54.407132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a6fb4882-99ce-4fa5-98a4-a1227f9f7c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:44:54.415103 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 06:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:44:54.564231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe92e1a-ff9b-4522-a15f-4219ee0febd0 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:44:54.579073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe92e1a-ff9b-4522-a15f-4219ee0febd0 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:44:54.584414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48830f4f-d1b0-4e6e-9b67-e3e31d0fa4ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:44:54.585042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48830f4f-d1b0-4e6e-9b67-e3e31d0fa4ca service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:54.585323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48830f4f-d1b0-4e6e-9b67-e3e31d0fa4ca service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:54.585600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48830f4f-d1b0-4e6e-9b67-e3e31d0fa4ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:54.594417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48830f4f-d1b0-4e6e-9b67-e3e31d0fa4ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:44:54.596009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48830f4f-d1b0-4e6e-9b67-e3e31d0fa4ca service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:44:54.605824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 765/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:44:58.728321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbc178-2713-4fe5-856e-ebf0061c1218 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:58.728893 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbc178-2713-4fe5-856e-ebf0061c1218 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:58.728893 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbc178-2713-4fe5-856e-ebf0061c1218 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:58.730217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:44:58.736153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcff2e-2fb7-43e9-95af-d335cb16b6ce None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:58.736579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcff2e-2fb7-43e9-95af-d335cb16b6ce None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:58.736714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcff2e-2fb7-43e9-95af-d335cb16b6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:58.754288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-65dcff2e-2fb7-43e9-95af-d335cb16b6ce None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:44:58.755485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-65dcff2e-2fb7-43e9-95af-d335cb16b6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:44:58.763224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:44:58.799752 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbc178-2713-4fe5-856e-ebf0061c1218 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:44:58.801412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c6bbc178-2713-4fe5-856e-ebf0061c1218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:44:58.858693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbc178-2713-4fe5-856e-ebf0061c1218 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:44:58.862215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fb386-685d-4c8c-bbeb-e205bfe2983c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:44:58.862857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb386-685d-4c8c-bbeb-e205bfe2983c service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:44:58.863139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb386-685d-4c8c-bbeb-e205bfe2983c service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:44:58.863414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb386-685d-4c8c-bbeb-e205bfe2983c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:44:58.872184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fb386-685d-4c8c-bbeb-e205bfe2983c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:44:58.873600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fb386-685d-4c8c-bbeb-e205bfe2983c service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:44:58.882811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 764/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:45:01.089359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558859-362d-47c4-b383-64f3453b0fe6 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:45:01.089923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558859-362d-47c4-b383-64f3453b0fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:45:01.089923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558859-362d-47c4-b383-64f3453b0fe6 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:45:01.091359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:45:01.096618 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4061-8c94-4781-b145-566f5f873443 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:45:01.097050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4061-8c94-4781-b145-566f5f873443 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:45:01.097157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4061-8c94-4781-b145-566f5f873443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:45:01.115391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-1dec4061-8c94-4781-b145-566f5f873443 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:45:01.116582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1dec4061-8c94-4781-b145-566f5f873443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:45:01.125203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:45:01.160841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63558859-362d-47c4-b383-64f3453b0fe6 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:45:01.171501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63558859-362d-47c4-b383-64f3453b0fe6 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:45:01.175101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423cadf-bd67-4dc2-82bc-e04f2b9af0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:45:01.175746 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423cadf-bd67-4dc2-82bc-e04f2b9af0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:45:01.176062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423cadf-bd67-4dc2-82bc-e04f2b9af0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:45:01.176338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423cadf-bd67-4dc2-82bc-e04f2b9af0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:45:01.185983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423cadf-bd67-4dc2-82bc-e04f2b9af0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:45:01.187472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423cadf-bd67-4dc2-82bc-e04f2b9af0e6 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:45:01.200534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 768/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:45:04.887849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551064-5167-4a33-bc88-28e2ad94836a None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:45:04.888452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551064-5167-4a33-bc88-28e2ad94836a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:45:04.888452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551064-5167-4a33-bc88-28e2ad94836a None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:45:04.889895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:45:04.896553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3224e8-8e53-46ed-8507-0318d79295f6 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:45:04.897076 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3224e8-8e53-46ed-8507-0318d79295f6 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:45:04.897188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3224e8-8e53-46ed-8507-0318d79295f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:45:04.915659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-9d3224e8-8e53-46ed-8507-0318d79295f6 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:45:04.916880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9d3224e8-8e53-46ed-8507-0318d79295f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:45:04.926229 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:45:05.197035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77551064-5167-4a33-bc88-28e2ad94836a None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:45:05.199533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-77551064-5167-4a33-bc88-28e2ad94836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:45:05.255902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77551064-5167-4a33-bc88-28e2ad94836a None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:45:05.259464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb304b7-de2f-49f8-907b-a04f177685d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:45:05.260103 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb304b7-de2f-49f8-907b-a04f177685d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:45:05.260388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb304b7-de2f-49f8-907b-a04f177685d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:45:05.260667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb304b7-de2f-49f8-907b-a04f177685d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:45:05.270047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb304b7-de2f-49f8-907b-a04f177685d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:45:05.271681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb304b7-de2f-49f8-907b-a04f177685d0 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:45:05.276480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:45:05.281796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 767/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:45:07.527904 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212077a3-dc44-4870-865c-d9f6f2c33ec4 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:45:07.528430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212077a3-dc44-4870-865c-d9f6f2c33ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:45:07.528430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212077a3-dc44-4870-865c-d9f6f2c33ec4 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:45:07.529734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 06:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:45:07.535148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396f934-6731-47ae-b449-c200a64d2182 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:45:07.535566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396f934-6731-47ae-b449-c200a64d2182 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:45:07.535738 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396f934-6731-47ae-b449-c200a64d2182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:45:07.554052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-3396f934-6731-47ae-b449-c200a64d2182 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:45:07.555279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3396f934-6731-47ae-b449-c200a64d2182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:45:07.563870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 06:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:45:07.832786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212077a3-dc44-4870-865c-d9f6f2c33ec4 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:45:07.835617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-212077a3-dc44-4870-865c-d9f6f2c33ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:45:07.842487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=94 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:45:07.848181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212077a3-dc44-4870-865c-d9f6f2c33ec4 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:45:07.851690 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e33de-8833-450c-a94f-43eca19d37eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:45:07.852321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e33de-8833-450c-a94f-43eca19d37eb service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:45:07.852602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e33de-8833-450c-a94f-43eca19d37eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:45:07.852877 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e33de-8833-450c-a94f-43eca19d37eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:45:07.862468 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e33de-8833-450c-a94f-43eca19d37eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:45:07.863876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e33de-8833-450c-a94f-43eca19d37eb service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:45:07.873178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 771/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:45:17.548889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:45:17.894553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:35.904533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54f103-fa05-446a-a052-09672ddcf876 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:35.905708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54f103-fa05-446a-a052-09672ddcf876 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:35.906217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54f103-fa05-446a-a052-09672ddcf876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:35.929222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05cc40-2c4d-483a-9e20-38521d34f5c8 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:35.929837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05cc40-2c4d-483a-9e20-38521d34f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:35.929837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05cc40-2c4d-483a-9e20-38521d34f5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:35.934841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-eb54f103-fa05-446a-a052-09672ddcf876 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:35.936461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-eb54f103-fa05-446a-a052-09672ddcf876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:35.945372 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 769/1540] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:35.955318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401e9bc-1ada-427f-9bcf-4d450950fcb4 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:35.959174 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401e9bc-1ada-427f-9bcf-4d450950fcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:35.959759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401e9bc-1ada-427f-9bcf-4d450950fcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:35.963031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-bf05cc40-2c4d-483a-9e20-38521d34f5c8 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:35.966200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-bf05cc40-2c4d-483a-9e20-38521d34f5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:35.992412 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 772/1541] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 08 06:46:36.004729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91310ca4-2dd9-4b82-b658-4d4ea1c70285 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.005356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91310ca4-2dd9-4b82-b658-4d4ea1c70285 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.005887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91310ca4-2dd9-4b82-b658-4d4ea1c70285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.010694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-3401e9bc-1ada-427f-9bcf-4d450950fcb4 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.019041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3401e9bc-1ada-427f-9bcf-4d450950fcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.035099 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 770/1542] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.042990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-91310ca4-2dd9-4b82-b658-4d4ea1c70285 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.044461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-91310ca4-2dd9-4b82-b658-4d4ea1c70285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.052788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 773/1543] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.059456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401e9bc-1ada-427f-9bcf-4d450950fcb4 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.067286 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91310ca4-2dd9-4b82-b658-4d4ea1c70285 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.069567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401e9bc-1ada-427f-9bcf-4d450950fcb4 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.074946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55d524-4a99-4ef3-a7a3-b1fee48f0a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.075877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55d524-4a99-4ef3-a7a3-b1fee48f0a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.076394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55d524-4a99-4ef3-a7a3-b1fee48f0a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.076885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55d524-4a99-4ef3-a7a3-b1fee48f0a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.077822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55d524-4a99-4ef3-a7a3-b1fee48f0a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:46:36.082495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55d524-4a99-4ef3-a7a3-b1fee48f0a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.084368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55d524-4a99-4ef3-a7a3-b1fee48f0a12 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.085241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91310ca4-2dd9-4b82-b658-4d4ea1c70285 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.105279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c5b95-c9be-40f3-90f6-950437b6e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.105963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c5b95-c9be-40f3-90f6-950437b6e161 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.106313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 771/1544] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:46:36.108474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c5b95-c9be-40f3-90f6-950437b6e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.108474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c5b95-c9be-40f3-90f6-950437b6e161 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.108474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c5b95-c9be-40f3-90f6-950437b6e161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:46:36.108474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c5b95-c9be-40f3-90f6-950437b6e161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.109053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: WARNING py.warnings [None req-060c5b95-c9be-40f3-90f6-950437b6e161 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:46:36.109053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: warnings.warn(msg) Jun 08 06:46:36.109053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: Jun 08 06:46:36.109943 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c5b95-c9be-40f3-90f6-950437b6e161 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.115910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55d524-4a99-4ef3-a7a3-b1fee48f0a12 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.133233 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 774/1545] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:46:36.135247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55d524-4a99-4ef3-a7a3-b1fee48f0a12 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.140698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61979e09-9097-4300-8fe4-1e526decacac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.141465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c5b95-c9be-40f3-90f6-950437b6e161 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.142034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979e09-9097-4300-8fe4-1e526decacac admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.142557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979e09-9097-4300-8fe4-1e526decacac admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.143069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979e09-9097-4300-8fe4-1e526decacac admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.144902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61979e09-9097-4300-8fe4-1e526decacac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.146154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: WARNING py.warnings [None req-61979e09-9097-4300-8fe4-1e526decacac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:46:36.146154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: warnings.warn(msg) Jun 08 06:46:36.146154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: Jun 08 06:46:36.151940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61979e09-9097-4300-8fe4-1e526decacac admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.161997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c5b95-c9be-40f3-90f6-950437b6e161 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.171913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e47deb-53d1-4cc4-a86d-301e2abe2dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.172592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e47deb-53d1-4cc4-a86d-301e2abe2dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.172871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e47deb-53d1-4cc4-a86d-301e2abe2dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.173147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e47deb-53d1-4cc4-a86d-301e2abe2dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.173843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e47deb-53d1-4cc4-a86d-301e2abe2dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.175766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e47deb-53d1-4cc4-a86d-301e2abe2dfe admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.300458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 772/1546] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:46:36.302117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc501-44bc-4ee8-ab4e-25089ab77780 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.302433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc501-44bc-4ee8-ab4e-25089ab77780 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.302712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc501-44bc-4ee8-ab4e-25089ab77780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.323556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a4adc501-44bc-4ee8-ab4e-25089ab77780 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.324904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a4adc501-44bc-4ee8-ab4e-25089ab77780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.330192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 775/1547] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:46:36.331499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544db76-f185-4448-852b-afa077962f33 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.333515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544db76-f185-4448-852b-afa077962f33 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.333515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544db76-f185-4448-852b-afa077962f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.350505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e544db76-f185-4448-852b-afa077962f33 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.351692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e544db76-f185-4448-852b-afa077962f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.385510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 773/1548] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.386834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5132fe-ab1f-438c-8710-68e208b63a70 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.387118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5132fe-ab1f-438c-8710-68e208b63a70 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.387388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5132fe-ab1f-438c-8710-68e208b63a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.405372 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-3f5132fe-ab1f-438c-8710-68e208b63a70 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.406623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3f5132fe-ab1f-438c-8710-68e208b63a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.425072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 776/1549] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.425072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ee0bf-96c8-4484-a348-c0a530750c36 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.425072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ee0bf-96c8-4484-a348-c0a530750c36 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.425072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ee0bf-96c8-4484-a348-c0a530750c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.437451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-661ee0bf-96c8-4484-a348-c0a530750c36 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.438682 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-661ee0bf-96c8-4484-a348-c0a530750c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.447765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 777/1550] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.448968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee288a76-784c-491c-9bd0-b6c5625942b6 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.449258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee288a76-784c-491c-9bd0-b6c5625942b6 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.449534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee288a76-784c-491c-9bd0-b6c5625942b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.468212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-ee288a76-784c-491c-9bd0-b6c5625942b6 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.469380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ee288a76-784c-491c-9bd0-b6c5625942b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.470578 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 774/1551] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.471314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5132fe-ab1f-438c-8710-68e208b63a70 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.477781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 778/1552] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.479045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59accb23-d01e-455c-8fb6-4cd18e52d0a1 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.479334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59accb23-d01e-455c-8fb6-4cd18e52d0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.479613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59accb23-d01e-455c-8fb6-4cd18e52d0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.486476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5132fe-ab1f-438c-8710-68e208b63a70 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.491107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd75f0-af10-410d-8345-5533dbb1268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.491817 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd75f0-af10-410d-8345-5533dbb1268b admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.492213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd75f0-af10-410d-8345-5533dbb1268b admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.492518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd75f0-af10-410d-8345-5533dbb1268b admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.493410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd75f0-af10-410d-8345-5533dbb1268b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.495364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd75f0-af10-410d-8345-5533dbb1268b admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.496688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-59accb23-d01e-455c-8fb6-4cd18e52d0a1 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.497851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-59accb23-d01e-455c-8fb6-4cd18e52d0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.506042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 779/1553] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.507500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59accb23-d01e-455c-8fb6-4cd18e52d0a1 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.517009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59accb23-d01e-455c-8fb6-4cd18e52d0a1 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.521697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68e54d-9056-40b5-a8f7-c6126ba2635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.522380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68e54d-9056-40b5-a8f7-c6126ba2635f admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.522668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68e54d-9056-40b5-a8f7-c6126ba2635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.522946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68e54d-9056-40b5-a8f7-c6126ba2635f admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.523628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68e54d-9056-40b5-a8f7-c6126ba2635f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.525295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: WARNING py.warnings [None req-be68e54d-9056-40b5-a8f7-c6126ba2635f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:46:36.525295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: warnings.warn(msg) Jun 08 06:46:36.525295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: Jun 08 06:46:36.526520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68e54d-9056-40b5-a8f7-c6126ba2635f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.610438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 775/1554] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:36.610438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f59a-4866-4f95-a757-6742ce5489a1 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.610438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f59a-4866-4f95-a757-6742ce5489a1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.610438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f59a-4866-4f95-a757-6742ce5489a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.628430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9ca0f59a-4866-4f95-a757-6742ce5489a1 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.629625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9ca0f59a-4866-4f95-a757-6742ce5489a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.639549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 776/1555] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.640810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c8eb5-d50a-4025-a584-2ee74e8d1f7f None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.641098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c8eb5-d50a-4025-a584-2ee74e8d1f7f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.641382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c8eb5-d50a-4025-a584-2ee74e8d1f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.643816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 780/1556] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:36.648726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08cdf-addc-4a3b-bb9c-91fd4fccd0d5 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.648726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08cdf-addc-4a3b-bb9c-91fd4fccd0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.648726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08cdf-addc-4a3b-bb9c-91fd4fccd0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.662006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-836c8eb5-d50a-4025-a584-2ee74e8d1f7f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.663256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-836c8eb5-d50a-4025-a584-2ee74e8d1f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.664303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-bde08cdf-addc-4a3b-bb9c-91fd4fccd0d5 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.665651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-bde08cdf-addc-4a3b-bb9c-91fd4fccd0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.671140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 777/1557] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.675166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c31432-90a5-48eb-a73b-96e30acf7546 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.675166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c31432-90a5-48eb-a73b-96e30acf7546 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.675166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c31432-90a5-48eb-a73b-96e30acf7546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.675510 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 781/1558] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.675510 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c150d-6b63-4d79-8aa1-b79f13c5ff93 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.675510 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c150d-6b63-4d79-8aa1-b79f13c5ff93 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.675727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c150d-6b63-4d79-8aa1-b79f13c5ff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.695238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-499c150d-6b63-4d79-8aa1-b79f13c5ff93 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.697055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-499c150d-6b63-4d79-8aa1-b79f13c5ff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.698447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-91c31432-90a5-48eb-a73b-96e30acf7546 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.699779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-91c31432-90a5-48eb-a73b-96e30acf7546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.706395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 782/1559] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.709987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fec35-5e60-4cee-86d5-9356def95c3a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.709987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fec35-5e60-4cee-86d5-9356def95c3a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.709987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fec35-5e60-4cee-86d5-9356def95c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.715202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 778/1560] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.715202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c31432-90a5-48eb-a73b-96e30acf7546 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.721626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c31432-90a5-48eb-a73b-96e30acf7546 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.726098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbf9c5-04e1-45cd-b88b-4123ed13ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.726784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf9c5-04e1-45cd-b88b-4123ed13ead0 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.727212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf9c5-04e1-45cd-b88b-4123ed13ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.727395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c74fec35-5e60-4cee-86d5-9356def95c3a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:36.727508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf9c5-04e1-45cd-b88b-4123ed13ead0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.728213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbf9c5-04e1-45cd-b88b-4123ed13ead0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.728582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c74fec35-5e60-4cee-86d5-9356def95c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:36.729788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbf9c5-04e1-45cd-b88b-4123ed13ead0 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.736390 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 783/1561] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:36.737161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fec35-5e60-4cee-86d5-9356def95c3a None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.743642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 779/1562] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:36.743642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbf9c5-04e1-45cd-b88b-4123ed13ead0 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.748346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:36.749010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fec35-5e60-4cee-86d5-9356def95c3a None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.751879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbf9c5-04e1-45cd-b88b-4123ed13ead0 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.753551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1c2b1-a38a-4bad-9e27-e4db57946b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.759750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1c2b1-a38a-4bad-9e27-e4db57946b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.759750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1c2b1-a38a-4bad-9e27-e4db57946b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.759750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1c2b1-a38a-4bad-9e27-e4db57946b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.759750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1c2b1-a38a-4bad-9e27-e4db57946b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:46:36.759750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1c2b1-a38a-4bad-9e27-e4db57946b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.760240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799b878-e28a-43bf-9d92-0b9ec57d4bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.760240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799b878-e28a-43bf-9d92-0b9ec57d4bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.760431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1c2b1-a38a-4bad-9e27-e4db57946b29 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.760517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799b878-e28a-43bf-9d92-0b9ec57d4bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.760517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799b878-e28a-43bf-9d92-0b9ec57d4bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.760517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799b878-e28a-43bf-9d92-0b9ec57d4bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.760731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799b878-e28a-43bf-9d92-0b9ec57d4bf5 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.769581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 784/1563] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:46:36.770565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1c2b1-a38a-4bad-9e27-e4db57946b29 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.770705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 780/1564] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:36.771441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799b878-e28a-43bf-9d92-0b9ec57d4bf5 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.781618 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799b878-e28a-43bf-9d92-0b9ec57d4bf5 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.782975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1c2b1-a38a-4bad-9e27-e4db57946b29 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.786275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacaee1-8c43-42aa-9808-321fb1ad74a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.790175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacaee1-8c43-42aa-9808-321fb1ad74a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.790175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacaee1-8c43-42aa-9808-321fb1ad74a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.790175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacaee1-8c43-42aa-9808-321fb1ad74a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.790589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340910af-d04e-4a11-81ae-97b3d64370c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.790589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340910af-d04e-4a11-81ae-97b3d64370c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.790799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacaee1-8c43-42aa-9808-321fb1ad74a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:46:36.790896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340910af-d04e-4a11-81ae-97b3d64370c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.790982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacaee1-8c43-42aa-9808-321fb1ad74a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.791075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340910af-d04e-4a11-81ae-97b3d64370c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.791075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340910af-d04e-4a11-81ae-97b3d64370c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:46:36.791075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340910af-d04e-4a11-81ae-97b3d64370c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.791335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacaee1-8c43-42aa-9808-321fb1ad74a6 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.791472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340910af-d04e-4a11-81ae-97b3d64370c6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.802608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 781/1565] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:46:36.803348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 785/1566] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:46:36.804139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340910af-d04e-4a11-81ae-97b3d64370c6 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.808605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacaee1-8c43-42aa-9808-321fb1ad74a6 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.819443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacaee1-8c43-42aa-9808-321fb1ad74a6 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.819599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340910af-d04e-4a11-81ae-97b3d64370c6 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.824821 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4d4d-f6ff-4905-b1dc-0daec2a73257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.824986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b686-4b2c-48f1-93be-0abbdfdee254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.825463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4d4d-f6ff-4905-b1dc-0daec2a73257 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.825573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b686-4b2c-48f1-93be-0abbdfdee254 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.825742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4d4d-f6ff-4905-b1dc-0daec2a73257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.825845 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b686-4b2c-48f1-93be-0abbdfdee254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.826020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4d4d-f6ff-4905-b1dc-0daec2a73257 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.826134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b686-4b2c-48f1-93be-0abbdfdee254 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.826777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e4d4d-f6ff-4905-b1dc-0daec2a73257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:46:36.826899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2b686-4b2c-48f1-93be-0abbdfdee254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:46:36.827075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e4d4d-f6ff-4905-b1dc-0daec2a73257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.827207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2b686-4b2c-48f1-93be-0abbdfdee254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.828642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e4d4d-f6ff-4905-b1dc-0daec2a73257 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.828790 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2b686-4b2c-48f1-93be-0abbdfdee254 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.840263 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 782/1567] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:46:36.841189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4d4d-f6ff-4905-b1dc-0daec2a73257 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.846354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 786/1568] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:46:36.847754 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b686-4b2c-48f1-93be-0abbdfdee254 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.851129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4d4d-f6ff-4905-b1dc-0daec2a73257 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.855780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571e5f-6afc-4d5e-9ea6-4227817d8129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.856410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571e5f-6afc-4d5e-9ea6-4227817d8129 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.856690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571e5f-6afc-4d5e-9ea6-4227817d8129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.857106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571e5f-6afc-4d5e-9ea6-4227817d8129 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.857333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b686-4b2c-48f1-93be-0abbdfdee254 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.857830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571e5f-6afc-4d5e-9ea6-4227817d8129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:46:36.858132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571e5f-6afc-4d5e-9ea6-4227817d8129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.859718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571e5f-6afc-4d5e-9ea6-4227817d8129 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.861956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de543-26d0-43c9-a613-ef3468dbb59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.862637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de543-26d0-43c9-a613-ef3468dbb59b admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.862923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de543-26d0-43c9-a613-ef3468dbb59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.863204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de543-26d0-43c9-a613-ef3468dbb59b admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.863929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1de543-26d0-43c9-a613-ef3468dbb59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.865503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1de543-26d0-43c9-a613-ef3468dbb59b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.873504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 783/1569] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:46:36.874503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571e5f-6afc-4d5e-9ea6-4227817d8129 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.876502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 787/1570] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:36.877298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de543-26d0-43c9-a613-ef3468dbb59b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.885463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571e5f-6afc-4d5e-9ea6-4227817d8129 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.887322 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:36.890519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed7c3-eb82-46ac-857e-3e93146fe38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.891073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de543-26d0-43c9-a613-ef3468dbb59b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.891193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed7c3-eb82-46ac-857e-3e93146fe38c admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.891432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed7c3-eb82-46ac-857e-3e93146fe38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.891709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed7c3-eb82-46ac-857e-3e93146fe38c admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.892390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eed7c3-eb82-46ac-857e-3e93146fe38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.894331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eed7c3-eb82-46ac-857e-3e93146fe38c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.898915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6855a-8ffd-40a7-9ce0-115518b7cb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.898915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6855a-8ffd-40a7-9ce0-115518b7cb91 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.898915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6855a-8ffd-40a7-9ce0-115518b7cb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.898915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6855a-8ffd-40a7-9ce0-115518b7cb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.899298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6855a-8ffd-40a7-9ce0-115518b7cb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.899298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6855a-8ffd-40a7-9ce0-115518b7cb91 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.909174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 788/1571] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:36.910098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6855a-8ffd-40a7-9ce0-115518b7cb91 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:36.920500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6855a-8ffd-40a7-9ce0-115518b7cb91 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:36.924931 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fccecb-d0e0-43a5-8ae0-86590654240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:36.925627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fccecb-d0e0-43a5-8ae0-86590654240e admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:36.925908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fccecb-d0e0-43a5-8ae0-86590654240e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:36.926181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fccecb-d0e0-43a5-8ae0-86590654240e admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:36.926887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fccecb-d0e0-43a5-8ae0-86590654240e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:36.928733 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fccecb-d0e0-43a5-8ae0-86590654240e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:36.991385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 784/1572] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:36.992336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed7c3-eb82-46ac-857e-3e93146fe38c admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.010319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 789/1573] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:37.011724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fccecb-d0e0-43a5-8ae0-86590654240e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.059500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed7c3-eb82-46ac-857e-3e93146fe38c admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.077667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fccecb-d0e0-43a5-8ae0-86590654240e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.082520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a1ee3-9b77-469a-b6e4-e78d6a994c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.083171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a1ee3-9b77-469a-b6e4-e78d6a994c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.083458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a1ee3-9b77-469a-b6e4-e78d6a994c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.083735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a1ee3-9b77-469a-b6e4-e78d6a994c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.084415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a1ee3-9b77-469a-b6e4-e78d6a994c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.086346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a1ee3-9b77-469a-b6e4-e78d6a994c72 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:37.116018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00803c-d5d6-4269-b597-3959840b7d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.119920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00803c-d5d6-4269-b597-3959840b7d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.119920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00803c-d5d6-4269-b597-3959840b7d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.119920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00803c-d5d6-4269-b597-3959840b7d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.119920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00803c-d5d6-4269-b597-3959840b7d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.120452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00803c-d5d6-4269-b597-3959840b7d2e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:37.203602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 790/1574] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:37 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:37.204503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a1ee3-9b77-469a-b6e4-e78d6a994c72 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.226284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 785/1575] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:36 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:37.227730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00803c-d5d6-4269-b597-3959840b7d2e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.254967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:37.266408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a1ee3-9b77-469a-b6e4-e78d6a994c72 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.293588 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00803c-d5d6-4269-b597-3959840b7d2e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.298287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b66ca-2101-4d0a-a4f3-5977b55d2ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.299179 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b66ca-2101-4d0a-a4f3-5977b55d2ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.299462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b66ca-2101-4d0a-a4f3-5977b55d2ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.299733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b66ca-2101-4d0a-a4f3-5977b55d2ca3 admin admin] PATH_INFO: `/v3/projects/573ff4baad10445dac71f2889c2ec6bf/users/fda3862bb0834113bea7e9fc3265b7dc/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.315261 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b66ca-2101-4d0a-a4f3-5977b55d2ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573ff4baad10445dac71f2889c2ec6bf, user_id=fda3862bb0834113bea7e9fc3265b7dc, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.316300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: WARNING py.warnings [None req-5b9b66ca-2101-4d0a-a4f3-5977b55d2ca3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:46:37.316300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: warnings.warn(msg) Jun 08 06:46:37.316300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: Jun 08 06:46:37.318258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b66ca-2101-4d0a-a4f3-5977b55d2ca3 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:37.324058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90902f70-7e44-493c-a290-c77d3def123f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.324724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90902f70-7e44-493c-a290-c77d3def123f admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.325006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90902f70-7e44-493c-a290-c77d3def123f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.325281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90902f70-7e44-493c-a290-c77d3def123f admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.326050 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90902f70-7e44-493c-a290-c77d3def123f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.328031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90902f70-7e44-493c-a290-c77d3def123f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:37.335946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:37.419798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 786/1576] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:37 2022] PUT /identity/v3/projects/573ff4baad10445dac71f2889c2ec6bf/users/fda3862bb0834113bea7e9fc3265b7dc/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:37.439567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b66ca-2101-4d0a-a4f3-5977b55d2ca3 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.447234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 791/1577] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:37 2022] POST /identity/v3/projects => generated 365 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:37.448400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90902f70-7e44-493c-a290-c77d3def123f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.487546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b66ca-2101-4d0a-a4f3-5977b55d2ca3 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.509480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90902f70-7e44-493c-a290-c77d3def123f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.514255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da612a-534c-421a-89f3-22e544c6c1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.515146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da612a-534c-421a-89f3-22e544c6c1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.515425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da612a-534c-421a-89f3-22e544c6c1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.515703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da612a-534c-421a-89f3-22e544c6c1d9 admin admin] PATH_INFO: `/v3/projects/7f796b1b89134bd4b26da60df1bb5353/users/cc861f1c354f45b09cb61fd86245a5cf/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.530701 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da612a-534c-421a-89f3-22e544c6c1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f796b1b89134bd4b26da60df1bb5353, user_id=cc861f1c354f45b09cb61fd86245a5cf, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.533471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da612a-534c-421a-89f3-22e544c6c1d9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:37.544300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd632207-82e0-4ef6-90aa-ecab6bb4db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.545009 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd632207-82e0-4ef6-90aa-ecab6bb4db63 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.545411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd632207-82e0-4ef6-90aa-ecab6bb4db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.545693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd632207-82e0-4ef6-90aa-ecab6bb4db63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.546444 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd632207-82e0-4ef6-90aa-ecab6bb4db63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.551818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd632207-82e0-4ef6-90aa-ecab6bb4db63 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:37.607737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 792/1578] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:37 2022] PUT /identity/v3/projects/7f796b1b89134bd4b26da60df1bb5353/users/cc861f1c354f45b09cb61fd86245a5cf/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:37.608530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da612a-534c-421a-89f3-22e544c6c1d9 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.635483 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 787/1579] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:37 2022] POST /identity/v3/projects => generated 389 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:37.638880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd632207-82e0-4ef6-90aa-ecab6bb4db63 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.671299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da612a-534c-421a-89f3-22e544c6c1d9 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.680757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:37.700144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd632207-82e0-4ef6-90aa-ecab6bb4db63 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.704752 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04275cf-b370-449e-803c-c24a13713765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.705398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04275cf-b370-449e-803c-c24a13713765 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.705678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04275cf-b370-449e-803c-c24a13713765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.705956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04275cf-b370-449e-803c-c24a13713765 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.706661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04275cf-b370-449e-803c-c24a13713765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.708607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04275cf-b370-449e-803c-c24a13713765 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:37.727500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90069de-df83-4ac6-af91-a6304e3370cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.728187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90069de-df83-4ac6-af91-a6304e3370cc admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.728459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90069de-df83-4ac6-af91-a6304e3370cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.728736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90069de-df83-4ac6-af91-a6304e3370cc admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.729451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90069de-df83-4ac6-af91-a6304e3370cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.731438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90069de-df83-4ac6-af91-a6304e3370cc admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:37.801148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 788/1580] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:37 2022] POST /identity/v3/users => generated 303 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:37.801950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04275cf-b370-449e-803c-c24a13713765 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.811445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04275cf-b370-449e-803c-c24a13713765 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.815847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a080d3f-cd45-4534-b271-de2d36f95b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.816472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a080d3f-cd45-4534-b271-de2d36f95b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.816774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a080d3f-cd45-4534-b271-de2d36f95b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.817042 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a080d3f-cd45-4534-b271-de2d36f95b7c admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.817709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a080d3f-cd45-4534-b271-de2d36f95b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.819617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a080d3f-cd45-4534-b271-de2d36f95b7c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:37.825188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 793/1581] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:37 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:37.826386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90069de-df83-4ac6-af91-a6304e3370cc admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.837229 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90069de-df83-4ac6-af91-a6304e3370cc admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.841827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c0cfe-958a-4fee-bdc9-d732648dff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.842508 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c0cfe-958a-4fee-bdc9-d732648dff61 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.842797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c0cfe-958a-4fee-bdc9-d732648dff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.843076 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c0cfe-958a-4fee-bdc9-d732648dff61 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.843756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c0cfe-958a-4fee-bdc9-d732648dff61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.845662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c0cfe-958a-4fee-bdc9-d732648dff61 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:37.853185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:37.924430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 789/1582] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:37 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:37.924641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 794/1583] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:37 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:37.924641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c0cfe-958a-4fee-bdc9-d732648dff61 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.924843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de1bed-7619-4b25-8351-8d29bdb36529 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.924843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de1bed-7619-4b25-8351-8d29bdb36529 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.924843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de1bed-7619-4b25-8351-8d29bdb36529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.933584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c0cfe-958a-4fee-bdc9-d732648dff61 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.938298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c30986-ff0e-41a3-8183-7ed10f545758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.938964 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c30986-ff0e-41a3-8183-7ed10f545758 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.939251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c30986-ff0e-41a3-8183-7ed10f545758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.939530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c30986-ff0e-41a3-8183-7ed10f545758 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.940339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c30986-ff0e-41a3-8183-7ed10f545758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.942272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c30986-ff0e-41a3-8183-7ed10f545758 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:37.942475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-e8de1bed-7619-4b25-8351-8d29bdb36529 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:37.943773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e8de1bed-7619-4b25-8351-8d29bdb36529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:37.952207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 790/1584] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:37.953504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060436-09ec-4e16-8148-052392272252 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.953783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060436-09ec-4e16-8148-052392272252 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.954054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060436-09ec-4e16-8148-052392272252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.971895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-1c060436-09ec-4e16-8148-052392272252 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:37.973051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1c060436-09ec-4e16-8148-052392272252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:37.980711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 791/1585] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:37.981506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c060436-09ec-4e16-8148-052392272252 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:37.990684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c060436-09ec-4e16-8148-052392272252 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:37.995151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8999a-d5ab-4a0c-92c2-d51f78f15328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:37.995784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8999a-d5ab-4a0c-92c2-d51f78f15328 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:37.996052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8999a-d5ab-4a0c-92c2-d51f78f15328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:37.996321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8999a-d5ab-4a0c-92c2-d51f78f15328 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:37.996993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8999a-d5ab-4a0c-92c2-d51f78f15328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:37.998918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8999a-d5ab-4a0c-92c2-d51f78f15328 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.024968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 795/1586] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:37 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:38.025803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c30986-ff0e-41a3-8183-7ed10f545758 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.035065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c30986-ff0e-41a3-8183-7ed10f545758 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.042059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f46c8-156b-41f1-a2eb-01f5b9b8eba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.042059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f46c8-156b-41f1-a2eb-01f5b9b8eba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.042059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f46c8-156b-41f1-a2eb-01f5b9b8eba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.042059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f46c8-156b-41f1-a2eb-01f5b9b8eba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.042491 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f46c8-156b-41f1-a2eb-01f5b9b8eba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.043035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f46c8-156b-41f1-a2eb-01f5b9b8eba4 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.053414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 796/1587] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.054119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f46c8-156b-41f1-a2eb-01f5b9b8eba4 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.063782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f46c8-156b-41f1-a2eb-01f5b9b8eba4 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.068308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085d84-a129-4501-bc53-8a7256278345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.068890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085d84-a129-4501-bc53-8a7256278345 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.069176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085d84-a129-4501-bc53-8a7256278345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.069453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085d84-a129-4501-bc53-8a7256278345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.070143 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56085d84-a129-4501-bc53-8a7256278345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.072297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56085d84-a129-4501-bc53-8a7256278345 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.082087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 797/1588] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.082866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085d84-a129-4501-bc53-8a7256278345 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.092088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085d84-a129-4501-bc53-8a7256278345 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.096147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 792/1589] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:37 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:38.096147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8999a-d5ab-4a0c-92c2-d51f78f15328 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.099042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca012dd1-b017-426d-9fc5-e9c8251e3a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.099682 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca012dd1-b017-426d-9fc5-e9c8251e3a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.099972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca012dd1-b017-426d-9fc5-e9c8251e3a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.100251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca012dd1-b017-426d-9fc5-e9c8251e3a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.100971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca012dd1-b017-426d-9fc5-e9c8251e3a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.102603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca012dd1-b017-426d-9fc5-e9c8251e3a9e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.103584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8999a-d5ab-4a0c-92c2-d51f78f15328 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.114456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ea47f-206f-4331-90c1-6b1307245c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.114456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea47f-206f-4331-90c1-6b1307245c76 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.114456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea47f-206f-4331-90c1-6b1307245c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.114456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea47f-206f-4331-90c1-6b1307245c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.114818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ea47f-206f-4331-90c1-6b1307245c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.114818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ea47f-206f-4331-90c1-6b1307245c76 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.114963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 798/1590] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.114963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca012dd1-b017-426d-9fc5-e9c8251e3a9e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.125675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 793/1591] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.126865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ea47f-206f-4331-90c1-6b1307245c76 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.175582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca012dd1-b017-426d-9fc5-e9c8251e3a9e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.179127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf0803-4573-4a81-90d6-a637f4d5880e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.179766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0803-4573-4a81-90d6-a637f4d5880e service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.180046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0803-4573-4a81-90d6-a637f4d5880e service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.180832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0803-4573-4a81-90d6-a637f4d5880e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.182364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ea47f-206f-4331-90c1-6b1307245c76 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.186010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe3c98-0666-4bae-a8a6-c54fbed379cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.186689 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe3c98-0666-4bae-a8a6-c54fbed379cc service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.186974 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe3c98-0666-4bae-a8a6-c54fbed379cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.187252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe3c98-0666-4bae-a8a6-c54fbed379cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.189614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf0803-4573-4a81-90d6-a637f4d5880e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.191051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf0803-4573-4a81-90d6-a637f4d5880e service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.197258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe3c98-0666-4bae-a8a6-c54fbed379cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.199031 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe3c98-0666-4bae-a8a6-c54fbed379cc service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.201306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 799/1592] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:38.202092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf0803-4573-4a81-90d6-a637f4d5880e service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.209204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 794/1593] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:38.210089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe3c98-0666-4bae-a8a6-c54fbed379cc service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.210808 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf0803-4573-4a81-90d6-a637f4d5880e service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.215434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e07174-de10-445b-8077-6663fb3551c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.216077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e07174-de10-445b-8077-6663fb3551c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.216356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e07174-de10-445b-8077-6663fb3551c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.216630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e07174-de10-445b-8077-6663fb3551c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.217377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e07174-de10-445b-8077-6663fb3551c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.218997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e07174-de10-445b-8077-6663fb3551c9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.219404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe3c98-0666-4bae-a8a6-c54fbed379cc service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.224326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c438f-7e3c-4362-9db8-d4d41656baef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.225083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c438f-7e3c-4362-9db8-d4d41656baef admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.225250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c438f-7e3c-4362-9db8-d4d41656baef admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.225570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c438f-7e3c-4362-9db8-d4d41656baef admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.226365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c438f-7e3c-4362-9db8-d4d41656baef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.227883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c438f-7e3c-4362-9db8-d4d41656baef admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.229987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 800/1594] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.233495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e07174-de10-445b-8077-6663fb3551c9 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.238373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 795/1595] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.239043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c438f-7e3c-4362-9db8-d4d41656baef admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.247211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e07174-de10-445b-8077-6663fb3551c9 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.249168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c438f-7e3c-4362-9db8-d4d41656baef admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.251933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d4f61-3d59-4c0d-821c-13e28e104f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.252593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d4f61-3d59-4c0d-821c-13e28e104f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.253112 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d4f61-3d59-4c0d-821c-13e28e104f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.253112 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d4f61-3d59-4c0d-821c-13e28e104f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.253800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfbb07-ed4d-43e6-bb8a-01d637949980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.253939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d4f61-3d59-4c0d-821c-13e28e104f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.254607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfbb07-ed4d-43e6-bb8a-01d637949980 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.254887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfbb07-ed4d-43e6-bb8a-01d637949980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.255236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfbb07-ed4d-43e6-bb8a-01d637949980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.255458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d4f61-3d59-4c0d-821c-13e28e104f42 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.255950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfbb07-ed4d-43e6-bb8a-01d637949980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.257506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfbb07-ed4d-43e6-bb8a-01d637949980 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.266178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 801/1596] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.266870 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d4f61-3d59-4c0d-821c-13e28e104f42 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.271202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 796/1597] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.271202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfbb07-ed4d-43e6-bb8a-01d637949980 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.277955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d4f61-3d59-4c0d-821c-13e28e104f42 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.278430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfbb07-ed4d-43e6-bb8a-01d637949980 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.282940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a7282-88e1-46eb-b13b-ff399399ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.283124 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438911e2-4aaa-4978-9c5d-09d94c3c435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.283571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a7282-88e1-46eb-b13b-ff399399ca70 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.283678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438911e2-4aaa-4978-9c5d-09d94c3c435f admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.283854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a7282-88e1-46eb-b13b-ff399399ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.283973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438911e2-4aaa-4978-9c5d-09d94c3c435f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.284139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a7282-88e1-46eb-b13b-ff399399ca70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.284358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438911e2-4aaa-4978-9c5d-09d94c3c435f admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.284879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a7282-88e1-46eb-b13b-ff399399ca70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.285088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438911e2-4aaa-4978-9c5d-09d94c3c435f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.286539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a7282-88e1-46eb-b13b-ff399399ca70 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.288987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438911e2-4aaa-4978-9c5d-09d94c3c435f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.297155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 797/1598] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.297941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a7282-88e1-46eb-b13b-ff399399ca70 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.304013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 802/1599] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.304013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438911e2-4aaa-4978-9c5d-09d94c3c435f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.307861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a7282-88e1-46eb-b13b-ff399399ca70 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.312900 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c247e-dfad-48b4-8cbc-f9f883a4297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.317899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c247e-dfad-48b4-8cbc-f9f883a4297c admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.318146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438911e2-4aaa-4978-9c5d-09d94c3c435f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.318282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c247e-dfad-48b4-8cbc-f9f883a4297c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.318282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c247e-dfad-48b4-8cbc-f9f883a4297c admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.318282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c247e-dfad-48b4-8cbc-f9f883a4297c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.318282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c247e-dfad-48b4-8cbc-f9f883a4297c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.318632 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a77c3d-24d6-4ef8-a8ec-70b594b7a54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.319353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77c3d-24d6-4ef8-a8ec-70b594b7a54c admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.319919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77c3d-24d6-4ef8-a8ec-70b594b7a54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.319919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77c3d-24d6-4ef8-a8ec-70b594b7a54c admin admin] PATH_INFO: `/v3/projects/8c48ef7c823a45f0af0a268b8dc0ed1f/users/150dbc1853404960a1dc94f8c7753e9d/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.331229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 798/1600] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.332062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c247e-dfad-48b4-8cbc-f9f883a4297c admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.340029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a77c3d-24d6-4ef8-a8ec-70b594b7a54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c48ef7c823a45f0af0a268b8dc0ed1f, user_id=150dbc1853404960a1dc94f8c7753e9d, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.343001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a77c3d-24d6-4ef8-a8ec-70b594b7a54c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.343866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c247e-dfad-48b4-8cbc-f9f883a4297c admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.348596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a955b-a290-4d1a-8db0-e56bb258f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.349474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a955b-a290-4d1a-8db0-e56bb258f3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.351756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a955b-a290-4d1a-8db0-e56bb258f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.351756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a955b-a290-4d1a-8db0-e56bb258f3b1 admin admin] PATH_INFO: `/v3/projects/a1bc854f78c845ada8ace42a0541c737/users/6f2424cc1f674b19ace00e703f39b20d/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.365210 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a955b-a290-4d1a-8db0-e56bb258f3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bc854f78c845ada8ace42a0541c737, user_id=6f2424cc1f674b19ace00e703f39b20d, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.367905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a955b-a290-4d1a-8db0-e56bb258f3b1 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.435406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 803/1601] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:38 2022] PUT /identity/v3/projects/8c48ef7c823a45f0af0a268b8dc0ed1f/users/150dbc1853404960a1dc94f8c7753e9d/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:38.447652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a77c3d-24d6-4ef8-a8ec-70b594b7a54c admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.495638 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 799/1602] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:38 2022] PUT /identity/v3/projects/a1bc854f78c845ada8ace42a0541c737/users/6f2424cc1f674b19ace00e703f39b20d/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:38.496433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a955b-a290-4d1a-8db0-e56bb258f3b1 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.498107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:38.503671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:38.513282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a77c3d-24d6-4ef8-a8ec-70b594b7a54c admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.562103 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a955b-a290-4d1a-8db0-e56bb258f3b1 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.566970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25ac0-66a4-4b20-9935-f296c4eec826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.567875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25ac0-66a4-4b20-9935-f296c4eec826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.568162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25ac0-66a4-4b20-9935-f296c4eec826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.568442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25ac0-66a4-4b20-9935-f296c4eec826 admin admin] PATH_INFO: `/v3/projects/c14f83dab8e44136a5d4a6fcdfeb2c09/users/86e9decb1b4d4fe2aab6541cb70c21c8/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.574871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e53c-d0d2-401e-acd5-ae26c9a710b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.575686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e53c-d0d2-401e-acd5-ae26c9a710b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.581209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e53c-d0d2-401e-acd5-ae26c9a710b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.581209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e53c-d0d2-401e-acd5-ae26c9a710b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.581209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9e53c-d0d2-401e-acd5-ae26c9a710b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.581209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9e53c-d0d2-401e-acd5-ae26c9a710b8 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.587926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a25ac0-66a4-4b20-9935-f296c4eec826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14f83dab8e44136a5d4a6fcdfeb2c09, user_id=86e9decb1b4d4fe2aab6541cb70c21c8, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.590075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 804/1603] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:38.590744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e53c-d0d2-401e-acd5-ae26c9a710b8 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.591284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a25ac0-66a4-4b20-9935-f296c4eec826 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.600293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e53c-d0d2-401e-acd5-ae26c9a710b8 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.604914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a9d6-8cbf-4c93-9e77-3d49a66de922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.605786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a9d6-8cbf-4c93-9e77-3d49a66de922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.610368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a9d6-8cbf-4c93-9e77-3d49a66de922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.610368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a9d6-8cbf-4c93-9e77-3d49a66de922 admin admin] PATH_INFO: `/v3/projects/a2dec42b35d44d54ae9b45371d8eb4ab/users/c6523f0f4dc249659c4e63fc5ee5e783/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.623340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062a9d6-8cbf-4c93-9e77-3d49a66de922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2dec42b35d44d54ae9b45371d8eb4ab, user_id=c6523f0f4dc249659c4e63fc5ee5e783, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.626031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062a9d6-8cbf-4c93-9e77-3d49a66de922 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.684757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 800/1604] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:38 2022] PUT /identity/v3/projects/c14f83dab8e44136a5d4a6fcdfeb2c09/users/86e9decb1b4d4fe2aab6541cb70c21c8/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:38.685334 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25ac0-66a4-4b20-9935-f296c4eec826 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.709264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 805/1605] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:38 2022] PUT /identity/v3/projects/a2dec42b35d44d54ae9b45371d8eb4ab/users/c6523f0f4dc249659c4e63fc5ee5e783/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:38.712297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9697a4-f2c8-467d-95de-cd05b663e42e None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.712297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9697a4-f2c8-467d-95de-cd05b663e42e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.712297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9697a4-f2c8-467d-95de-cd05b663e42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.739617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-5f9697a4-f2c8-467d-95de-cd05b663e42e None None] MFA Rules not processed for user `150dbc1853404960a1dc94f8c7753e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:38.741093 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5f9697a4-f2c8-467d-95de-cd05b663e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:38.765763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25ac0-66a4-4b20-9935-f296c4eec826 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.825044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 806/1606] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:38.825044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c12fa7-5fb8-4731-9ae9-d836b83c4a24 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.825044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c12fa7-5fb8-4731-9ae9-d836b83c4a24 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.825391 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c12fa7-5fb8-4731-9ae9-d836b83c4a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.827934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598701b-9ec9-4d46-a60d-daa83faae254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:38.828828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598701b-9ec9-4d46-a60d-daa83faae254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.829104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598701b-9ec9-4d46-a60d-daa83faae254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.829372 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598701b-9ec9-4d46-a60d-daa83faae254 admin admin] PATH_INFO: `/v3/projects/784a5693f27a471a942c49eff8c6b60a/users/1855cc05be90464fa628e08f814dcd83/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.843786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598701b-9ec9-4d46-a60d-daa83faae254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784a5693f27a471a942c49eff8c6b60a, user_id=1855cc05be90464fa628e08f814dcd83, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:38.846454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598701b-9ec9-4d46-a60d-daa83faae254 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:38.851428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-99c12fa7-5fb8-4731-9ae9-d836b83c4a24 None None] MFA Rules not processed for user `6f2424cc1f674b19ace00e703f39b20d`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:38.855433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-99c12fa7-5fb8-4731-9ae9-d836b83c4a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:38.897987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:38.918540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 807/1607] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:38.919414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c12fa7-5fb8-4731-9ae9-d836b83c4a24 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:38.931784 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c12fa7-5fb8-4731-9ae9-d836b83c4a24 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:38.940110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 801/1608] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:38 2022] PUT /identity/v3/projects/784a5693f27a471a942c49eff8c6b60a/users/1855cc05be90464fa628e08f814dcd83/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:38.947962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73ccab-59a3-46e6-89c3-2aaf1b884bb0 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:38.947962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73ccab-59a3-46e6-89c3-2aaf1b884bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:38.947962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73ccab-59a3-46e6-89c3-2aaf1b884bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:38.984232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-7d73ccab-59a3-46e6-89c3-2aaf1b884bb0 None None] MFA Rules not processed for user `86e9decb1b4d4fe2aab6541cb70c21c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:38.985554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7d73ccab-59a3-46e6-89c3-2aaf1b884bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:38.991723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:39.012309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f9f60-0482-484b-9cf3-31ab3a2b31dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:39.013359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f9f60-0482-484b-9cf3-31ab3a2b31dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.013715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f9f60-0482-484b-9cf3-31ab3a2b31dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.014058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f9f60-0482-484b-9cf3-31ab3a2b31dc admin admin] PATH_INFO: `/v3/projects/5939bb2d7ba94aaeaf67ce4b12b5b330/users/7f7bf346718b4c61bab0fdc198af8818/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.044616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f9f60-0482-484b-9cf3-31ab3a2b31dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5939bb2d7ba94aaeaf67ce4b12b5b330, user_id=7f7bf346718b4c61bab0fdc198af8818, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:39.052198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f9f60-0482-484b-9cf3-31ab3a2b31dc admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:39.077637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 802/1609] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:39.079845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38f84e-b8ee-444c-8b4d-5bf86483880b None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.080325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38f84e-b8ee-444c-8b4d-5bf86483880b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.080777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38f84e-b8ee-444c-8b4d-5bf86483880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.116082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-4f38f84e-b8ee-444c-8b4d-5bf86483880b None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:39.118163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4f38f84e-b8ee-444c-8b4d-5bf86483880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:39.126873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 803/1610] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:39.130787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38f84e-b8ee-444c-8b4d-5bf86483880b None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:39.138038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38f84e-b8ee-444c-8b4d-5bf86483880b None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:39.142899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954f29b-a266-4c76-9d93-c4660de41630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:39.143560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954f29b-a266-4c76-9d93-c4660de41630 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.143873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954f29b-a266-4c76-9d93-c4660de41630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.144147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954f29b-a266-4c76-9d93-c4660de41630 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.144831 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954f29b-a266-4c76-9d93-c4660de41630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:39.146761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954f29b-a266-4c76-9d93-c4660de41630 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:39.157309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 808/1611] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:38 2022] PUT /identity/v3/projects/5939bb2d7ba94aaeaf67ce4b12b5b330/users/7f7bf346718b4c61bab0fdc198af8818/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:39.158210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f9f60-0482-484b-9cf3-31ab3a2b31dc admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:39.223110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f9f60-0482-484b-9cf3-31ab3a2b31dc admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:39.227600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da6b61-eae5-437b-ab6d-4fde6121f7a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:39.228443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da6b61-eae5-437b-ab6d-4fde6121f7a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.228799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da6b61-eae5-437b-ab6d-4fde6121f7a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.229189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da6b61-eae5-437b-ab6d-4fde6121f7a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.244264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 804/1612] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:39 2022] POST /identity/v3/projects => generated 405 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:39.246326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab4bd6-6fb1-47eb-9ad4-1c2599e9b4de None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.246326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab4bd6-6fb1-47eb-9ad4-1c2599e9b4de None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.246326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab4bd6-6fb1-47eb-9ad4-1c2599e9b4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.276385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9eab4bd6-6fb1-47eb-9ad4-1c2599e9b4de None None] MFA Rules not processed for user `1855cc05be90464fa628e08f814dcd83`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:39.282933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9eab4bd6-6fb1-47eb-9ad4-1c2599e9b4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:39.329496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da6b61-eae5-437b-ab6d-4fde6121f7a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:39.331883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da6b61-eae5-437b-ab6d-4fde6121f7a0 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:39.345876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 809/1613] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:39.357640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 805/1614] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:39.357640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a116-fe85-49e3-89d8-93252f1f56c9 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.357640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a116-fe85-49e3-89d8-93252f1f56c9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.357640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a116-fe85-49e3-89d8-93252f1f56c9 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.357640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 806/1615] 10.222.0.40 () {54 vars in 961 bytes} [Wed Jun 8 06:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:46:39.359822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34335448-6dd3-46c9-8d0f-ce394c8fc92d None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.360116 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34335448-6dd3-46c9-8d0f-ce394c8fc92d None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.360406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34335448-6dd3-46c9-8d0f-ce394c8fc92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.364300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a116-fe85-49e3-89d8-93252f1f56c9 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:39.386672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-34335448-6dd3-46c9-8d0f-ce394c8fc92d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:39.387954 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-34335448-6dd3-46c9-8d0f-ce394c8fc92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:39.407907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:39.455303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a116-fe85-49e3-89d8-93252f1f56c9 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:39.460797 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7eb37b-f787-4bb7-977d-aaeead2f5e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:39.461630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eb37b-f787-4bb7-977d-aaeead2f5e98 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.461982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eb37b-f787-4bb7-977d-aaeead2f5e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.462351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eb37b-f787-4bb7-977d-aaeead2f5e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.473740 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 810/1616] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:39.473740 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34335448-6dd3-46c9-8d0f-ce394c8fc92d None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:39.474022 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7eb37b-f787-4bb7-977d-aaeead2f5e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:39.483553 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7eb37b-f787-4bb7-977d-aaeead2f5e98 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:39.485729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34335448-6dd3-46c9-8d0f-ce394c8fc92d None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:39.495618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4ad6b-01e5-47c2-8644-8b6a0efbbcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:39.496596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4ad6b-01e5-47c2-8644-8b6a0efbbcc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.497072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4ad6b-01e5-47c2-8644-8b6a0efbbcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.497454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4ad6b-01e5-47c2-8644-8b6a0efbbcc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.498534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4ad6b-01e5-47c2-8644-8b6a0efbbcc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:39.500742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4ad6b-01e5-47c2-8644-8b6a0efbbcc1 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:39.504735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 807/1617] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:39.505702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7eb37b-f787-4bb7-977d-aaeead2f5e98 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:39.524737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7eb37b-f787-4bb7-977d-aaeead2f5e98 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:39.531029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fa0a2-a62d-461b-8686-8cb3350bdc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:39.531709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa0a2-a62d-461b-8686-8cb3350bdc7d admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.531997 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa0a2-a62d-461b-8686-8cb3350bdc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.532274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa0a2-a62d-461b-8686-8cb3350bdc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.533151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fa0a2-a62d-461b-8686-8cb3350bdc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:39.535362 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fa0a2-a62d-461b-8686-8cb3350bdc7d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:39.548463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:39.628254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 811/1618] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:39 2022] POST /identity/v3/users => generated 309 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:39.628254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f338cfb-85a8-4fc0-a1d4-6d34ceeaaed3 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.628254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f338cfb-85a8-4fc0-a1d4-6d34ceeaaed3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.628254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f338cfb-85a8-4fc0-a1d4-6d34ceeaaed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.647185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-6f338cfb-85a8-4fc0-a1d4-6d34ceeaaed3 None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:39.650593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6f338cfb-85a8-4fc0-a1d4-6d34ceeaaed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:39.680222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 808/1619] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:39 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:39.681791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fa0a2-a62d-461b-8686-8cb3350bdc7d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:39.723970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 812/1620] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Jun 8 06:46:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:39.727787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f338cfb-85a8-4fc0-a1d4-6d34ceeaaed3 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:39.739869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f338cfb-85a8-4fc0-a1d4-6d34ceeaaed3 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:39.785646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fa0a2-a62d-461b-8686-8cb3350bdc7d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:39.790641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916e5b7-31dd-429d-9180-3e2fe3d26986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:39.791374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916e5b7-31dd-429d-9180-3e2fe3d26986 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.791691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916e5b7-31dd-429d-9180-3e2fe3d26986 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.791972 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916e5b7-31dd-429d-9180-3e2fe3d26986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.832483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce10156-19a7-4398-b2ec-3aef5a6d086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:39.833225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce10156-19a7-4398-b2ec-3aef5a6d086b admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.833507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce10156-19a7-4398-b2ec-3aef5a6d086b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.833857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce10156-19a7-4398-b2ec-3aef5a6d086b admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.834743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce10156-19a7-4398-b2ec-3aef5a6d086b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:39.837069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce10156-19a7-4398-b2ec-3aef5a6d086b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:39.848243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 813/1621] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:39.849305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce10156-19a7-4398-b2ec-3aef5a6d086b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:39.861324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce10156-19a7-4398-b2ec-3aef5a6d086b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:39.884760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073d8c4-5b8d-421d-971c-1f12c8e6febc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:39.884760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073d8c4-5b8d-421d-971c-1f12c8e6febc admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.884760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073d8c4-5b8d-421d-971c-1f12c8e6febc admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.884760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073d8c4-5b8d-421d-971c-1f12c8e6febc admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:39.885172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073d8c4-5b8d-421d-971c-1f12c8e6febc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:39.885172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073d8c4-5b8d-421d-971c-1f12c8e6febc admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:39.887490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916e5b7-31dd-429d-9180-3e2fe3d26986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:39.889331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916e5b7-31dd-429d-9180-3e2fe3d26986 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:39.903575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 809/1622] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:39.903575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916e5b7-31dd-429d-9180-3e2fe3d26986 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:39.962641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 814/1623] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:39 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:39.963763 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073d8c4-5b8d-421d-971c-1f12c8e6febc admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:39.978413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073d8c4-5b8d-421d-971c-1f12c8e6febc admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:39.990481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595defc8-ef11-4ff1-ab08-1113212000c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:39.990481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595defc8-ef11-4ff1-ab08-1113212000c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:39.990481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595defc8-ef11-4ff1-ab08-1113212000c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:39.990481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595defc8-ef11-4ff1-ab08-1113212000c9 admin admin] PATH_INFO: `/v3/projects/5d15a108e8da4ac89233d63951762c11/users/b81c44e2ce2f4f5586b6930d07166191/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.007650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595defc8-ef11-4ff1-ab08-1113212000c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d15a108e8da4ac89233d63951762c11, user_id=b81c44e2ce2f4f5586b6930d07166191, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:40.011156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595defc8-ef11-4ff1-ab08-1113212000c9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:40.063802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916e5b7-31dd-429d-9180-3e2fe3d26986 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:40.075910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c4c7b-cf96-473f-9f56-e28d71f88916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:40.076902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c4c7b-cf96-473f-9f56-e28d71f88916 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.077341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c4c7b-cf96-473f-9f56-e28d71f88916 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.077826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c4c7b-cf96-473f-9f56-e28d71f88916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.151307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 815/1624] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:39 2022] PUT /identity/v3/projects/5d15a108e8da4ac89233d63951762c11/users/b81c44e2ce2f4f5586b6930d07166191/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:40.155886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c5287-20b7-4c4f-bc50-f1214ff221a3 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.155886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c5287-20b7-4c4f-bc50-f1214ff221a3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.155886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c5287-20b7-4c4f-bc50-f1214ff221a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.196702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c4c7b-cf96-473f-9f56-e28d71f88916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:40.199165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c4c7b-cf96-473f-9f56-e28d71f88916 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:40.202520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:40.213734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-177c5287-20b7-4c4f-bc50-f1214ff221a3 None None] MFA Rules not processed for user `fda3862bb0834113bea7e9fc3265b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:40.213734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-177c5287-20b7-4c4f-bc50-f1214ff221a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:40.217872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 810/1625] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:40.218843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c4c7b-cf96-473f-9f56-e28d71f88916 service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:40.235093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c4c7b-cf96-473f-9f56-e28d71f88916 service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:40.300359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:40.331679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 816/1626] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:40.332867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c5287-20b7-4c4f-bc50-f1214ff221a3 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:40.360403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46503725-efa0-4108-b0b2-a34e04010931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:40.360403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503725-efa0-4108-b0b2-a34e04010931 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.360403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503725-efa0-4108-b0b2-a34e04010931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.363014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503725-efa0-4108-b0b2-a34e04010931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.363896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46503725-efa0-4108-b0b2-a34e04010931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:40.368267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46503725-efa0-4108-b0b2-a34e04010931 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:40.401044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 811/1627] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:40.401044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6e1f7-f219-4ae6-814d-f5cb18b31ca3 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.405552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6e1f7-f219-4ae6-814d-f5cb18b31ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.405907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6e1f7-f219-4ae6-814d-f5cb18b31ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.443098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c6a6e1f7-f219-4ae6-814d-f5cb18b31ca3 None None] MFA Rules not processed for user `fda3862bb0834113bea7e9fc3265b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:40.444366 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c6a6e1f7-f219-4ae6-814d-f5cb18b31ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:40.487234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 812/1628] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:40.490537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6e1f7-f219-4ae6-814d-f5cb18b31ca3 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:40.503759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6e1f7-f219-4ae6-814d-f5cb18b31ca3 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:40.511886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7b8ce-770c-4697-9f91-78df55b7beca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:40.513381 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b8ce-770c-4697-9f91-78df55b7beca admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.513841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b8ce-770c-4697-9f91-78df55b7beca admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.514083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c5287-20b7-4c4f-bc50-f1214ff221a3 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:40.514476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b8ce-770c-4697-9f91-78df55b7beca admin admin] PATH_INFO: `/v3/projects/638bd385720a461faa8398431c0319c0/users/09668450414142ea81d4e79f540fecdb/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.526595 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f62b4-570d-4ad9-8ac1-21a8bdb4e537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:40.528523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f62b4-570d-4ad9-8ac1-21a8bdb4e537 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.530381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f62b4-570d-4ad9-8ac1-21a8bdb4e537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.531600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f62b4-570d-4ad9-8ac1-21a8bdb4e537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.533457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f62b4-570d-4ad9-8ac1-21a8bdb4e537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:40.537482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7b8ce-770c-4697-9f91-78df55b7beca admin admin] RBAC: Authorizing `identity:create_grant(project_id=638bd385720a461faa8398431c0319c0, user_id=09668450414142ea81d4e79f540fecdb, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:40.538199 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f62b4-570d-4ad9-8ac1-21a8bdb4e537 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:40.554018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7b8ce-770c-4697-9f91-78df55b7beca admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:40.569535 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 817/1629] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:40.574399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d03a1-e5b6-4568-8cf5-d92db87c3851 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.576663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d03a1-e5b6-4568-8cf5-d92db87c3851 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.577152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d03a1-e5b6-4568-8cf5-d92db87c3851 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.581112 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 818/1630] 10.222.0.40 () {54 vars in 961 bytes} [Wed Jun 8 06:46:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:46:40.582097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d03a1-e5b6-4568-8cf5-d92db87c3851 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:40.614479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d03a1-e5b6-4568-8cf5-d92db87c3851 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:40.624486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 813/1631] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:40 2022] PUT /identity/v3/projects/638bd385720a461faa8398431c0319c0/users/09668450414142ea81d4e79f540fecdb/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:40.627383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de522fd-f6ff-4aa9-b804-79b3b30ab175 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.627877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de522fd-f6ff-4aa9-b804-79b3b30ab175 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.628165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de522fd-f6ff-4aa9-b804-79b3b30ab175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.680940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-6de522fd-f6ff-4aa9-b804-79b3b30ab175 None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:40.683034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-6de522fd-f6ff-4aa9-b804-79b3b30ab175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:40.773093 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef06c1-ab8f-454a-b053-1836d50f42e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:40.774277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef06c1-ab8f-454a-b053-1836d50f42e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.774645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef06c1-ab8f-454a-b053-1836d50f42e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.775023 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef06c1-ab8f-454a-b053-1836d50f42e2 admin admin] PATH_INFO: `/v3/projects/5d15a108e8da4ac89233d63951762c11/users/b81c44e2ce2f4f5586b6930d07166191/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.777695 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef06c1-ab8f-454a-b053-1836d50f42e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d15a108e8da4ac89233d63951762c11, user_id=b81c44e2ce2f4f5586b6930d07166191, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:40.781102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef06c1-ab8f-454a-b053-1836d50f42e2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:40.794390 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 819/1632] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:40 2022] PUT /identity/v3/projects/5d15a108e8da4ac89233d63951762c11/users/b81c44e2ce2f4f5586b6930d07166191/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:40.795265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef06c1-ab8f-454a-b053-1836d50f42e2 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:40.835554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 814/1633] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Jun 8 06:46:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:40.837121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace7565-f5a1-4e22-9b76-f3f33bc1bbd5 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.837408 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace7565-f5a1-4e22-9b76-f3f33bc1bbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.837682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace7565-f5a1-4e22-9b76-f3f33bc1bbd5 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.839284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 815/1634] 10.222.0.40 () {54 vars in 912 bytes} [Wed Jun 8 06:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:46:40.840180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54917246-4d4d-4c38-8fe2-b59df6076714 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.840607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54917246-4d4d-4c38-8fe2-b59df6076714 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.840887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54917246-4d4d-4c38-8fe2-b59df6076714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.884504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-54917246-4d4d-4c38-8fe2-b59df6076714 None None] MFA Rules not processed for user `b81c44e2ce2f4f5586b6930d07166191`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:40.885743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-54917246-4d4d-4c38-8fe2-b59df6076714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:40.891611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef06c1-ab8f-454a-b053-1836d50f42e2 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:40.898856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09bbf9-2de1-49c5-9dc9-90c58b1b3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:40.900082 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09bbf9-2de1-49c5-9dc9-90c58b1b3128 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.900384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09bbf9-2de1-49c5-9dc9-90c58b1b3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.900671 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09bbf9-2de1-49c5-9dc9-90c58b1b3128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.901430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09bbf9-2de1-49c5-9dc9-90c58b1b3128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:40.905270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09bbf9-2de1-49c5-9dc9-90c58b1b3128 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:40.922729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 820/1635] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:40.926286 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082831e-86a6-4e33-9abd-1b82b16151e0 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:40.926585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082831e-86a6-4e33-9abd-1b82b16151e0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:40.926872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082831e-86a6-4e33-9abd-1b82b16151e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:40.954411 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-7082831e-86a6-4e33-9abd-1b82b16151e0 None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:40.955901 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-7082831e-86a6-4e33-9abd-1b82b16151e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:40.987811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 816/1636] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:40.994523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54917246-4d4d-4c38-8fe2-b59df6076714 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:41.034489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 821/1637] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:46:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:41.035249 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082831e-86a6-4e33-9abd-1b82b16151e0 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:41.051524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082831e-86a6-4e33-9abd-1b82b16151e0 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:41.062029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2c1bf-7a78-4fb3-aa01-bfd2c6f6f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:41.063120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2c1bf-7a78-4fb3-aa01-bfd2c6f6f490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:41.063413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2c1bf-7a78-4fb3-aa01-bfd2c6f6f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:41.063783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2c1bf-7a78-4fb3-aa01-bfd2c6f6f490 admin admin] PATH_INFO: `/v3/projects/638bd385720a461faa8398431c0319c0/users/09668450414142ea81d4e79f540fecdb/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:41.067162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2c1bf-7a78-4fb3-aa01-bfd2c6f6f490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638bd385720a461faa8398431c0319c0, user_id=09668450414142ea81d4e79f540fecdb, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:41.071789 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2c1bf-7a78-4fb3-aa01-bfd2c6f6f490 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:41.089816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 822/1638] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:41 2022] PUT /identity/v3/projects/638bd385720a461faa8398431c0319c0/users/09668450414142ea81d4e79f540fecdb/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:41.089816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2c1bf-7a78-4fb3-aa01-bfd2c6f6f490 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:41.118470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:41.135415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54917246-4d4d-4c38-8fe2-b59df6076714 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:41.215703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2c1bf-7a78-4fb3-aa01-bfd2c6f6f490 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:41.220302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df39df-9756-422a-83bd-d2362dd9f18e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:41.220973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df39df-9756-422a-83bd-d2362dd9f18e service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:41.221257 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df39df-9756-422a-83bd-d2362dd9f18e service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:41.221539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df39df-9756-422a-83bd-d2362dd9f18e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:41.276280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245aa92-faa6-4539-8bb7-b2521a0a0c58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:41.276959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245aa92-faa6-4539-8bb7-b2521a0a0c58 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:41.277248 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245aa92-faa6-4539-8bb7-b2521a0a0c58 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:41.277515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245aa92-faa6-4539-8bb7-b2521a0a0c58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:41.324379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df39df-9756-422a-83bd-d2362dd9f18e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:41.326861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df39df-9756-422a-83bd-d2362dd9f18e service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:41.341215 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 823/1639] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:41 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:41.342261 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df39df-9756-422a-83bd-d2362dd9f18e service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:41.342493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245aa92-faa6-4539-8bb7-b2521a0a0c58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:41.344280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245aa92-faa6-4539-8bb7-b2521a0a0c58 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:41.350748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df39df-9756-422a-83bd-d2362dd9f18e service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:41.355362 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 817/1640] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:41.357615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab8fce-49bd-4e69-9871-d94735aa82e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:41.357995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18754b-e2da-4a3c-8f31-111dbc0c795f None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:41.357995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18754b-e2da-4a3c-8f31-111dbc0c795f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:41.357995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18754b-e2da-4a3c-8f31-111dbc0c795f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:41.358299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab8fce-49bd-4e69-9871-d94735aa82e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:41.358299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab8fce-49bd-4e69-9871-d94735aa82e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:41.358710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab8fce-49bd-4e69-9871-d94735aa82e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:41.381655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab8fce-49bd-4e69-9871-d94735aa82e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:41.383550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab8fce-49bd-4e69-9871-d94735aa82e6 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:41.402206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-0f18754b-e2da-4a3c-8f31-111dbc0c795f None None] MFA Rules not processed for user `09668450414142ea81d4e79f540fecdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:41.405608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0f18754b-e2da-4a3c-8f31-111dbc0c795f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:41.410783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 824/1641] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:41.534034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:41.604053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 818/1642] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:41.651568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab8fce-49bd-4e69-9871-d94735aa82e6 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:41.663670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab8fce-49bd-4e69-9871-d94735aa82e6 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:41.679520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df0415-acd2-4c57-8d3f-692a516b231d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:41.680401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df0415-acd2-4c57-8d3f-692a516b231d service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:41.681784 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df0415-acd2-4c57-8d3f-692a516b231d service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:41.684929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df0415-acd2-4c57-8d3f-692a516b231d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:41.710417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df0415-acd2-4c57-8d3f-692a516b231d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:41.718986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df0415-acd2-4c57-8d3f-692a516b231d service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:41.746451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 825/1643] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:41 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:41.857719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac1cc-3a3c-4d13-8e66-4a9fd98c1437 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:41.858592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac1cc-3a3c-4d13-8e66-4a9fd98c1437 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:41.859146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac1cc-3a3c-4d13-8e66-4a9fd98c1437 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:41.861013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 819/1644] 10.222.0.40 () {54 vars in 912 bytes} [Wed Jun 8 06:46:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:46:41.868142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f883b-f5cc-4973-a37d-1cb32dadb235 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:41.868568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f883b-f5cc-4973-a37d-1cb32dadb235 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:41.868972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f883b-f5cc-4973-a37d-1cb32dadb235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:41.896912 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-239f883b-f5cc-4973-a37d-1cb32dadb235 None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:41.898600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-239f883b-f5cc-4973-a37d-1cb32dadb235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:41.924190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 826/1645] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:46:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:46:41.937319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ac1cc-3a3c-4d13-8e66-4a9fd98c1437 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:41.943005 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-011ac1cc-3a3c-4d13-8e66-4a9fd98c1437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:41.983018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f883b-f5cc-4973-a37d-1cb32dadb235 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:42.062272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ac1cc-3a3c-4d13-8e66-4a9fd98c1437 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:42.071370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1832b-0f71-427a-b765-5a061da3addb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5498a6912a08408d9ea30920faceee7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:42.073091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1832b-0f71-427a-b765-5a061da3addb service glance] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:42.073668 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1832b-0f71-427a-b765-5a061da3addb service glance] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:42.075646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1832b-0f71-427a-b765-5a061da3addb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:42.115394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1832b-0f71-427a-b765-5a061da3addb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:42.117171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1832b-0f71-427a-b765-5a061da3addb service glance] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:42.146809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 820/1646] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:46:42.151034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f883b-f5cc-4973-a37d-1cb32dadb235 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:42.161068 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:42.161651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:42.162007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:42.162396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] PATH_INFO: `/v3/users/150dbc1853404960a1dc94f8c7753e9d` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:42.166516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] RBAC: Authorizing `identity:delete_user(user_id=150dbc1853404960a1dc94f8c7753e9d)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:42.170013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:42.219713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1832b-0f71-427a-b765-5a061da3addb service glance] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:42.244932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1832b-0f71-427a-b765-5a061da3addb service glance] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:42.244932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45571d16-457a-47c6-a627-664bc4b1ca96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:42.244932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45571d16-457a-47c6-a627-664bc4b1ca96 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:42.244932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45571d16-457a-47c6-a627-664bc4b1ca96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:42.569017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45571d16-457a-47c6-a627-664bc4b1ca96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:42.569017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45571d16-457a-47c6-a627-664bc4b1ca96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:42.569017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45571d16-457a-47c6-a627-664bc4b1ca96 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:42.569017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 821/1647] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:42.680459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150dbc1853404960a1dc94f8c7753e9d'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:42.688318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150dbc1853404960a1dc94f8c7753e9d'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:42.796054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150dbc1853404960a1dc94f8c7753e9d'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:42.818778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150dbc1853404960a1dc94f8c7753e9d'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:42.840483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150dbc1853404960a1dc94f8c7753e9d'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:42.852630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 827/1648] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:46:41 2022] DELETE /identity/v3/users/150dbc1853404960a1dc94f8c7753e9d => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:42.854184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55da3f-b194-436e-a63c-944e04af78c3 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:42.854499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55da3f-b194-436e-a63c-944e04af78c3 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:42.854780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55da3f-b194-436e-a63c-944e04af78c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:42.906592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-cf55da3f-b194-436e-a63c-944e04af78c3 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:42.915030 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-cf55da3f-b194-436e-a63c-944e04af78c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:43.038003 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 822/1649] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:46:43.048923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:43.050972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:43.170674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773859a7-87ec-42d8-9b4c-4f3ec9d8e2dd None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:43.171073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773859a7-87ec-42d8-9b4c-4f3ec9d8e2dd None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:43.171239 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773859a7-87ec-42d8-9b4c-4f3ec9d8e2dd None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:43.172617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 823/1650] 10.222.0.40 () {54 vars in 912 bytes} [Wed Jun 8 06:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:46:43.180898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b2f2a-b4b1-47c8-8284-3e8fc930323d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:43.181238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b2f2a-b4b1-47c8-8284-3e8fc930323d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:43.181564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b2f2a-b4b1-47c8-8284-3e8fc930323d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:43.188591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:43.201364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a77e7-5796-4ec2-afe7-22a4cbbd09be admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:43.207868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5615ca1-a699-4f0b-9990-8f46d387494c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:43.207868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5615ca1-a699-4f0b-9990-8f46d387494c service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:43.209141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5615ca1-a699-4f0b-9990-8f46d387494c service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:43.209436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5615ca1-a699-4f0b-9990-8f46d387494c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:43.221436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5615ca1-a699-4f0b-9990-8f46d387494c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:43.222915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5615ca1-a699-4f0b-9990-8f46d387494c service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:43.254781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 828/1651] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:43.274176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-745b2f2a-b4b1-47c8-8284-3e8fc930323d None None] MFA Rules not processed for user `11838a2908884cc79df912b3b2199564`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:43.283413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-745b2f2a-b4b1-47c8-8284-3e8fc930323d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:43.299008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 824/1652] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:46:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:43.357171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5615ca1-a699-4f0b-9990-8f46d387494c service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:43.359379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f5615ca1-a699-4f0b-9990-8f46d387494c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:43.383677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5615ca1-a699-4f0b-9990-8f46d387494c service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:43.392949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7ba7e-2337-4edc-afb0-5db7389849f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:43.394915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7ba7e-2337-4edc-afb0-5db7389849f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:43.395482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7ba7e-2337-4edc-afb0-5db7389849f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:43.396684 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7ba7e-2337-4edc-afb0-5db7389849f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:43.410768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7ba7e-2337-4edc-afb0-5db7389849f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:43.415139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7ba7e-2337-4edc-afb0-5db7389849f4 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:43.442622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:43.448257 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 829/1653] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:44.147204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:44.426135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:44.711767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b2f2a-b4b1-47c8-8284-3e8fc930323d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:44.714784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-745b2f2a-b4b1-47c8-8284-3e8fc930323d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:44.740869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b2f2a-b4b1-47c8-8284-3e8fc930323d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:44.748371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:44.749896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:44.750338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:44.750746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] PATH_INFO: `/v3/projects/8c48ef7c823a45f0af0a268b8dc0ed1f` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:44.753221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c48ef7c823a45f0af0a268b8dc0ed1f)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:44.755713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:44.993318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c48ef7c823a45f0af0a268b8dc0ed1f', 'request_id': 'req-8afa7320-f35b-4355-9cc9-91b4b38f6f98'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:45.186038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c48ef7c823a45f0af0a268b8dc0ed1f', 'request_id': 'req-8afa7320-f35b-4355-9cc9-91b4b38f6f98'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:45.186038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c48ef7c823a45f0af0a268b8dc0ed1f', 'request_id': 'req-8afa7320-f35b-4355-9cc9-91b4b38f6f98'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:45.188772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ee057-21f8-4a48-831d-628d0d3e09b7 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:45.189063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ee057-21f8-4a48-831d-628d0d3e09b7 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:45.189347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ee057-21f8-4a48-831d-628d0d3e09b7 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:45.191253 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 830/1654] 10.222.0.40 () {54 vars in 960 bytes} [Wed Jun 8 06:46:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:46:45.201290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6daae-4704-4c08-80f8-ce39223ab78b None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:45.201824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6daae-4704-4c08-80f8-ce39223ab78b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:45.202415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6daae-4704-4c08-80f8-ce39223ab78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:45.205255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] The token cache is being invalidate because project 8c48ef7c823a45f0af0a268b8dc0ed1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:46:45.205555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:45.206957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:45.212104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 825/1655] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:46:44 2022] DELETE /identity/v3/projects/8c48ef7c823a45f0af0a268b8dc0ed1f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:45.216296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:45.218110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:45.252372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a8f6daae-4704-4c08-80f8-ce39223ab78b None None] MFA Rules not processed for user `b1e0226354d14b9b9c4184063b2df9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:45.253583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a8f6daae-4704-4c08-80f8-ce39223ab78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:45.399653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 831/1656] 10.222.0.40 () {58 vars in 1057 bytes} [Wed Jun 8 06:46:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:45.407054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6daae-4704-4c08-80f8-ce39223ab78b None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:45.423505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa7320-f35b-4355-9cc9-91b4b38f6f98 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:45.434372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6daae-4704-4c08-80f8-ce39223ab78b None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:45.443258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:45.448357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:45.452014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:45.452219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bd0ea-dabd-4a27-acd2-3b493946fd13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:45.452219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bd0ea-dabd-4a27-acd2-3b493946fd13 service placement] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:45.452219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bd0ea-dabd-4a27-acd2-3b493946fd13 service placement] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:45.452578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bd0ea-dabd-4a27-acd2-3b493946fd13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:45.457923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] PATH_INFO: `/v3/users/b81c44e2ce2f4f5586b6930d07166191` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:45.459919 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81c44e2ce2f4f5586b6930d07166191)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:45.463086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: WARNING py.warnings [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:46:45.463086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: warnings.warn(msg) Jun 08 06:46:45.463086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: Jun 08 06:46:45.466601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:45.467298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-776bd0ea-dabd-4a27-acd2-3b493946fd13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:45.496970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bd0ea-dabd-4a27-acd2-3b493946fd13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:45.501152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bd0ea-dabd-4a27-acd2-3b493946fd13 service placement] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:45.554035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 832/1657] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:45.690799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:45.844271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81c44e2ce2f4f5586b6930d07166191'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:45.845932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81c44e2ce2f4f5586b6930d07166191'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:45.908273 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81c44e2ce2f4f5586b6930d07166191'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:45.981428 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81c44e2ce2f4f5586b6930d07166191'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:45.997418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-49676760-d87e-4636-8bf4-4c9f8d74eb93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81c44e2ce2f4f5586b6930d07166191'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:46.005691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 826/1658] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:46:45 2022] DELETE /identity/v3/users/b81c44e2ce2f4f5586b6930d07166191 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:46:47.459290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bd0ea-dabd-4a27-acd2-3b493946fd13 service placement] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:47.478869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bd0ea-dabd-4a27-acd2-3b493946fd13 service placement] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:47.628631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:47.629721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:47.630156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:47.634417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] PATH_INFO: `/v3/projects/5d15a108e8da4ac89233d63951762c11` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:47.639967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d15a108e8da4ac89233d63951762c11)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:47.639967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: WARNING py.warnings [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 06:46:47.639967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: warnings.warn(msg) Jun 08 06:46:47.639967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: Jun 08 06:46:47.646940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:47.795667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5109004-3e30-4f5e-aa97-c7e825daa552 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:47.795667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5109004-3e30-4f5e-aa97-c7e825daa552 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:47.796347 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5109004-3e30-4f5e-aa97-c7e825daa552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:47.809664 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:47.838693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d15a108e8da4ac89233d63951762c11', 'request_id': 'req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:47.869593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-f5109004-3e30-4f5e-aa97-c7e825daa552 None None] MFA Rules not processed for user `cc861f1c354f45b09cb61fd86245a5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:47.875047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f5109004-3e30-4f5e-aa97-c7e825daa552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:47.944504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d15a108e8da4ac89233d63951762c11', 'request_id': 'req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:47.955501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d15a108e8da4ac89233d63951762c11', 'request_id': 'req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:47.983943 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] The token cache is being invalidate because project 5d15a108e8da4ac89233d63951762c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:46:47.984544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:47.985341 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b73f12a4-3a5f-4ee0-b580-d0024eac44d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:47.999959 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 833/1659] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:46:47 2022] DELETE /identity/v3/projects/5d15a108e8da4ac89233d63951762c11 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:48.002197 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b6ac-59e5-4ade-9eb5-0969327d8b6d None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:48.002822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b6ac-59e5-4ade-9eb5-0969327d8b6d None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:48.005755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b6ac-59e5-4ade-9eb5-0969327d8b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:48.007702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 827/1660] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:48.024091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5109004-3e30-4f5e-aa97-c7e825daa552 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:48.027364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f5109004-3e30-4f5e-aa97-c7e825daa552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:48.049836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-2f44b6ac-59e5-4ade-9eb5-0969327d8b6d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:48.054344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2f44b6ac-59e5-4ade-9eb5-0969327d8b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:48.153363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 834/1661] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:48.162340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0b8be-f597-43eb-88e8-cf36e951671f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:48.163040 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0b8be-f597-43eb-88e8-cf36e951671f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:48.166377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0b8be-f597-43eb-88e8-cf36e951671f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:48.192321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5109004-3e30-4f5e-aa97-c7e825daa552 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:48.207847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-53a0b8be-f597-43eb-88e8-cf36e951671f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:48.209492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-53a0b8be-f597-43eb-88e8-cf36e951671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:48.210788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c0b8c-ca8b-4e5b-a05d-052e1fd342ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:48.212066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c0b8c-ca8b-4e5b-a05d-052e1fd342ba service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:48.212352 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c0b8c-ca8b-4e5b-a05d-052e1fd342ba service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:48.212629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c0b8c-ca8b-4e5b-a05d-052e1fd342ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:48.218526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-783c0b8c-ca8b-4e5b-a05d-052e1fd342ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:48.224039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 835/1662] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:48.225423 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0b8be-f597-43eb-88e8-cf36e951671f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:48.256092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0b8be-f597-43eb-88e8-cf36e951671f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:48.267522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc95a1-7781-4cd7-b3a4-8082d07449fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:48.269055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc95a1-7781-4cd7-b3a4-8082d07449fe admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:48.270311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc95a1-7781-4cd7-b3a4-8082d07449fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:48.273415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc95a1-7781-4cd7-b3a4-8082d07449fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:48.275485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc95a1-7781-4cd7-b3a4-8082d07449fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:46:48.275903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc95a1-7781-4cd7-b3a4-8082d07449fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:48.276622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c0b8c-ca8b-4e5b-a05d-052e1fd342ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:48.277755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc95a1-7781-4cd7-b3a4-8082d07449fe admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:48.278736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c0b8c-ca8b-4e5b-a05d-052e1fd342ba service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:48.289144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 828/1663] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:46:48.294997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 836/1664] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:46:48.303962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c0b8c-ca8b-4e5b-a05d-052e1fd342ba service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:48.319534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c0b8c-ca8b-4e5b-a05d-052e1fd342ba service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:48.324659 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dd367-2a71-40ee-b025-ed4a222e23f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:48.325401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dd367-2a71-40ee-b025-ed4a222e23f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:48.325691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dd367-2a71-40ee-b025-ed4a222e23f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:48.326113 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dd367-2a71-40ee-b025-ed4a222e23f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:48.327241 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dd367-2a71-40ee-b025-ed4a222e23f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:48.329297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dd367-2a71-40ee-b025-ed4a222e23f0 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:48.349239 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:48.494374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 829/1665] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:48 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:46:48.499031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc95a1-7781-4cd7-b3a4-8082d07449fe admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:48.524967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc95a1-7781-4cd7-b3a4-8082d07449fe admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:48.653122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95699b53-4af7-4715-a5ec-5cddd3159225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:48.656758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95699b53-4af7-4715-a5ec-5cddd3159225 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:48.658176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95699b53-4af7-4715-a5ec-5cddd3159225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:48.658617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95699b53-4af7-4715-a5ec-5cddd3159225 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:48.659825 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95699b53-4af7-4715-a5ec-5cddd3159225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:48.665503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95699b53-4af7-4715-a5ec-5cddd3159225 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:48.791205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 837/1666] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:48 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:48.794613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dd367-2a71-40ee-b025-ed4a222e23f0 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:48.808456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dd367-2a71-40ee-b025-ed4a222e23f0 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:48.814478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf49d4-5382-4a83-a9ce-ad95f3cde427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:48.815375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf49d4-5382-4a83-a9ce-ad95f3cde427 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:48.815808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf49d4-5382-4a83-a9ce-ad95f3cde427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:48.816221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf49d4-5382-4a83-a9ce-ad95f3cde427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:48.817175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf49d4-5382-4a83-a9ce-ad95f3cde427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:48.819619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf49d4-5382-4a83-a9ce-ad95f3cde427 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:48.834905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 830/1667] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:48.838867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95699b53-4af7-4715-a5ec-5cddd3159225 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:48.850146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95699b53-4af7-4715-a5ec-5cddd3159225 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:48.858342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d84b4-ea06-4776-a1ef-22f67f6217de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:48.859434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d84b4-ea06-4776-a1ef-22f67f6217de admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:48.859858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d84b4-ea06-4776-a1ef-22f67f6217de admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:48.860323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d84b4-ea06-4776-a1ef-22f67f6217de admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:48.862168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d84b4-ea06-4776-a1ef-22f67f6217de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:48.864022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d84b4-ea06-4776-a1ef-22f67f6217de admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:48.880301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 838/1668] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:46:48.881789 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf49d4-5382-4a83-a9ce-ad95f3cde427 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:48.899373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf49d4-5382-4a83-a9ce-ad95f3cde427 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:48.914618 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e51730-a840-43bd-8f4d-3b89e4e3c348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:48.920721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51730-a840-43bd-8f4d-3b89e4e3c348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:48.920721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51730-a840-43bd-8f4d-3b89e4e3c348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:48.920721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51730-a840-43bd-8f4d-3b89e4e3c348 admin admin] PATH_INFO: `/v3/projects/6ce1c7ccc9664d1e8caf33152460d7f7/users/f8f948b0746b4728be956519447c4b8f/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:48.954469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e51730-a840-43bd-8f4d-3b89e4e3c348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce1c7ccc9664d1e8caf33152460d7f7, user_id=f8f948b0746b4728be956519447c4b8f, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:48.962167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e51730-a840-43bd-8f4d-3b89e4e3c348 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:49.056890 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 831/1669] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:48 2022] PUT /identity/v3/projects/6ce1c7ccc9664d1e8caf33152460d7f7/users/f8f948b0746b4728be956519447c4b8f/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:49.057227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d84b4-ea06-4776-a1ef-22f67f6217de admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:49.059056 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b051a2-8b4a-4ae9-ab6f-758e05bc4f5b None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:49.059358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b051a2-8b4a-4ae9-ab6f-758e05bc4f5b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:49.060811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5e4d84b4-ea06-4776-a1ef-22f67f6217de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:49.063197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b051a2-8b4a-4ae9-ab6f-758e05bc4f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:49.096783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d84b4-ea06-4776-a1ef-22f67f6217de admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:49.152709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:49.173959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-48b051a2-8b4a-4ae9-ab6f-758e05bc4f5b None None] MFA Rules not processed for user `f8f948b0746b4728be956519447c4b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:49.175752 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-48b051a2-8b4a-4ae9-ab6f-758e05bc4f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:49.223985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14666207-a6fd-4ca0-9bbd-588422b95fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:49.227569 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14666207-a6fd-4ca0-9bbd-588422b95fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:49.228130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14666207-a6fd-4ca0-9bbd-588422b95fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:49.229092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14666207-a6fd-4ca0-9bbd-588422b95fea admin admin] PATH_INFO: `/v3/users/1855cc05be90464fa628e08f814dcd83` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:49.230777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14666207-a6fd-4ca0-9bbd-588422b95fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1855cc05be90464fa628e08f814dcd83)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:49.233456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14666207-a6fd-4ca0-9bbd-588422b95fea admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:49.324226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 832/1670] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:46:49.325387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b051a2-8b4a-4ae9-ab6f-758e05bc4f5b None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:49.381454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b051a2-8b4a-4ae9-ab6f-758e05bc4f5b None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:49.392037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cb5c7-8d9e-4dfa-afeb-5a98075d7443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:49.395876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cb5c7-8d9e-4dfa-afeb-5a98075d7443 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:49.395876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cb5c7-8d9e-4dfa-afeb-5a98075d7443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:49.395876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cb5c7-8d9e-4dfa-afeb-5a98075d7443 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:49.397771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cb5c7-8d9e-4dfa-afeb-5a98075d7443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:49.400382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cb5c7-8d9e-4dfa-afeb-5a98075d7443 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:49.494886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-14666207-a6fd-4ca0-9bbd-588422b95fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1855cc05be90464fa628e08f814dcd83'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:49.497024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-14666207-a6fd-4ca0-9bbd-588422b95fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1855cc05be90464fa628e08f814dcd83'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:49.570683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 833/1671] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:49 2022] POST /identity/v3/projects => generated 379 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:49.574442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cb5c7-8d9e-4dfa-afeb-5a98075d7443 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:49.578472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ef9cb5c7-8d9e-4dfa-afeb-5a98075d7443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:49.591210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-14666207-a6fd-4ca0-9bbd-588422b95fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1855cc05be90464fa628e08f814dcd83'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:49.615558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-14666207-a6fd-4ca0-9bbd-588422b95fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1855cc05be90464fa628e08f814dcd83'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:49.642145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-14666207-a6fd-4ca0-9bbd-588422b95fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1855cc05be90464fa628e08f814dcd83'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:49.671180 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 839/1672] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:46:49 2022] DELETE /identity/v3/users/1855cc05be90464fa628e08f814dcd83 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:49.672854 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3de7-7ec0-41b5-a450-57723d715fe3 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:49.673169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3de7-7ec0-41b5-a450-57723d715fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:49.673498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3de7-7ec0-41b5-a450-57723d715fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:49.736659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-512b3de7-7ec0-41b5-a450-57723d715fe3 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:49.746654 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-512b3de7-7ec0-41b5-a450-57723d715fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:49.816613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cb5c7-8d9e-4dfa-afeb-5a98075d7443 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:49.948577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 840/1673] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:49.973911 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b27a5-187c-469b-b658-5f07090744a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:49.975441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b27a5-187c-469b-b658-5f07090744a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:49.975945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b27a5-187c-469b-b658-5f07090744a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:49.976351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b27a5-187c-469b-b658-5f07090744a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:49.977235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b27a5-187c-469b-b658-5f07090744a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:49.980121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b27a5-187c-469b-b658-5f07090744a8 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:50.066533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 834/1674] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:49 2022] POST /identity/v3/users => generated 296 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:46:50.070810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b3de7-7ec0-41b5-a450-57723d715fe3 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:50.083920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b3de7-7ec0-41b5-a450-57723d715fe3 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:50.091321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd78e37-5a0c-40a9-b3e3-263a91f34cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:50.092141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd78e37-5a0c-40a9-b3e3-263a91f34cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:50.092739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd78e37-5a0c-40a9-b3e3-263a91f34cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:50.093334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd78e37-5a0c-40a9-b3e3-263a91f34cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:50.095104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd78e37-5a0c-40a9-b3e3-263a91f34cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:50.096830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd78e37-5a0c-40a9-b3e3-263a91f34cb3 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:50.109387 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 841/1675] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:50.114578 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b27a5-187c-469b-b658-5f07090744a8 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:50.134953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b27a5-187c-469b-b658-5f07090744a8 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:50.140709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e80fe7-fab8-4317-a758-017568143cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:50.141635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80fe7-fab8-4317-a758-017568143cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:50.141974 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80fe7-fab8-4317-a758-017568143cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:50.142286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80fe7-fab8-4317-a758-017568143cdd admin admin] PATH_INFO: `/v3/projects/c407869065204709b6f3330fb20d3215/users/188ee4c630c74aafaa8299088084f84e/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:50.162591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e80fe7-fab8-4317-a758-017568143cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c407869065204709b6f3330fb20d3215, user_id=188ee4c630c74aafaa8299088084f84e, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:50.166451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e80fe7-fab8-4317-a758-017568143cdd admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:50.182387 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd78e37-5a0c-40a9-b3e3-263a91f34cb3 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:50.185800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0cd78e37-5a0c-40a9-b3e3-263a91f34cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:50.290484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 835/1676] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:50 2022] PUT /identity/v3/projects/c407869065204709b6f3330fb20d3215/users/188ee4c630c74aafaa8299088084f84e/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:50.292679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e80fe7-fab8-4317-a758-017568143cdd admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:50.376793 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:50.406357 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd78e37-5a0c-40a9-b3e3-263a91f34cb3 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:50.498308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e80fe7-fab8-4317-a758-017568143cdd admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:50.533037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1c26f-fe51-4a12-94a6-3e93ecb5ae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:50.536678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c26f-fe51-4a12-94a6-3e93ecb5ae81 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:50.536678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c26f-fe51-4a12-94a6-3e93ecb5ae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:50.538732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c26f-fe51-4a12-94a6-3e93ecb5ae81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:50.540120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1c26f-fe51-4a12-94a6-3e93ecb5ae81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:50.549397 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1c26f-fe51-4a12-94a6-3e93ecb5ae81 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:50.572827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 836/1677] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:50.576699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1c26f-fe51-4a12-94a6-3e93ecb5ae81 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:50.588355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177172b-205d-470d-987a-d03eb92dc980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:50.589047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177172b-205d-470d-987a-d03eb92dc980 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:50.589334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177172b-205d-470d-987a-d03eb92dc980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:50.589614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177172b-205d-470d-987a-d03eb92dc980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:50.607586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177172b-205d-470d-987a-d03eb92dc980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:50.609062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177172b-205d-470d-987a-d03eb92dc980 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:50.609994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1c26f-fe51-4a12-94a6-3e93ecb5ae81 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:50.621189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9bfea-7fea-4056-a332-9a4929ac6fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:50.626521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9bfea-7fea-4056-a332-9a4929ac6fda admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:50.626815 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9bfea-7fea-4056-a332-9a4929ac6fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:50.627098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9bfea-7fea-4056-a332-9a4929ac6fda admin admin] PATH_INFO: `/v3/projects/c407869065204709b6f3330fb20d3215/users/188ee4c630c74aafaa8299088084f84e/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:50.631870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9bfea-7fea-4056-a332-9a4929ac6fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c407869065204709b6f3330fb20d3215, user_id=188ee4c630c74aafaa8299088084f84e, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:50.638831 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9bfea-7fea-4056-a332-9a4929ac6fda admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:50.638991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 842/1678] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:50.688362 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 837/1679] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:50 2022] PUT /identity/v3/projects/c407869065204709b6f3330fb20d3215/users/188ee4c630c74aafaa8299088084f84e/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:50.699869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460de88-ad98-4aba-8d1b-3fb7facb9aed None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:50.700251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460de88-ad98-4aba-8d1b-3fb7facb9aed None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:50.700643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460de88-ad98-4aba-8d1b-3fb7facb9aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:50.779476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618356dd-780c-4247-aeef-f29e13300047 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:50.779476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618356dd-780c-4247-aeef-f29e13300047 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:50.779476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618356dd-780c-4247-aeef-f29e13300047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:50.801056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-f460de88-ad98-4aba-8d1b-3fb7facb9aed None None] MFA Rules not processed for user `188ee4c630c74aafaa8299088084f84e`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:50.805843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f460de88-ad98-4aba-8d1b-3fb7facb9aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:50.850331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-618356dd-780c-4247-aeef-f29e13300047 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:50.853686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-618356dd-780c-4247-aeef-f29e13300047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:51.048599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 838/1680] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:46:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:51.090736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 843/1681] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:51.116068 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:51.163442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618356dd-780c-4247-aeef-f29e13300047 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:51.165808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-618356dd-780c-4247-aeef-f29e13300047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:51.300137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618356dd-780c-4247-aeef-f29e13300047 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:51.305284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9754da-c08b-4aff-906f-5b71592a1735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:51.305284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9754da-c08b-4aff-906f-5b71592a1735 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:51.305508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9754da-c08b-4aff-906f-5b71592a1735 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:51.305683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9754da-c08b-4aff-906f-5b71592a1735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:51.317311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9754da-c08b-4aff-906f-5b71592a1735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:51.319062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9754da-c08b-4aff-906f-5b71592a1735 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:51.332729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 839/1682] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:51.447619 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460de88-ad98-4aba-8d1b-3fb7facb9aed None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:51.450293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f460de88-ad98-4aba-8d1b-3fb7facb9aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:51.495009 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:51.641353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460de88-ad98-4aba-8d1b-3fb7facb9aed None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:51.657688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddf321-4b74-4c1b-bc5f-9edc0ce38f07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:51.658466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf321-4b74-4c1b-bc5f-9edc0ce38f07 service swift] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:51.658871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf321-4b74-4c1b-bc5f-9edc0ce38f07 service swift] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:51.659212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf321-4b74-4c1b-bc5f-9edc0ce38f07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:51.685463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddf321-4b74-4c1b-bc5f-9edc0ce38f07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:51.685463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddf321-4b74-4c1b-bc5f-9edc0ce38f07 service swift] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:51.696488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9754da-c08b-4aff-906f-5b71592a1735 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:51.698338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-af9754da-c08b-4aff-906f-5b71592a1735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:51.706911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 844/1683] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:46:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:46:51.722424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9754da-c08b-4aff-906f-5b71592a1735 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:51.726998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163ef16-5619-48af-9529-11f609ec29b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:51.727846 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163ef16-5619-48af-9529-11f609ec29b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:51.728261 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163ef16-5619-48af-9529-11f609ec29b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:51.728758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163ef16-5619-48af-9529-11f609ec29b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:51.730912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4163ef16-5619-48af-9529-11f609ec29b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:51.812090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163ef16-5619-48af-9529-11f609ec29b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:51.813710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163ef16-5619-48af-9529-11f609ec29b6 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:51.829728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 840/1684] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:53.023101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddf321-4b74-4c1b-bc5f-9edc0ce38f07 service swift] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:53.027127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2fddf321-4b74-4c1b-bc5f-9edc0ce38f07 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:53.046085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:53.130856 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3919-4a15-4410-9786-abf8bea81e80 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:53.130856 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3919-4a15-4410-9786-abf8bea81e80 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:53.130856 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3919-4a15-4410-9786-abf8bea81e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:53.203190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddf321-4b74-4c1b-bc5f-9edc0ce38f07 service swift] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:53.203190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:53.203190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:53.203190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:53.213662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] PATH_INFO: `/v3/users/86e9decb1b4d4fe2aab6541cb70c21c8` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:53.242132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e9decb1b4d4fe2aab6541cb70c21c8)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:53.258468 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:53.288341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b1ae3919-4a15-4410-9786-abf8bea81e80 None None] MFA Rules not processed for user `c6523f0f4dc249659c4e63fc5ee5e783`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:53.288341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b1ae3919-4a15-4410-9786-abf8bea81e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:53.563199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 841/1685] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:53.564477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae3919-4a15-4410-9786-abf8bea81e80 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:53.567105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b1ae3919-4a15-4410-9786-abf8bea81e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:53.606840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae3919-4a15-4410-9786-abf8bea81e80 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:53.624783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:53.625684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:53.625973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:53.626525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] PATH_INFO: `/v3/projects/784a5693f27a471a942c49eff8c6b60a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:53.627931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784a5693f27a471a942c49eff8c6b60a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:53.633702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:53.678454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e9decb1b4d4fe2aab6541cb70c21c8'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:53.681524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e9decb1b4d4fe2aab6541cb70c21c8'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:53.832869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784a5693f27a471a942c49eff8c6b60a', 'request_id': 'req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:53.837413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e9decb1b4d4fe2aab6541cb70c21c8'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:53.854486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:53.872052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e9decb1b4d4fe2aab6541cb70c21c8'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:53.894290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e9decb1b4d4fe2aab6541cb70c21c8'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:53.928577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 845/1686] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:46:53 2022] DELETE /identity/v3/users/86e9decb1b4d4fe2aab6541cb70c21c8 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:53.930685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:53.933511 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:53.949867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784a5693f27a471a942c49eff8c6b60a', 'request_id': 'req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:53.961605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784a5693f27a471a942c49eff8c6b60a', 'request_id': 'req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:54.014375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] The token cache is being invalidate because project 784a5693f27a471a942c49eff8c6b60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:46:54.014702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:54.017377 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-79c79c61-7267-4c9e-bdd5-35cb1cf19ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:54.023402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 842/1687] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:46:53 2022] DELETE /identity/v3/projects/784a5693f27a471a942c49eff8c6b60a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:54.031183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0264d-6499-4582-b92c-950d52a800ea None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:54.036432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0264d-6499-4582-b92c-950d52a800ea None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:54.036432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0264d-6499-4582-b92c-950d52a800ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:54.064040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b7d0264d-6499-4582-b92c-950d52a800ea None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:54.070808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b7d0264d-6499-4582-b92c-950d52a800ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:54.111409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe2471-cff3-43b5-a56a-f39fc1a32994 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:54.125056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be043550-6366-40e5-a618-b6a6eea72167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:54.125962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be043550-6366-40e5-a618-b6a6eea72167 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:54.126442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be043550-6366-40e5-a618-b6a6eea72167 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:54.126822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be043550-6366-40e5-a618-b6a6eea72167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:54.129589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-be043550-6366-40e5-a618-b6a6eea72167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:54.181952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:54.273877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 843/1688] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:54.275324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0264d-6499-4582-b92c-950d52a800ea None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:54.279315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b7d0264d-6499-4582-b92c-950d52a800ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:54.320765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0264d-6499-4582-b92c-950d52a800ea None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:54.323663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be043550-6366-40e5-a618-b6a6eea72167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:54.331070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be043550-6366-40e5-a618-b6a6eea72167 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:54.349331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:54.357841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:54.358130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:54.358534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] PATH_INFO: `/v3/users/09668450414142ea81d4e79f540fecdb` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:54.359445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 846/1689] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:54.362227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab34dc-eac4-4fa5-ac84-3ae867437081 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:54.365894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab34dc-eac4-4fa5-ac84-3ae867437081 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:54.365894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab34dc-eac4-4fa5-ac84-3ae867437081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:54.374385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09668450414142ea81d4e79f540fecdb)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:54.385834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:54.425781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a2ab34dc-eac4-4fa5-ac84-3ae867437081 None None] MFA Rules not processed for user `11838a2908884cc79df912b3b2199564`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:54.427052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a2ab34dc-eac4-4fa5-ac84-3ae867437081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:54.595921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 847/1690] 10.222.0.41 () {58 vars in 1015 bytes} [Wed Jun 8 06:46:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:54.597709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab34dc-eac4-4fa5-ac84-3ae867437081 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:54.600529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a2ab34dc-eac4-4fa5-ac84-3ae867437081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:54.633146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab34dc-eac4-4fa5-ac84-3ae867437081 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:54.644329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7484d-0b11-467b-9e8c-3127e1924dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:54.645135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7484d-0b11-467b-9e8c-3127e1924dab service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:54.645431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7484d-0b11-467b-9e8c-3127e1924dab service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:54.645717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7484d-0b11-467b-9e8c-3127e1924dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:54.682674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7484d-0b11-467b-9e8c-3127e1924dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:54.684294 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7484d-0b11-467b-9e8c-3127e1924dab service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:54.702129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09668450414142ea81d4e79f540fecdb'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:54.707452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09668450414142ea81d4e79f540fecdb'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:54.730731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 848/1691] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:54.731668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7484d-0b11-467b-9e8c-3127e1924dab service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:54.736855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2ee7484d-0b11-467b-9e8c-3127e1924dab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:54.781700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09668450414142ea81d4e79f540fecdb'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:54.789996 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7484d-0b11-467b-9e8c-3127e1924dab service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:54.817957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1223f-1896-469b-a09a-96d0ab876929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:54.820783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1223f-1896-469b-a09a-96d0ab876929 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:54.821292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1223f-1896-469b-a09a-96d0ab876929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:54.831850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1223f-1896-469b-a09a-96d0ab876929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:54.832161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c7c1223f-1896-469b-a09a-96d0ab876929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:54.904032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1223f-1896-469b-a09a-96d0ab876929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:54.904032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1223f-1896-469b-a09a-96d0ab876929 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:54.927922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09668450414142ea81d4e79f540fecdb'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:54.944817 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09668450414142ea81d4e79f540fecdb'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:54.959048 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 849/1692] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:54.981895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 844/1693] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:46:54 2022] DELETE /identity/v3/users/09668450414142ea81d4e79f540fecdb => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:56.488583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1223f-1896-469b-a09a-96d0ab876929 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:56.490157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c7c1223f-1896-469b-a09a-96d0ab876929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:56.573064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1223f-1896-469b-a09a-96d0ab876929 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:56.633259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:56.641152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:56.764812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:56.765884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:56.766497 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:56.766744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] PATH_INFO: `/v3/users/6f2424cc1f674b19ace00e703f39b20d` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:56.768274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2424cc1f674b19ace00e703f39b20d)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:56.777123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:56.843891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:56.850520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c019e-d3cc-49e7-bf38-56bcf2410306 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:56.856222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:56.857773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:56.858368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:56.858842 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] PATH_INFO: `/v3/projects/c14f83dab8e44136a5d4a6fcdfeb2c09` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:56.860415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14f83dab8e44136a5d4a6fcdfeb2c09)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:56.862413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:56.985281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2424cc1f674b19ace00e703f39b20d'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:56.986085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2424cc1f674b19ace00e703f39b20d'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:56.988076 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:57.025065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14f83dab8e44136a5d4a6fcdfeb2c09', 'request_id': 'req-05470144-ae97-408d-8475-f61d98146494'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.071275 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2424cc1f674b19ace00e703f39b20d'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.094811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2424cc1f674b19ace00e703f39b20d'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.112088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2424cc1f674b19ace00e703f39b20d'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.130218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 850/1694] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:46:56 2022] DELETE /identity/v3/users/6f2424cc1f674b19ace00e703f39b20d => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:57.131687 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:57.136829 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:57.155992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14f83dab8e44136a5d4a6fcdfeb2c09', 'request_id': 'req-05470144-ae97-408d-8475-f61d98146494'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.166860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14f83dab8e44136a5d4a6fcdfeb2c09', 'request_id': 'req-05470144-ae97-408d-8475-f61d98146494'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.201971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] The token cache is being invalidate because project c14f83dab8e44136a5d4a6fcdfeb2c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:46:57.201971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.218192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-05470144-ae97-408d-8475-f61d98146494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.226894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 845/1695] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:46:56 2022] DELETE /identity/v3/projects/c14f83dab8e44136a5d4a6fcdfeb2c09 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:46:57.226894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602715f-253d-4a80-ad20-10b86c278e45 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:57.226894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602715f-253d-4a80-ad20-10b86c278e45 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:57.226894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602715f-253d-4a80-ad20-10b86c278e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:57.272570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c602715f-253d-4a80-ad20-10b86c278e45 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:57.272570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c602715f-253d-4a80-ad20-10b86c278e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:57.283341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 846/1696] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:57.289360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfecf-4cbf-4603-8206-106cc033437a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:57.289935 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfecf-4cbf-4603-8206-106cc033437a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:57.290446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b544c11-617b-4783-840e-1d902a333f67 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:57.290763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfecf-4cbf-4603-8206-106cc033437a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:57.296052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:57.297073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:57.297372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:57.301643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] PATH_INFO: `/v3/projects/638bd385720a461faa8398431c0319c0` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:57.309366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638bd385720a461faa8398431c0319c0)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:57.315359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-afbbfecf-4cbf-4603-8206-106cc033437a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:57.317194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-afbbfecf-4cbf-4603-8206-106cc033437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:57.322940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:57.330320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 847/1697] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:57.332034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbfecf-4cbf-4603-8206-106cc033437a None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:57.333853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-afbbfecf-4cbf-4603-8206-106cc033437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:57.465668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638bd385720a461faa8398431c0319c0', 'request_id': 'req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.488863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbfecf-4cbf-4603-8206-106cc033437a None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:57.561969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd1eab-ce43-4537-bac1-fa51ab1915b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:57.562814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1eab-ce43-4537-bac1-fa51ab1915b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:57.563103 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1eab-ce43-4537-bac1-fa51ab1915b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:57.563638 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1eab-ce43-4537-bac1-fa51ab1915b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:57.575331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638bd385720a461faa8398431c0319c0', 'request_id': 'req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.582836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638bd385720a461faa8398431c0319c0', 'request_id': 'req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.609733 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] The token cache is being invalidate because project 638bd385720a461faa8398431c0319c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:46:57.610036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.613307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d5a917fc-fd69-4ef0-8dd6-103364c8c6f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:57.629668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 851/1698] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:46:57 2022] DELETE /identity/v3/projects/638bd385720a461faa8398431c0319c0 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:57.632201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765666aa-4828-46b8-a06e-f3dd00574df3 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:57.633380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765666aa-4828-46b8-a06e-f3dd00574df3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:57.633625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765666aa-4828-46b8-a06e-f3dd00574df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:57.662298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-765666aa-4828-46b8-a06e-f3dd00574df3 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:57.664960 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-765666aa-4828-46b8-a06e-f3dd00574df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:57.770991 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd1eab-ce43-4537-bac1-fa51ab1915b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:57.773816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd1eab-ce43-4537-bac1-fa51ab1915b0 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:57.802684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 848/1699] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:46:57.806938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0bfa8-88bc-463b-bcb4-5b18a75d0423 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:57.806938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0bfa8-88bc-463b-bcb4-5b18a75d0423 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:57.806938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0bfa8-88bc-463b-bcb4-5b18a75d0423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:57.847814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 852/1700] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:57.858680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-70b0bfa8-88bc-463b-bcb4-5b18a75d0423 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:57.859945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-70b0bfa8-88bc-463b-bcb4-5b18a75d0423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:57.877831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765666aa-4828-46b8-a06e-f3dd00574df3 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:57.889275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 849/1701] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:57.899576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496aa2-9032-4265-9549-548b94348ee4 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:57.899937 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496aa2-9032-4265-9549-548b94348ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:57.904250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496aa2-9032-4265-9549-548b94348ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:57.926809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765666aa-4828-46b8-a06e-f3dd00574df3 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:57.943060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23ae2-1641-4c64-bf34-c00462370ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:57.943766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23ae2-1641-4c64-bf34-c00462370ece admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:57.944047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23ae2-1641-4c64-bf34-c00462370ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:57.944319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23ae2-1641-4c64-bf34-c00462370ece admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:57.950991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23ae2-1641-4c64-bf34-c00462370ece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:46:57.955109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23ae2-1641-4c64-bf34-c00462370ece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:57.955109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23ae2-1641-4c64-bf34-c00462370ece admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:57.970014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-03496aa2-9032-4265-9549-548b94348ee4 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:57.974992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-03496aa2-9032-4265-9549-548b94348ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:57.980007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 853/1702] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:46:57.984413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23ae2-1641-4c64-bf34-c00462370ece admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:57.997491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 850/1703] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:58.007171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03496aa2-9032-4265-9549-548b94348ee4 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:58.020641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03496aa2-9032-4265-9549-548b94348ee4 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:58.035903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75605fc-57bc-456e-b7fd-9117b732507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:58.035903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75605fc-57bc-456e-b7fd-9117b732507f admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:58.035903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75605fc-57bc-456e-b7fd-9117b732507f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:58.036121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75605fc-57bc-456e-b7fd-9117b732507f admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:58.036706 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75605fc-57bc-456e-b7fd-9117b732507f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:46:58.037098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75605fc-57bc-456e-b7fd-9117b732507f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:58.043508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75605fc-57bc-456e-b7fd-9117b732507f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:58.045048 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23ae2-1641-4c64-bf34-c00462370ece admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:58.087086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b072b-a7a1-4ccf-9135-e0ca38e53f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:58.089094 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b072b-a7a1-4ccf-9135-e0ca38e53f38 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:58.089591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b072b-a7a1-4ccf-9135-e0ca38e53f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:58.090212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b072b-a7a1-4ccf-9135-e0ca38e53f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:58.091817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b072b-a7a1-4ccf-9135-e0ca38e53f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:58.096970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b072b-a7a1-4ccf-9135-e0ca38e53f38 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:58.098702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 851/1704] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:46:58.105776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75605fc-57bc-456e-b7fd-9117b732507f admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:58.140061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75605fc-57bc-456e-b7fd-9117b732507f admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:58.161291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d3423-482f-47f6-88d5-04cfe03a95c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:58.161980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d3423-482f-47f6-88d5-04cfe03a95c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:58.162307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d3423-482f-47f6-88d5-04cfe03a95c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:58.162613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d3423-482f-47f6-88d5-04cfe03a95c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:58.163389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d3423-482f-47f6-88d5-04cfe03a95c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:58.165925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d3423-482f-47f6-88d5-04cfe03a95c7 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:58.361541 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 852/1705] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:58 2022] POST /identity/v3/projects => generated 399 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:58.366111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d3423-482f-47f6-88d5-04cfe03a95c7 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:58.368188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 854/1706] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:57 2022] POST /identity/v3/projects => generated 373 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:46:58.372999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b072b-a7a1-4ccf-9135-e0ca38e53f38 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:58.452987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:58.604520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b072b-a7a1-4ccf-9135-e0ca38e53f38 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:58.624687 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311d068-ec35-48fc-847a-9540668efc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:58.625530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d3423-482f-47f6-88d5-04cfe03a95c7 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:58.627652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311d068-ec35-48fc-847a-9540668efc1c admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:58.627945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311d068-ec35-48fc-847a-9540668efc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:58.628218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311d068-ec35-48fc-847a-9540668efc1c admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:58.633840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311d068-ec35-48fc-847a-9540668efc1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:58.641459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311d068-ec35-48fc-847a-9540668efc1c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:58.649691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e827e-c701-4f69-ba41-e30fbbd142c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:58.653968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e827e-c701-4f69-ba41-e30fbbd142c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:58.654284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e827e-c701-4f69-ba41-e30fbbd142c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:58.654570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e827e-c701-4f69-ba41-e30fbbd142c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:58.658213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e827e-c701-4f69-ba41-e30fbbd142c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:58.665405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e827e-c701-4f69-ba41-e30fbbd142c8 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:58.835183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 855/1707] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:58 2022] POST /identity/v3/users => generated 287 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:58.837904 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311d068-ec35-48fc-847a-9540668efc1c admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:58.854066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 853/1708] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:46:58 2022] POST /identity/v3/users => generated 300 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:46:58.855049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e827e-c701-4f69-ba41-e30fbbd142c8 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:58.883452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311d068-ec35-48fc-847a-9540668efc1c admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:58.892863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e827e-c701-4f69-ba41-e30fbbd142c8 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:58.897655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d65d66-504b-41f5-964c-c718d343886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:58.898965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d65d66-504b-41f5-964c-c718d343886d admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:58.899256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d65d66-504b-41f5-964c-c718d343886d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:58.899531 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d65d66-504b-41f5-964c-c718d343886d admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:58.903233 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d65d66-504b-41f5-964c-c718d343886d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:58.903233 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d65d66-504b-41f5-964c-c718d343886d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:58.918680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 856/1709] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:58.922652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d65d66-504b-41f5-964c-c718d343886d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:58.937144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30506-a05a-4086-92dc-d245581a6746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:58.940912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30506-a05a-4086-92dc-d245581a6746 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:58.941212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30506-a05a-4086-92dc-d245581a6746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:58.941513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30506-a05a-4086-92dc-d245581a6746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:58.947121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e30506-a05a-4086-92dc-d245581a6746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:58.948169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d65d66-504b-41f5-964c-c718d343886d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:58.951006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:46:58.954959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e30506-a05a-4086-92dc-d245581a6746 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:58.961120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7684102-d1ad-45a2-a858-2b9bdbf3595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:58.961816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7684102-d1ad-45a2-a858-2b9bdbf3595f admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:58.962102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7684102-d1ad-45a2-a858-2b9bdbf3595f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:58.963982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7684102-d1ad-45a2-a858-2b9bdbf3595f admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:58.965370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7684102-d1ad-45a2-a858-2b9bdbf3595f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:58.971184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7684102-d1ad-45a2-a858-2b9bdbf3595f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:59.001742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 854/1710] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:59.009882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30506-a05a-4086-92dc-d245581a6746 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:59.021705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 857/1711] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:59.026389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7684102-d1ad-45a2-a858-2b9bdbf3595f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:59.046443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7684102-d1ad-45a2-a858-2b9bdbf3595f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:59.051319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fd5f9-a7a7-466d-a7e6-ad2b9ff410bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:59.052198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fd5f9-a7a7-466d-a7e6-ad2b9ff410bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:59.052494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fd5f9-a7a7-466d-a7e6-ad2b9ff410bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:59.052752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fd5f9-a7a7-466d-a7e6-ad2b9ff410bc admin admin] PATH_INFO: `/v3/projects/58afc9af5f644ee68ea68633a3ad9611/users/7c1340a8199f4c5b90b4f3010ac31a2e/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:59.062396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30506-a05a-4086-92dc-d245581a6746 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:59.087847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fd5f9-a7a7-466d-a7e6-ad2b9ff410bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=58afc9af5f644ee68ea68633a3ad9611, user_id=7c1340a8199f4c5b90b4f3010ac31a2e, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:59.091364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554ed8d-f403-4060-a7d4-e63378400273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:59.091486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fd5f9-a7a7-466d-a7e6-ad2b9ff410bc admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:59.094290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554ed8d-f403-4060-a7d4-e63378400273 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:59.095491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554ed8d-f403-4060-a7d4-e63378400273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:59.095889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554ed8d-f403-4060-a7d4-e63378400273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:59.098711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554ed8d-f403-4060-a7d4-e63378400273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:59.107487 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554ed8d-f403-4060-a7d4-e63378400273 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:59.159197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 855/1712] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:46:59.161106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554ed8d-f403-4060-a7d4-e63378400273 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:59.182673 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554ed8d-f403-4060-a7d4-e63378400273 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:59.197663 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabc3f1-4566-4b08-848c-87f0e5eb7730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:59.199221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc3f1-4566-4b08-848c-87f0e5eb7730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:59.199221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc3f1-4566-4b08-848c-87f0e5eb7730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:59.199221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc3f1-4566-4b08-848c-87f0e5eb7730 admin admin] PATH_INFO: `/v3/projects/e82d04c5c23c4d94b1174820b19c498e/users/ef53413523cf47c7a22bc06a191397df/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:59.225967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 858/1713] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:59 2022] PUT /identity/v3/projects/58afc9af5f644ee68ea68633a3ad9611/users/7c1340a8199f4c5b90b4f3010ac31a2e/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:46:59.239708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef531c55-0088-47eb-a008-2cd59a3a25fe None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:59.240001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef531c55-0088-47eb-a008-2cd59a3a25fe None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:59.240285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef531c55-0088-47eb-a008-2cd59a3a25fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:59.258835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabc3f1-4566-4b08-848c-87f0e5eb7730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82d04c5c23c4d94b1174820b19c498e, user_id=ef53413523cf47c7a22bc06a191397df, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:59.261748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabc3f1-4566-4b08-848c-87f0e5eb7730 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:59.295901 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-ef531c55-0088-47eb-a008-2cd59a3a25fe None None] MFA Rules not processed for user `7c1340a8199f4c5b90b4f3010ac31a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:59.297141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ef531c55-0088-47eb-a008-2cd59a3a25fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:59.349154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 856/1714] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:46:59 2022] PUT /identity/v3/projects/e82d04c5c23c4d94b1174820b19c498e/users/ef53413523cf47c7a22bc06a191397df/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:59.350087 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabc3f1-4566-4b08-848c-87f0e5eb7730 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:59.363163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ebabc3f1-4566-4b08-848c-87f0e5eb7730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:59.536823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabc3f1-4566-4b08-848c-87f0e5eb7730 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:46:59.553464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:46:59.555311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:59.555833 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:59.556207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] PATH_INFO: `/v3/projects/a1bc854f78c845ada8ace42a0541c737` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:59.557740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1bc854f78c845ada8ace42a0541c737)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:46:59.560091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:46:59.567378 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 859/1715] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:59.568722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645a6d-c2c9-4a44-8b87-824b6f9ab835 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:46:59.569017 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645a6d-c2c9-4a44-8b87-824b6f9ab835 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:46:59.569300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645a6d-c2c9-4a44-8b87-824b6f9ab835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:46:59.641343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e4645a6d-c2c9-4a44-8b87-824b6f9ab835 None None] MFA Rules not processed for user `ef53413523cf47c7a22bc06a191397df`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:46:59.642653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e4645a6d-c2c9-4a44-8b87-824b6f9ab835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:59.740509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bc854f78c845ada8ace42a0541c737', 'request_id': 'req-21a45ea4-242b-47a7-839d-8e22153561e3'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:59.812236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 860/1716] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:46:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:46:59.813132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4645a6d-c2c9-4a44-8b87-824b6f9ab835 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:59.820809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e4645a6d-c2c9-4a44-8b87-824b6f9ab835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:59.880432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bc854f78c845ada8ace42a0541c737', 'request_id': 'req-21a45ea4-242b-47a7-839d-8e22153561e3'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:59.894918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bc854f78c845ada8ace42a0541c737', 'request_id': 'req-21a45ea4-242b-47a7-839d-8e22153561e3'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:59.922503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] The token cache is being invalidate because project a1bc854f78c845ada8ace42a0541c737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:46:59.922805 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:59.933018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:46:59.937306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 857/1717] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:46:59 2022] DELETE /identity/v3/projects/a1bc854f78c845ada8ace42a0541c737 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:46:59.939147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:46:59.948260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:46:59.985477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4645a6d-c2c9-4a44-8b87-824b6f9ab835 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:00.085492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45ea4-242b-47a7-839d-8e22153561e3 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:00.094407 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d109e2a-7151-44b8-89cf-664aeba3627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:00.095981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d109e2a-7151-44b8-89cf-664aeba3627e admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:00.096343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d109e2a-7151-44b8-89cf-664aeba3627e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:00.096627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d109e2a-7151-44b8-89cf-664aeba3627e admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:00.097332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d109e2a-7151-44b8-89cf-664aeba3627e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:00.119441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d109e2a-7151-44b8-89cf-664aeba3627e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:00.186383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ea2e7-9f69-4265-98b6-cb5f29364e3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:00.187461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ea2e7-9f69-4265-98b6-cb5f29364e3b service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:00.190409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ea2e7-9f69-4265-98b6-cb5f29364e3b service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:00.191051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ea2e7-9f69-4265-98b6-cb5f29364e3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:00.201395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f04ea2e7-9f69-4265-98b6-cb5f29364e3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:00.260570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 858/1718] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:46:59 2022] POST /identity/v3/projects => generated 399 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:00.264904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb154af-fb4b-4a70-8ed2-03c4f1c47dd1 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:00.265369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb154af-fb4b-4a70-8ed2-03c4f1c47dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:00.265658 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb154af-fb4b-4a70-8ed2-03c4f1c47dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:00.284127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:00.343022 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-8eb154af-fb4b-4a70-8ed2-03c4f1c47dd1 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:00.344483 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8eb154af-fb4b-4a70-8ed2-03c4f1c47dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:00.347797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ea2e7-9f69-4265-98b6-cb5f29364e3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:00.353800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ea2e7-9f69-4265-98b6-cb5f29364e3b service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:00.373667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 861/1719] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:46:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:00.375124 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb46a8-3293-4ef3-bf9d-c81c909e94ac None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:00.375745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb46a8-3293-4ef3-bf9d-c81c909e94ac None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:00.375745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb46a8-3293-4ef3-bf9d-c81c909e94ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:00.451922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-8beb46a8-3293-4ef3-bf9d-c81c909e94ac None None] MFA Rules not processed for user `7f7bf346718b4c61bab0fdc198af8818`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:00.453201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8beb46a8-3293-4ef3-bf9d-c81c909e94ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:00.512790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 859/1720] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:00.512790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb154af-fb4b-4a70-8ed2-03c4f1c47dd1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:00.531141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb154af-fb4b-4a70-8ed2-03c4f1c47dd1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:00.554709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ecfdb-ef1a-4ff3-b518-4b695a3014bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:00.558259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ecfdb-ef1a-4ff3-b518-4b695a3014bd admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:00.560256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ecfdb-ef1a-4ff3-b518-4b695a3014bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:00.560256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ecfdb-ef1a-4ff3-b518-4b695a3014bd admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:00.560256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ecfdb-ef1a-4ff3-b518-4b695a3014bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:00.570535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ecfdb-ef1a-4ff3-b518-4b695a3014bd admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:00.606369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:00.709560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 860/1721] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:00 2022] POST /identity/v3/users => generated 306 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:00.711669 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3458-3bd0-4007-b235-a277d65a0442 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:00.716540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3458-3bd0-4007-b235-a277d65a0442 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:00.716971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3458-3bd0-4007-b235-a277d65a0442 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:00.719193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 861/1722] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:47:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:47:00.721664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95feb10-cf50-4b87-b5fb-50e483cd4724 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:00.722683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95feb10-cf50-4b87-b5fb-50e483cd4724 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:00.724280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95feb10-cf50-4b87-b5fb-50e483cd4724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:00.781184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-d95feb10-cf50-4b87-b5fb-50e483cd4724 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:00.788144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d95feb10-cf50-4b87-b5fb-50e483cd4724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:00.813294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 862/1723] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:00.813294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95feb10-cf50-4b87-b5fb-50e483cd4724 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:00.833091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95feb10-cf50-4b87-b5fb-50e483cd4724 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:00.844367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc71893-b20e-4747-ab67-c124fd193b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:00.847610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc71893-b20e-4747-ab67-c124fd193b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:00.847610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc71893-b20e-4747-ab67-c124fd193b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:00.847610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc71893-b20e-4747-ab67-c124fd193b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:00.847610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc71893-b20e-4747-ab67-c124fd193b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:00.851798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc71893-b20e-4747-ab67-c124fd193b05 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:00.854637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 862/1724] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:00.856225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb46a8-3293-4ef3-bf9d-c81c909e94ac None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:00.885721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 863/1725] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:00.886983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb46a8-3293-4ef3-bf9d-c81c909e94ac None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:00.887355 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bee2f-c52e-4054-be0d-4c704dfb490d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:00.887767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bee2f-c52e-4054-be0d-4c704dfb490d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:00.888152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bee2f-c52e-4054-be0d-4c704dfb490d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:00.903916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e160b-1f34-458e-b63c-8f91c891b950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:00.904758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e160b-1f34-458e-b63c-8f91c891b950 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:00.905054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e160b-1f34-458e-b63c-8f91c891b950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:00.905319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e160b-1f34-458e-b63c-8f91c891b950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:00.906141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e160b-1f34-458e-b63c-8f91c891b950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:00.906445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e160b-1f34-458e-b63c-8f91c891b950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:00.911670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e160b-1f34-458e-b63c-8f91c891b950 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:00.925229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-396bee2f-c52e-4054-be0d-4c704dfb490d None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:00.928630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-396bee2f-c52e-4054-be0d-4c704dfb490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:00.943583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 863/1726] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:00.944386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af964acb-138f-484b-ba4c-aae04cc8ab7f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:00.956807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af964acb-138f-484b-ba4c-aae04cc8ab7f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:00.957391 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af964acb-138f-484b-ba4c-aae04cc8ab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:01.015450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-af964acb-138f-484b-ba4c-aae04cc8ab7f None None] MFA Rules not processed for user `c6523f0f4dc249659c4e63fc5ee5e783`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:01.020367 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-af964acb-138f-484b-ba4c-aae04cc8ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:01.152820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 864/1727] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:47:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:01.155006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bee2f-c52e-4054-be0d-4c704dfb490d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:01.196790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bee2f-c52e-4054-be0d-4c704dfb490d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:01.213402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5566463-fab1-44cc-8320-aa2b305bebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:01.215291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5566463-fab1-44cc-8320-aa2b305bebee admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:01.219450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5566463-fab1-44cc-8320-aa2b305bebee admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:01.219751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5566463-fab1-44cc-8320-aa2b305bebee admin admin] PATH_INFO: `/v3/projects/3a027b8d7c00442ca32f917ae6e7df43/users/f6b7316d86c14c4a8506c59e4e3e8460/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:01.243459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 864/1728] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:01.244567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af964acb-138f-484b-ba4c-aae04cc8ab7f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:01.273669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af964acb-138f-484b-ba4c-aae04cc8ab7f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:01.282036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5566463-fab1-44cc-8320-aa2b305bebee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a027b8d7c00442ca32f917ae6e7df43, user_id=f6b7316d86c14c4a8506c59e4e3e8460, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:01.286990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:01.294839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca25b4f-9711-4e49-8faf-0aacbd2012ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:01.295638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25b4f-9711-4e49-8faf-0aacbd2012ca admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:01.296011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25b4f-9711-4e49-8faf-0aacbd2012ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:01.296357 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25b4f-9711-4e49-8faf-0aacbd2012ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:01.297679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca25b4f-9711-4e49-8faf-0aacbd2012ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:01.303385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca25b4f-9711-4e49-8faf-0aacbd2012ca admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:01.319365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5566463-fab1-44cc-8320-aa2b305bebee admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:01.427093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 865/1729] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:01 2022] PUT /identity/v3/projects/3a027b8d7c00442ca32f917ae6e7df43/users/f6b7316d86c14c4a8506c59e4e3e8460/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:01.428682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5566463-fab1-44cc-8320-aa2b305bebee admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:01.438818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b5566463-fab1-44cc-8320-aa2b305bebee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:01.441627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 865/1730] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:01 2022] POST /identity/v3/projects => generated 405 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:01.445494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca25b4f-9711-4e49-8faf-0aacbd2012ca admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:01.581543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca25b4f-9711-4e49-8faf-0aacbd2012ca admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:01.585741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:01.597893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bad84-ba07-4fb1-b34f-c03cf13115f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:01.618303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bad84-ba07-4fb1-b34f-c03cf13115f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:01.618775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bad84-ba07-4fb1-b34f-c03cf13115f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:01.619063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bad84-ba07-4fb1-b34f-c03cf13115f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:01.619858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bad84-ba07-4fb1-b34f-c03cf13115f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:01.621517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bad84-ba07-4fb1-b34f-c03cf13115f8 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:01.650597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 866/1731] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:01.651521 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bad84-ba07-4fb1-b34f-c03cf13115f8 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:01.694274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bad84-ba07-4fb1-b34f-c03cf13115f8 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:01.732935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0dfc1-2839-4d65-9ccc-84c567a8c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:01.733633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0dfc1-2839-4d65-9ccc-84c567a8c8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:01.733923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0dfc1-2839-4d65-9ccc-84c567a8c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:01.734196 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0dfc1-2839-4d65-9ccc-84c567a8c8ca admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:01.734928 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0dfc1-2839-4d65-9ccc-84c567a8c8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:01.736969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0dfc1-2839-4d65-9ccc-84c567a8c8ca admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:01.770453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5566463-fab1-44cc-8320-aa2b305bebee admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:01.812942 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:01.908825 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 867/1732] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:01 2022] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:01.910220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18e192-0eaa-4644-af59-3f709c9de36a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:01.910539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18e192-0eaa-4644-af59-3f709c9de36a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:01.910820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18e192-0eaa-4644-af59-3f709c9de36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:01.936692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9106-6e1b-4076-9f83-8f7a11c395cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:01.938216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9106-6e1b-4076-9f83-8f7a11c395cf service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:01.938671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9106-6e1b-4076-9f83-8f7a11c395cf service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:01.939803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9106-6e1b-4076-9f83-8f7a11c395cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:01.968693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-bd18e192-0eaa-4644-af59-3f709c9de36a None None] MFA Rules not processed for user `cc861f1c354f45b09cb61fd86245a5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:01.970096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-bd18e192-0eaa-4644-af59-3f709c9de36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:02.104611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b9106-6e1b-4076-9f83-8f7a11c395cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:02.107730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b9106-6e1b-4076-9f83-8f7a11c395cf service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:02.145948 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 866/1733] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:02.151809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 868/1734] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:02.152711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18e192-0eaa-4644-af59-3f709c9de36a None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:02.180010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9106-6e1b-4076-9f83-8f7a11c395cf service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:02.180287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18e192-0eaa-4644-af59-3f709c9de36a None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:02.180287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f17d6-1c0b-4dba-922b-1e3d96102c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:02.180287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f17d6-1c0b-4dba-922b-1e3d96102c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:02.180287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f17d6-1c0b-4dba-922b-1e3d96102c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:02.180618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f17d6-1c0b-4dba-922b-1e3d96102c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:02.180618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f17d6-1c0b-4dba-922b-1e3d96102c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:02.183137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f17d6-1c0b-4dba-922b-1e3d96102c5b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:02.186215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9106-6e1b-4076-9f83-8f7a11c395cf service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:02.191997 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc97dd-f6bf-47c9-8f2b-79bc0323a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:02.193790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc97dd-f6bf-47c9-8f2b-79bc0323a1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:02.194186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc97dd-f6bf-47c9-8f2b-79bc0323a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:02.194683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc97dd-f6bf-47c9-8f2b-79bc0323a1a6 admin admin] PATH_INFO: `/v3/projects/3a027b8d7c00442ca32f917ae6e7df43/users/f6b7316d86c14c4a8506c59e4e3e8460/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:02.198954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc97dd-f6bf-47c9-8f2b-79bc0323a1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a027b8d7c00442ca32f917ae6e7df43, user_id=f6b7316d86c14c4a8506c59e4e3e8460, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:02.202105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc97dd-f6bf-47c9-8f2b-79bc0323a1a6 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:02.204319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 869/1735] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:02.208792 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f17d6-1c0b-4dba-922b-1e3d96102c5b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:02.220875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 867/1736] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:02 2022] PUT /identity/v3/projects/3a027b8d7c00442ca32f917ae6e7df43/users/f6b7316d86c14c4a8506c59e4e3e8460/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:02.226765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f17d6-1c0b-4dba-922b-1e3d96102c5b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:02.231515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd345e1-ec7c-42f5-aac5-b37307238f60 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:02.231952 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd345e1-ec7c-42f5-aac5-b37307238f60 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:02.232356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd345e1-ec7c-42f5-aac5-b37307238f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:02.310737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-2cd345e1-ec7c-42f5-aac5-b37307238f60 None None] MFA Rules not processed for user `f6b7316d86c14c4a8506c59e4e3e8460`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:02.313924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2cd345e1-ec7c-42f5-aac5-b37307238f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:02.411649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341309c6-e765-4b8f-b618-77568818803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:02.412693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341309c6-e765-4b8f-b618-77568818803d admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:02.412693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341309c6-e765-4b8f-b618-77568818803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:02.412899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341309c6-e765-4b8f-b618-77568818803d admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:02.414263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341309c6-e765-4b8f-b618-77568818803d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:02.417155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341309c6-e765-4b8f-b618-77568818803d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:02.474965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 870/1737] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:02.483684 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341309c6-e765-4b8f-b618-77568818803d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:02.531664 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341309c6-e765-4b8f-b618-77568818803d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:02.541894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394df1e-bcac-44ae-9e18-6eb0109b5f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:02.543502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394df1e-bcac-44ae-9e18-6eb0109b5f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:02.544009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394df1e-bcac-44ae-9e18-6eb0109b5f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:02.544448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394df1e-bcac-44ae-9e18-6eb0109b5f56 admin admin] PATH_INFO: `/v3/projects/987d2d893ecb46ec94f06f9c75945554/users/f5d3db3296784552976e511e3778bdad/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:02.577569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 868/1738] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:02.584902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd345e1-ec7c-42f5-aac5-b37307238f60 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:02.592511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2cd345e1-ec7c-42f5-aac5-b37307238f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:02.596499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394df1e-bcac-44ae-9e18-6eb0109b5f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987d2d893ecb46ec94f06f9c75945554, user_id=f5d3db3296784552976e511e3778bdad, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:02.604975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394df1e-bcac-44ae-9e18-6eb0109b5f56 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:02.738158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd345e1-ec7c-42f5-aac5-b37307238f60 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:02.743782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bd9a4-f5da-4382-857a-6459926adf9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:02.744458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd9a4-f5da-4382-857a-6459926adf9f service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:02.744741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd9a4-f5da-4382-857a-6459926adf9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:02.745260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd9a4-f5da-4382-857a-6459926adf9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:02.763114 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bd9a4-f5da-4382-857a-6459926adf9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:02.764913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bd9a4-f5da-4382-857a-6459926adf9f service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:02.803816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 869/1739] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:02 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:02.805582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacbc6f-c899-4d46-9163-ac166d45c865 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:02.805933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacbc6f-c899-4d46-9163-ac166d45c865 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:02.806496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacbc6f-c899-4d46-9163-ac166d45c865 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:02.815235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 870/1740] 10.222.0.40 () {54 vars in 912 bytes} [Wed Jun 8 06:47:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:47:02.824675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab76e-5c8f-4cea-bbe4-7fed18c45fb3 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:02.824998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab76e-5c8f-4cea-bbe4-7fed18c45fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:02.825289 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab76e-5c8f-4cea-bbe4-7fed18c45fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:02.852879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-912ab76e-5c8f-4cea-bbe4-7fed18c45fb3 None None] MFA Rules not processed for user `11838a2908884cc79df912b3b2199564`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:02.854716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-912ab76e-5c8f-4cea-bbe4-7fed18c45fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:02.943459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 871/1741] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:47:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:02.966668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 871/1742] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:02 2022] PUT /identity/v3/projects/987d2d893ecb46ec94f06f9c75945554/users/f5d3db3296784552976e511e3778bdad/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:02.979172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2849b84-2bce-4460-b501-4afeced7e246 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:02.985891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2849b84-2bce-4460-b501-4afeced7e246 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:02.986267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2849b84-2bce-4460-b501-4afeced7e246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:03.006423 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394df1e-bcac-44ae-9e18-6eb0109b5f56 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:03.008976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9394df1e-bcac-44ae-9e18-6eb0109b5f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:03.046928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c2849b84-2bce-4460-b501-4afeced7e246 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:03.048623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c2849b84-2bce-4460-b501-4afeced7e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:03.175444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394df1e-bcac-44ae-9e18-6eb0109b5f56 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:03.192033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fa36f-eb78-4f9f-8594-17a5ba2f8133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:03.192710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa36f-eb78-4f9f-8594-17a5ba2f8133 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:03.192997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa36f-eb78-4f9f-8594-17a5ba2f8133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:03.193276 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa36f-eb78-4f9f-8594-17a5ba2f8133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:03.210786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fa36f-eb78-4f9f-8594-17a5ba2f8133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:03.214391 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fa36f-eb78-4f9f-8594-17a5ba2f8133 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:03.238576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 872/1743] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:03.238576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2849b84-2bce-4460-b501-4afeced7e246 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:03.259294 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 872/1744] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:03.263114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fa36f-eb78-4f9f-8594-17a5ba2f8133 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:03.438849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fa36f-eb78-4f9f-8594-17a5ba2f8133 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:03.449229 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14316c9-b006-479e-adb0-8bf5ca4e0a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:03.449922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14316c9-b006-479e-adb0-8bf5ca4e0a9c service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:03.450208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14316c9-b006-479e-adb0-8bf5ca4e0a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:03.450673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14316c9-b006-479e-adb0-8bf5ca4e0a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:03.456447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e14316c9-b006-479e-adb0-8bf5ca4e0a9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:03.512269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2849b84-2bce-4460-b501-4afeced7e246 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:03.543375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947465bd-06fa-4f70-b394-44e9b3aba68f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:03.544325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947465bd-06fa-4f70-b394-44e9b3aba68f service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:03.544769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947465bd-06fa-4f70-b394-44e9b3aba68f service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:03.545341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947465bd-06fa-4f70-b394-44e9b3aba68f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:03.591446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947465bd-06fa-4f70-b394-44e9b3aba68f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:03.602400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947465bd-06fa-4f70-b394-44e9b3aba68f service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:03.622091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14316c9-b006-479e-adb0-8bf5ca4e0a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:03.631386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 873/1745] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:03.631659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14316c9-b006-479e-adb0-8bf5ca4e0a9c service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:03.634317 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947465bd-06fa-4f70-b394-44e9b3aba68f service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:03.648486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947465bd-06fa-4f70-b394-44e9b3aba68f service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:03.652267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 873/1746] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:03.662816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dca15-8864-4229-8af4-266bf40ca6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:03.666112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dca15-8864-4229-8af4-266bf40ca6ed service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:03.666475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dca15-8864-4229-8af4-266bf40ca6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:03.666759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dca15-8864-4229-8af4-266bf40ca6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:03.707388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dca15-8864-4229-8af4-266bf40ca6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:03.712376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dca15-8864-4229-8af4-266bf40ca6ed service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:03.717459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:03.768761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 874/1747] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:03.801237 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:05.221929 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:06.292309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:06.981218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14316c9-b006-479e-adb0-8bf5ca4e0a9c service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:06.987412 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e14316c9-b006-479e-adb0-8bf5ca4e0a9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:07.001765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14316c9-b006-479e-adb0-8bf5ca4e0a9c service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:07.009490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a2e8a-327a-4669-8eee-b8e7d2d2a330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:07.010565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2e8a-327a-4669-8eee-b8e7d2d2a330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:07.012460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2e8a-327a-4669-8eee-b8e7d2d2a330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:07.012460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2e8a-327a-4669-8eee-b8e7d2d2a330 admin admin] PATH_INFO: `/v3/users/7c1340a8199f4c5b90b4f3010ac31a2e` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:07.013388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a2e8a-327a-4669-8eee-b8e7d2d2a330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1340a8199f4c5b90b4f3010ac31a2e)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:07.015703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a2e8a-327a-4669-8eee-b8e7d2d2a330 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:07.280712 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7d0a2e8a-327a-4669-8eee-b8e7d2d2a330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1340a8199f4c5b90b4f3010ac31a2e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:07.286974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7d0a2e8a-327a-4669-8eee-b8e7d2d2a330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1340a8199f4c5b90b4f3010ac31a2e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:07.318836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fab7e-fadf-4d65-9c59-e7e4d9c7babc None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:07.319288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fab7e-fadf-4d65-9c59-e7e4d9c7babc None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:07.320351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fab7e-fadf-4d65-9c59-e7e4d9c7babc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:07.359519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-026fab7e-fadf-4d65-9c59-e7e4d9c7babc None None] MFA Rules not processed for user `7f7bf346718b4c61bab0fdc198af8818`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:07.361298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-026fab7e-fadf-4d65-9c59-e7e4d9c7babc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:07.421850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7d0a2e8a-327a-4669-8eee-b8e7d2d2a330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1340a8199f4c5b90b4f3010ac31a2e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:07.425565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:07.437583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7d0a2e8a-327a-4669-8eee-b8e7d2d2a330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1340a8199f4c5b90b4f3010ac31a2e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:07.449334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7d0a2e8a-327a-4669-8eee-b8e7d2d2a330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1340a8199f4c5b90b4f3010ac31a2e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:07.459252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 874/1748] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:06 2022] DELETE /identity/v3/users/7c1340a8199f4c5b90b4f3010ac31a2e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:07.466691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 875/1749] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:07.468334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed4a3b-2560-418b-b2b3-b3db18fe5bda None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:07.468646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed4a3b-2560-418b-b2b3-b3db18fe5bda None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:07.468894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed4a3b-2560-418b-b2b3-b3db18fe5bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:07.486728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c7ed4a3b-2560-418b-b2b3-b3db18fe5bda None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:07.487987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c7ed4a3b-2560-418b-b2b3-b3db18fe5bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:07.587828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 875/1750] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:07.603140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fab7e-fadf-4d65-9c59-e7e4d9c7babc None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:07.605187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-026fab7e-fadf-4d65-9c59-e7e4d9c7babc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:07.623568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fab7e-fadf-4d65-9c59-e7e4d9c7babc None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:07.693776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c13ca3-aab7-4419-8253-27ad8279b24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:07.694508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c13ca3-aab7-4419-8253-27ad8279b24d service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:07.694797 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c13ca3-aab7-4419-8253-27ad8279b24d service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:07.695135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c13ca3-aab7-4419-8253-27ad8279b24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:07.705782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c13ca3-aab7-4419-8253-27ad8279b24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:07.707266 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c13ca3-aab7-4419-8253-27ad8279b24d service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:07.718565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 876/1751] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:07.807598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed4a3b-2560-418b-b2b3-b3db18fe5bda None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:07.809142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c7ed4a3b-2560-418b-b2b3-b3db18fe5bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:07.836340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed4a3b-2560-418b-b2b3-b3db18fe5bda None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:07.845555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c2992-6b79-4fa9-b2b8-6b0d2379979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:07.845555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c2992-6b79-4fa9-b2b8-6b0d2379979c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:07.845555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c2992-6b79-4fa9-b2b8-6b0d2379979c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:07.845555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c2992-6b79-4fa9-b2b8-6b0d2379979c admin admin] PATH_INFO: `/v3/users/f8f948b0746b4728be956519447c4b8f` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:07.846756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c2992-6b79-4fa9-b2b8-6b0d2379979c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f948b0746b4728be956519447c4b8f)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:07.848776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c2992-6b79-4fa9-b2b8-6b0d2379979c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:07.863947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67013a5-3891-4f03-a030-c25a413de96d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:07.864236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67013a5-3891-4f03-a030-c25a413de96d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:07.864521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67013a5-3891-4f03-a030-c25a413de96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:07.912403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a67013a5-3891-4f03-a030-c25a413de96d None None] MFA Rules not processed for user `f5d3db3296784552976e511e3778bdad`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:07.914258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a67013a5-3891-4f03-a030-c25a413de96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:08.065029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 877/1752] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:07 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:08.069892 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67013a5-3891-4f03-a030-c25a413de96d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:08.072660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a67013a5-3891-4f03-a030-c25a413de96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:08.074228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-657c2992-6b79-4fa9-b2b8-6b0d2379979c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f948b0746b4728be956519447c4b8f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:08.075552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-657c2992-6b79-4fa9-b2b8-6b0d2379979c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f948b0746b4728be956519447c4b8f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:08.094583 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67013a5-3891-4f03-a030-c25a413de96d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:08.099511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709731-d621-45e8-8017-e3907472a95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:08.100291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709731-d621-45e8-8017-e3907472a95e admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.101240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709731-d621-45e8-8017-e3907472a95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.101515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709731-d621-45e8-8017-e3907472a95e admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.102660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac709731-d621-45e8-8017-e3907472a95e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:08.105148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac709731-d621-45e8-8017-e3907472a95e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:08.205331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-657c2992-6b79-4fa9-b2b8-6b0d2379979c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f948b0746b4728be956519447c4b8f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:08.220373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-657c2992-6b79-4fa9-b2b8-6b0d2379979c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f948b0746b4728be956519447c4b8f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:08.230397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-657c2992-6b79-4fa9-b2b8-6b0d2379979c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f948b0746b4728be956519447c4b8f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:08.239719 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 876/1753] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:07 2022] DELETE /identity/v3/users/f8f948b0746b4728be956519447c4b8f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:08.241325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1d79a-abbf-429b-918a-36acc1926919 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.241616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1d79a-abbf-429b-918a-36acc1926919 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.241958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1d79a-abbf-429b-918a-36acc1926919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.261264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-94e1d79a-abbf-429b-918a-36acc1926919 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:08.262366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-94e1d79a-abbf-429b-918a-36acc1926919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:08.274920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 878/1754] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:08 2022] POST /identity/v3/projects => generated 403 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:08.279219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709731-d621-45e8-8017-e3907472a95e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:08.290466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ac709731-d621-45e8-8017-e3907472a95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:08.305086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:08.386872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 877/1755] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:08.387913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1d79a-abbf-429b-918a-36acc1926919 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:08.400347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-94e1d79a-abbf-429b-918a-36acc1926919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:08.409621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709731-d621-45e8-8017-e3907472a95e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:08.416930 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b4210-f088-4a6e-8335-af0469fd0af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:08.417678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4210-f088-4a6e-8335-af0469fd0af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.417794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1d79a-abbf-429b-918a-36acc1926919 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:08.417957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4210-f088-4a6e-8335-af0469fd0af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.418221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4210-f088-4a6e-8335-af0469fd0af4 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.419095 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b4210-f088-4a6e-8335-af0469fd0af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:08.421235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b4210-f088-4a6e-8335-af0469fd0af4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:08.427814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:08.428800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.429083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.429358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] PATH_INFO: `/v3/projects/58afc9af5f644ee68ea68633a3ad9611` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.431240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58afc9af5f644ee68ea68633a3ad9611)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:08.434182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:08.510031 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 879/1756] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:08 2022] POST /identity/v3/users => generated 308 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:08.525931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b4210-f088-4a6e-8335-af0469fd0af4 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:08.525931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-283b4210-f088-4a6e-8335-af0469fd0af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:08.574132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b4210-f088-4a6e-8335-af0469fd0af4 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:08.578080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6019c-9655-410b-bbfd-0009b550ed1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:08.578888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6019c-9655-410b-bbfd-0009b550ed1b service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.579155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6019c-9655-410b-bbfd-0009b550ed1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.579440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6019c-9655-410b-bbfd-0009b550ed1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.601367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6019c-9655-410b-bbfd-0009b550ed1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:08.606723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6019c-9655-410b-bbfd-0009b550ed1b service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:08.623281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58afc9af5f644ee68ea68633a3ad9611', 'request_id': 'req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:08.632647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 880/1757] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:08.634182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6019c-9655-410b-bbfd-0009b550ed1b service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:08.646937 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6019c-9655-410b-bbfd-0009b550ed1b service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:08.692011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58afc9af5f644ee68ea68633a3ad9611', 'request_id': 'req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:08.704318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58afc9af5f644ee68ea68633a3ad9611', 'request_id': 'req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:08.729492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a929bb-efd7-435f-9861-48c356811bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:08.732262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] The token cache is being invalidate because project 58afc9af5f644ee68ea68633a3ad9611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:08.732262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:08.732456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a929bb-efd7-435f-9861-48c356811bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.732456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a929bb-efd7-435f-9861-48c356811bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.732456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a929bb-efd7-435f-9861-48c356811bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.732456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a929bb-efd7-435f-9861-48c356811bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:08.734491 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-587bba4a-4a63-44b9-a6ac-e1fdbfd42483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:08.735162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a929bb-efd7-435f-9861-48c356811bbc admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:08.736606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 878/1758] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:08 2022] DELETE /identity/v3/projects/58afc9af5f644ee68ea68633a3ad9611 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:08.743100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7663-862b-4d5d-902f-57f22e8dbfab None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.743973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7663-862b-4d5d-902f-57f22e8dbfab None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.749440 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7663-862b-4d5d-902f-57f22e8dbfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.749681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 881/1759] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:08.752698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a929bb-efd7-435f-9861-48c356811bbc admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:08.755584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-68a929bb-efd7-435f-9861-48c356811bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:08.777830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-11aa7663-862b-4d5d-902f-57f22e8dbfab None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:08.779115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-11aa7663-862b-4d5d-902f-57f22e8dbfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:08.784077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a929bb-efd7-435f-9861-48c356811bbc admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:08.788660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81a866-9edf-4a5e-81a8-dff6edf2648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:08.791068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81a866-9edf-4a5e-81a8-dff6edf2648d admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.791738 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81a866-9edf-4a5e-81a8-dff6edf2648d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.792659 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81a866-9edf-4a5e-81a8-dff6edf2648d admin admin] PATH_INFO: `/v3/projects/bbedf667f16643a7ab5bfd39af438156/users/c8a09bfa2165445ba390bc5629dde437/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.793857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 879/1760] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:08.802560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60744b-abca-4814-b648-21d2af6d05af None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.803069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60744b-abca-4814-b648-21d2af6d05af None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.803500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60744b-abca-4814-b648-21d2af6d05af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.824041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81a866-9edf-4a5e-81a8-dff6edf2648d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbedf667f16643a7ab5bfd39af438156, user_id=c8a09bfa2165445ba390bc5629dde437, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:08.824041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81a866-9edf-4a5e-81a8-dff6edf2648d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:08.836545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-fe60744b-abca-4814-b648-21d2af6d05af None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:08.838321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fe60744b-abca-4814-b648-21d2af6d05af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:08.848292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 880/1761] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:08.852122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60744b-abca-4814-b648-21d2af6d05af None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:08.861310 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60744b-abca-4814-b648-21d2af6d05af None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:08.866883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290743c-7b9b-48f0-ba63-bbbb234c878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:08.867642 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290743c-7b9b-48f0-ba63-bbbb234c878e admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.868006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290743c-7b9b-48f0-ba63-bbbb234c878e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.868361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290743c-7b9b-48f0-ba63-bbbb234c878e admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.869152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290743c-7b9b-48f0-ba63-bbbb234c878e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:08.869538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290743c-7b9b-48f0-ba63-bbbb234c878e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:08.871285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290743c-7b9b-48f0-ba63-bbbb234c878e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:08.878503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 882/1762] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:08 2022] PUT /identity/v3/projects/bbedf667f16643a7ab5bfd39af438156/users/c8a09bfa2165445ba390bc5629dde437/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:08.882920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81a866-9edf-4a5e-81a8-dff6edf2648d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:08.890230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 881/1763] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:47:08.894449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290743c-7b9b-48f0-ba63-bbbb234c878e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:08.908807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290743c-7b9b-48f0-ba63-bbbb234c878e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:08.963006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81a866-9edf-4a5e-81a8-dff6edf2648d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:08.968499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ae483-0195-4440-bd5e-4249fb17119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:08.969170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ae483-0195-4440-bd5e-4249fb17119b admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.969453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ae483-0195-4440-bd5e-4249fb17119b admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.969732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ae483-0195-4440-bd5e-4249fb17119b admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.970510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ae483-0195-4440-bd5e-4249fb17119b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:08.972143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ae483-0195-4440-bd5e-4249fb17119b admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:08.981651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:08.984712 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb2d89-0a97-4695-a0a6-d688acb5f749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:08.985661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2d89-0a97-4695-a0a6-d688acb5f749 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:08.986444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2d89-0a97-4695-a0a6-d688acb5f749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:08.986618 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 883/1764] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:08.987019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2d89-0a97-4695-a0a6-d688acb5f749 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:08.987368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ae483-0195-4440-bd5e-4249fb17119b admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:08.988185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb2d89-0a97-4695-a0a6-d688acb5f749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:08.992604 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb2d89-0a97-4695-a0a6-d688acb5f749 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:08.999992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ae483-0195-4440-bd5e-4249fb17119b admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:09.009489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebc586-0d22-41a6-ad4c-3b8814edb529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:09.011791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebc586-0d22-41a6-ad4c-3b8814edb529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:09.012321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebc586-0d22-41a6-ad4c-3b8814edb529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:09.012908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebc586-0d22-41a6-ad4c-3b8814edb529 admin admin] PATH_INFO: `/v3/projects/bbedf667f16643a7ab5bfd39af438156/users/c8a09bfa2165445ba390bc5629dde437/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:09.015708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebc586-0d22-41a6-ad4c-3b8814edb529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbedf667f16643a7ab5bfd39af438156, user_id=c8a09bfa2165445ba390bc5629dde437, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:09.018852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebc586-0d22-41a6-ad4c-3b8814edb529 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:09.030304 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 884/1765] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:08 2022] PUT /identity/v3/projects/bbedf667f16643a7ab5bfd39af438156/users/c8a09bfa2165445ba390bc5629dde437/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:09.093060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 882/1766] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:08 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:09.097106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebc586-0d22-41a6-ad4c-3b8814edb529 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:09.205601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebc586-0d22-41a6-ad4c-3b8814edb529 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:09.271637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9de905-a861-47fb-81b4-4cdc87f55be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:09.272313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9de905-a861-47fb-81b4-4cdc87f55be8 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:09.272594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9de905-a861-47fb-81b4-4cdc87f55be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:09.272936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9de905-a861-47fb-81b4-4cdc87f55be8 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:09.273627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9de905-a861-47fb-81b4-4cdc87f55be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:09.275553 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9de905-a861-47fb-81b4-4cdc87f55be8 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:09.312330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb2d89-0a97-4695-a0a6-d688acb5f749 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:09.314340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e7cb2d89-0a97-4695-a0a6-d688acb5f749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:09.332967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb2d89-0a97-4695-a0a6-d688acb5f749 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:09.338604 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:09.339490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:09.339775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:09.340051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] PATH_INFO: `/v3/projects/6ce1c7ccc9664d1e8caf33152460d7f7` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:09.341260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce1c7ccc9664d1e8caf33152460d7f7)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:09.343293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:09.431496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 885/1767] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:09 2022] POST /identity/v3/users => generated 294 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:09.435508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9de905-a861-47fb-81b4-4cdc87f55be8 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:09.455275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9de905-a861-47fb-81b4-4cdc87f55be8 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:09.461516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:09.482385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce1c7ccc9664d1e8caf33152460d7f7', 'request_id': 'req-0859c37d-deca-4633-af94-99a5103e5296'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:09.554293 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e74fc-e7fe-4bc9-8e3d-b64e5d7fe9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:09.554999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e74fc-e7fe-4bc9-8e3d-b64e5d7fe9ac admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:09.555284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e74fc-e7fe-4bc9-8e3d-b64e5d7fe9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:09.555729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e74fc-e7fe-4bc9-8e3d-b64e5d7fe9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:09.556556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e74fc-e7fe-4bc9-8e3d-b64e5d7fe9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:09.558198 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e74fc-e7fe-4bc9-8e3d-b64e5d7fe9ac admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:09.569488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 886/1768] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:09.573784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e74fc-e7fe-4bc9-8e3d-b64e5d7fe9ac admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:09.583590 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce1c7ccc9664d1e8caf33152460d7f7', 'request_id': 'req-0859c37d-deca-4633-af94-99a5103e5296'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:09.592949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce1c7ccc9664d1e8caf33152460d7f7', 'request_id': 'req-0859c37d-deca-4633-af94-99a5103e5296'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:09.596831 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e74fc-e7fe-4bc9-8e3d-b64e5d7fe9ac admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:09.614159 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] The token cache is being invalidate because project 6ce1c7ccc9664d1e8caf33152460d7f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:09.614159 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:09.614379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c467ae-8301-4834-bd80-b0443bb39649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:09.614482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:09.614564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c467ae-8301-4834-bd80-b0443bb39649 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:09.614564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c467ae-8301-4834-bd80-b0443bb39649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:09.614564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c467ae-8301-4834-bd80-b0443bb39649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:09.614564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c467ae-8301-4834-bd80-b0443bb39649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:09.614879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 883/1769] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:09 2022] DELETE /identity/v3/projects/6ce1c7ccc9664d1e8caf33152460d7f7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:09.616731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:09.618794 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c467ae-8301-4834-bd80-b0443bb39649 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:09.621333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:09.635927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 887/1770] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:09.644829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c467ae-8301-4834-bd80-b0443bb39649 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:09.646865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a0c467ae-8301-4834-bd80-b0443bb39649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:09.646983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859c37d-deca-4633-af94-99a5103e5296 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:09.652977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:09.653862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:09.654145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:09.654570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] PATH_INFO: `/v3/users/188ee4c630c74aafaa8299088084f84e` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:09.655716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=188ee4c630c74aafaa8299088084f84e)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:09.657932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:09.665356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c467ae-8301-4834-bd80-b0443bb39649 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:09.674298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc8547-4937-47be-a12c-28c8e26c655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:09.674298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8547-4937-47be-a12c-28c8e26c655f admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:09.674298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8547-4937-47be-a12c-28c8e26c655f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:09.674298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8547-4937-47be-a12c-28c8e26c655f admin admin] PATH_INFO: `/v3/projects/45acee808c504056999c914710416d5f/users/9acfc28e5c2a45a6b249a11e6d242e52/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:09.698860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8547-4937-47be-a12c-28c8e26c655f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45acee808c504056999c914710416d5f, user_id=9acfc28e5c2a45a6b249a11e6d242e52, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:09.702111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8547-4937-47be-a12c-28c8e26c655f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:09.829361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 888/1771] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:09 2022] PUT /identity/v3/projects/45acee808c504056999c914710416d5f/users/9acfc28e5c2a45a6b249a11e6d242e52/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:09.841725 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870c039-7144-4cfa-aa52-3b22475d027a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:09.842013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870c039-7144-4cfa-aa52-3b22475d027a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:09.842319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870c039-7144-4cfa-aa52-3b22475d027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:09.878823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188ee4c630c74aafaa8299088084f84e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:09.880272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188ee4c630c74aafaa8299088084f84e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:09.898986 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-f870c039-7144-4cfa-aa52-3b22475d027a None None] MFA Rules not processed for user `9acfc28e5c2a45a6b249a11e6d242e52`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:09.900246 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f870c039-7144-4cfa-aa52-3b22475d027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:09.955197 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188ee4c630c74aafaa8299088084f84e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:09.968924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 889/1772] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:09.969819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188ee4c630c74aafaa8299088084f84e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:09.974228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870c039-7144-4cfa-aa52-3b22475d027a None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:09.975934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f870c039-7144-4cfa-aa52-3b22475d027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:09.977883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188ee4c630c74aafaa8299088084f84e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:09.987847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 884/1773] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:09 2022] DELETE /identity/v3/users/188ee4c630c74aafaa8299088084f84e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:10.071250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870c039-7144-4cfa-aa52-3b22475d027a None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:10.156437 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862f4e3-f4c8-4177-99b3-dcc0ae2e825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:10.157098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862f4e3-f4c8-4177-99b3-dcc0ae2e825b admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:10.157377 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862f4e3-f4c8-4177-99b3-dcc0ae2e825b admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:10.157649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862f4e3-f4c8-4177-99b3-dcc0ae2e825b admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:10.160202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862f4e3-f4c8-4177-99b3-dcc0ae2e825b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:10.162628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862f4e3-f4c8-4177-99b3-dcc0ae2e825b admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:10.251838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:10.254628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:10.287349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2627a-a3b0-48a6-8c10-02ec617cea28 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:10.295908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 890/1774] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:09 2022] POST /identity/v3/projects => generated 387 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:10.299284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862f4e3-f4c8-4177-99b3-dcc0ae2e825b admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:10.299444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fafee-34e4-4dd7-9d63-19810155e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:10.300656 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fafee-34e4-4dd7-9d63-19810155e738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:10.302079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fafee-34e4-4dd7-9d63-19810155e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:10.302696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fafee-34e4-4dd7-9d63-19810155e738 admin admin] PATH_INFO: `/v3/users/ef53413523cf47c7a22bc06a191397df` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:10.310301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fafee-34e4-4dd7-9d63-19810155e738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef53413523cf47c7a22bc06a191397df)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:10.313581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fafee-34e4-4dd7-9d63-19810155e738 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:10.412115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:10.509167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862f4e3-f4c8-4177-99b3-dcc0ae2e825b admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:10.525969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58090f-27a8-4ceb-af28-4d8c36fef11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:10.528570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58090f-27a8-4ceb-af28-4d8c36fef11c admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:10.528857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58090f-27a8-4ceb-af28-4d8c36fef11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:10.529131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58090f-27a8-4ceb-af28-4d8c36fef11c admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:10.530184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58090f-27a8-4ceb-af28-4d8c36fef11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:10.532443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58090f-27a8-4ceb-af28-4d8c36fef11c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:10.592021 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8d2fafee-34e4-4dd7-9d63-19810155e738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef53413523cf47c7a22bc06a191397df'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:10.593289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8d2fafee-34e4-4dd7-9d63-19810155e738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef53413523cf47c7a22bc06a191397df'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:10.636398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:10.643732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 891/1775] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:10 2022] POST /identity/v3/users => generated 300 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:10.647781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58090f-27a8-4ceb-af28-4d8c36fef11c admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:10.653374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8d2fafee-34e4-4dd7-9d63-19810155e738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef53413523cf47c7a22bc06a191397df'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:10.670758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-dc58090f-27a8-4ceb-af28-4d8c36fef11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:10.691540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8d2fafee-34e4-4dd7-9d63-19810155e738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef53413523cf47c7a22bc06a191397df'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:10.705718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58090f-27a8-4ceb-af28-4d8c36fef11c admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:10.713309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8d2fafee-34e4-4dd7-9d63-19810155e738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef53413523cf47c7a22bc06a191397df'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:10.717669 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3df95-9b46-4ba7-b0e4-661e1dda6522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:10.721703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 885/1776] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:10 2022] DELETE /identity/v3/users/ef53413523cf47c7a22bc06a191397df => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:10.725231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3df95-9b46-4ba7-b0e4-661e1dda6522 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:10.726048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3df95-9b46-4ba7-b0e4-661e1dda6522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:10.729906 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f33cc-48bb-407d-8abe-f116caa689a3 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:10.731095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f33cc-48bb-407d-8abe-f116caa689a3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:10.733026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f33cc-48bb-407d-8abe-f116caa689a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:10.733688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3df95-9b46-4ba7-b0e4-661e1dda6522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:10.734800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3df95-9b46-4ba7-b0e4-661e1dda6522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:10.736247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3df95-9b46-4ba7-b0e4-661e1dda6522 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:10.758435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 892/1777] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:10.759850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3df95-9b46-4ba7-b0e4-661e1dda6522 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:10.775342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-da8f33cc-48bb-407d-8abe-f116caa689a3 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:10.777025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-da8f33cc-48bb-407d-8abe-f116caa689a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:10.779442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3df95-9b46-4ba7-b0e4-661e1dda6522 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:10.921245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 886/1778] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:10.953313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f33cc-48bb-407d-8abe-f116caa689a3 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:10.959108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-da8f33cc-48bb-407d-8abe-f116caa689a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:10.984721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741e5e7-cbed-4d9c-b4a1-f32dab412004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:10.984721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741e5e7-cbed-4d9c-b4a1-f32dab412004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:10.984721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741e5e7-cbed-4d9c-b4a1-f32dab412004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:10.985563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741e5e7-cbed-4d9c-b4a1-f32dab412004 admin admin] PATH_INFO: `/v3/projects/5dfb1e274245476193077893d2233f10/users/d1807fff9e1c403faec4dc16a8e997f1/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:11.020616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741e5e7-cbed-4d9c-b4a1-f32dab412004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfb1e274245476193077893d2233f10, user_id=d1807fff9e1c403faec4dc16a8e997f1, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:11.023886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741e5e7-cbed-4d9c-b4a1-f32dab412004 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:11.072817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f33cc-48bb-407d-8abe-f116caa689a3 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:11.083370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36cdab-648a-41e4-9d3e-bf8166779141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:11.084241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36cdab-648a-41e4-9d3e-bf8166779141 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:11.086430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36cdab-648a-41e4-9d3e-bf8166779141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:11.086971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36cdab-648a-41e4-9d3e-bf8166779141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:11.103099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36cdab-648a-41e4-9d3e-bf8166779141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:11.105360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36cdab-648a-41e4-9d3e-bf8166779141 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:11.112238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 893/1779] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:10 2022] PUT /identity/v3/projects/5dfb1e274245476193077893d2233f10/users/d1807fff9e1c403faec4dc16a8e997f1/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:11.112942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741e5e7-cbed-4d9c-b4a1-f32dab412004 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:11.114922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7741e5e7-cbed-4d9c-b4a1-f32dab412004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:11.148048 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 887/1780] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:11.148048 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36cdab-648a-41e4-9d3e-bf8166779141 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:11.160353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36cdab-648a-41e4-9d3e-bf8166779141 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:11.248928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741e5e7-cbed-4d9c-b4a1-f32dab412004 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:11.252270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7adb45-b2e4-4c84-93c0-cada2ba23830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:11.252973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7adb45-b2e4-4c84-93c0-cada2ba23830 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:11.253269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7adb45-b2e4-4c84-93c0-cada2ba23830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:11.253552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7adb45-b2e4-4c84-93c0-cada2ba23830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:11.254317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7adb45-b2e4-4c84-93c0-cada2ba23830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:11.255929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7adb45-b2e4-4c84-93c0-cada2ba23830 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:11.256415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:11.257640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:11.258037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:11.258441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] PATH_INFO: `/v3/projects/c407869065204709b6f3330fb20d3215` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:11.269909 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 888/1781] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:11.271055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c407869065204709b6f3330fb20d3215)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:11.277213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7adb45-b2e4-4c84-93c0-cada2ba23830 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:11.277339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:11.282518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7adb45-b2e4-4c84-93c0-cada2ba23830 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:11.288955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8153e1f-2dbe-4cbc-bbcc-3ae1b683a08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:11.289900 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8153e1f-2dbe-4cbc-bbcc-3ae1b683a08a admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:11.290366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8153e1f-2dbe-4cbc-bbcc-3ae1b683a08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:11.290739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8153e1f-2dbe-4cbc-bbcc-3ae1b683a08a admin admin] PATH_INFO: `/v3/projects/5dfb1e274245476193077893d2233f10/users/d1807fff9e1c403faec4dc16a8e997f1/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:11.293470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8153e1f-2dbe-4cbc-bbcc-3ae1b683a08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfb1e274245476193077893d2233f10, user_id=d1807fff9e1c403faec4dc16a8e997f1, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:11.296925 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8153e1f-2dbe-4cbc-bbcc-3ae1b683a08a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:11.319436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 889/1782] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:11 2022] PUT /identity/v3/projects/5dfb1e274245476193077893d2233f10/users/d1807fff9e1c403faec4dc16a8e997f1/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:11.322791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5795-3a5a-4e1a-83d0-be8129638067 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:11.323186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5795-3a5a-4e1a-83d0-be8129638067 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:11.323565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5795-3a5a-4e1a-83d0-be8129638067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:11.388044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-121b5795-3a5a-4e1a-83d0-be8129638067 None None] MFA Rules not processed for user `d1807fff9e1c403faec4dc16a8e997f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:11.391243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-121b5795-3a5a-4e1a-83d0-be8129638067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:11.452414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:11.455907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c407869065204709b6f3330fb20d3215', 'request_id': 'req-4ef22bd5-cd18-4f14-ba52-b6767baace91'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:11.531817 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c407869065204709b6f3330fb20d3215', 'request_id': 'req-4ef22bd5-cd18-4f14-ba52-b6767baace91'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:11.542931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c407869065204709b6f3330fb20d3215', 'request_id': 'req-4ef22bd5-cd18-4f14-ba52-b6767baace91'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:11.560202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 890/1783] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:11.577360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b5795-3a5a-4e1a-83d0-be8129638067 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:11.579984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-121b5795-3a5a-4e1a-83d0-be8129638067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:11.582700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] The token cache is being invalidate because project c407869065204709b6f3330fb20d3215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:11.583002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:11.586701 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4ef22bd5-cd18-4f14-ba52-b6767baace91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:11.590195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 894/1784] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:11 2022] DELETE /identity/v3/projects/c407869065204709b6f3330fb20d3215 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:11.595905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e968da6-0fe1-4308-9bbd-7f48bd3d4e60 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:11.596201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e968da6-0fe1-4308-9bbd-7f48bd3d4e60 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:11.598709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e968da6-0fe1-4308-9bbd-7f48bd3d4e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:11.642178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5e968da6-0fe1-4308-9bbd-7f48bd3d4e60 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:11.643444 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5e968da6-0fe1-4308-9bbd-7f48bd3d4e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:11.681811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b5795-3a5a-4e1a-83d0-be8129638067 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:11.751675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022b0b7-ccea-419c-bdb8-4164b58eef96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:11.756805 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022b0b7-ccea-419c-bdb8-4164b58eef96 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:11.756805 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022b0b7-ccea-419c-bdb8-4164b58eef96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:11.756805 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022b0b7-ccea-419c-bdb8-4164b58eef96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:11.756805 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f022b0b7-ccea-419c-bdb8-4164b58eef96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:11.784757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 895/1785] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:11.794105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a809e-5304-4eef-9330-2428d0d31c8e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:11.794422 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a809e-5304-4eef-9330-2428d0d31c8e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:11.794706 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a809e-5304-4eef-9330-2428d0d31c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:11.827584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-391a809e-5304-4eef-9330-2428d0d31c8e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:11.828820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-391a809e-5304-4eef-9330-2428d0d31c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:11.849612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 896/1786] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:11.854274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a809e-5304-4eef-9330-2428d0d31c8e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:11.888614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a809e-5304-4eef-9330-2428d0d31c8e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:11.905627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c482f-e773-4ea9-9dfe-8e88ab450262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:11.906343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c482f-e773-4ea9-9dfe-8e88ab450262 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:11.908882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c482f-e773-4ea9-9dfe-8e88ab450262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:11.908882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c482f-e773-4ea9-9dfe-8e88ab450262 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:11.908882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c482f-e773-4ea9-9dfe-8e88ab450262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:11.908882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c482f-e773-4ea9-9dfe-8e88ab450262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:11.909813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c482f-e773-4ea9-9dfe-8e88ab450262 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:11.937181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 897/1787] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:47:11.938466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4567ad3-fd62-4ffd-875a-380318840704 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:11.938761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4567ad3-fd62-4ffd-875a-380318840704 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:11.939045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4567ad3-fd62-4ffd-875a-380318840704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:11.942347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022b0b7-ccea-419c-bdb8-4164b58eef96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:11.944135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022b0b7-ccea-419c-bdb8-4164b58eef96 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:11.972670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 891/1788] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:11.986541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022b0b7-ccea-419c-bdb8-4164b58eef96 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:11.997287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-f4567ad3-fd62-4ffd-875a-380318840704 None None] MFA Rules not processed for user `c8a09bfa2165445ba390bc5629dde437`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:11.999945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f4567ad3-fd62-4ffd-875a-380318840704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:12.019444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022b0b7-ccea-419c-bdb8-4164b58eef96 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:12.035733 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fc8fc-c1af-4c9d-9a32-9ca61a8fa651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:12.037128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fc8fc-c1af-4c9d-9a32-9ca61a8fa651 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:12.037521 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fc8fc-c1af-4c9d-9a32-9ca61a8fa651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:12.037871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fc8fc-c1af-4c9d-9a32-9ca61a8fa651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:12.039284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fc8fc-c1af-4c9d-9a32-9ca61a8fa651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:12.041692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fc8fc-c1af-4c9d-9a32-9ca61a8fa651 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:12.164649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 898/1789] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:12.167315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4567ad3-fd62-4ffd-875a-380318840704 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:12.169161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f4567ad3-fd62-4ffd-875a-380318840704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:12.191085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4567ad3-fd62-4ffd-875a-380318840704 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:12.202392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7ca41-43ec-4d02-8b27-1ff59b0c41ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:12.203309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ca41-43ec-4d02-8b27-1ff59b0c41ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:12.203581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ca41-43ec-4d02-8b27-1ff59b0c41ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:12.203857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ca41-43ec-4d02-8b27-1ff59b0c41ec admin admin] PATH_INFO: `/v3/users/9acfc28e5c2a45a6b249a11e6d242e52` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:12.205761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7ca41-43ec-4d02-8b27-1ff59b0c41ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9acfc28e5c2a45a6b249a11e6d242e52)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:12.208548 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7ca41-43ec-4d02-8b27-1ff59b0c41ec admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:12.210502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 892/1790] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:11 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:12.214681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fc8fc-c1af-4c9d-9a32-9ca61a8fa651 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:12.320552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fc8fc-c1af-4c9d-9a32-9ca61a8fa651 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:12.338617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d994d3-2012-460e-9d8c-874818957c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:12.339340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d994d3-2012-460e-9d8c-874818957c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:12.339686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d994d3-2012-460e-9d8c-874818957c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:12.339977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d994d3-2012-460e-9d8c-874818957c9c admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:12.340692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d994d3-2012-460e-9d8c-874818957c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:12.342747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d994d3-2012-460e-9d8c-874818957c9c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:12.431670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 893/1791] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:12 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:12.432603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d994d3-2012-460e-9d8c-874818957c9c admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:12.442954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4fc7ca41-43ec-4d02-8b27-1ff59b0c41ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9acfc28e5c2a45a6b249a11e6d242e52'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:12.445344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4fc7ca41-43ec-4d02-8b27-1ff59b0c41ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9acfc28e5c2a45a6b249a11e6d242e52'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:12.448542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d994d3-2012-460e-9d8c-874818957c9c admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:12.449095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:DELETE=27,keystone:SELECT=70,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:12.455856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266a7e8-3232-45d5-8f16-175cdc21e584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:12.456549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266a7e8-3232-45d5-8f16-175cdc21e584 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:12.456957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266a7e8-3232-45d5-8f16-175cdc21e584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:12.457455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266a7e8-3232-45d5-8f16-175cdc21e584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:12.458066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266a7e8-3232-45d5-8f16-175cdc21e584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:12.462044 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266a7e8-3232-45d5-8f16-175cdc21e584 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:12.463565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4fc7ca41-43ec-4d02-8b27-1ff59b0c41ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9acfc28e5c2a45a6b249a11e6d242e52'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:12.478010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 894/1792] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:12.482202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266a7e8-3232-45d5-8f16-175cdc21e584 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:12.484163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3266a7e8-3232-45d5-8f16-175cdc21e584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:12.498571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266a7e8-3232-45d5-8f16-175cdc21e584 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:12.512460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2565a82-9888-43af-a695-aed732f27edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:12.513627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2565a82-9888-43af-a695-aed732f27edd admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:12.518606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2565a82-9888-43af-a695-aed732f27edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:12.519002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2565a82-9888-43af-a695-aed732f27edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:12.519812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2565a82-9888-43af-a695-aed732f27edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:12.521524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2565a82-9888-43af-a695-aed732f27edd admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:12.538554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4fc7ca41-43ec-4d02-8b27-1ff59b0c41ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9acfc28e5c2a45a6b249a11e6d242e52'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:12.546990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 895/1793] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:12.548580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4fc7ca41-43ec-4d02-8b27-1ff59b0c41ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9acfc28e5c2a45a6b249a11e6d242e52'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:12.551065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2565a82-9888-43af-a695-aed732f27edd admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:12.556541 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 899/1794] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:12 2022] DELETE /identity/v3/users/9acfc28e5c2a45a6b249a11e6d242e52 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:12.561167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd32c-d689-4edf-97b9-c69ef0934f6d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:12.561670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd32c-d689-4edf-97b9-c69ef0934f6d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:12.562096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd32c-d689-4edf-97b9-c69ef0934f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:12.562756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2565a82-9888-43af-a695-aed732f27edd admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:12.587731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5d1bd32c-d689-4edf-97b9-c69ef0934f6d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:12.589935 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5d1bd32c-d689-4edf-97b9-c69ef0934f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:12.625070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:12.641428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa0072-ee1c-46e7-b0e7-3e3575d8d7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:12.642552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa0072-ee1c-46e7-b0e7-3e3575d8d7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:12.643159 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa0072-ee1c-46e7-b0e7-3e3575d8d7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:12.643660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa0072-ee1c-46e7-b0e7-3e3575d8d7d6 admin admin] PATH_INFO: `/v3/projects/dd6ddbb1205745e98bb3a45e115759dd/users/969df570424143548dd22b3acb8f4be8/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:12.708991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa0072-ee1c-46e7-b0e7-3e3575d8d7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd6ddbb1205745e98bb3a45e115759dd, user_id=969df570424143548dd22b3acb8f4be8, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:12.722431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa0072-ee1c-46e7-b0e7-3e3575d8d7d6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:12.797948 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 900/1795] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:12.799185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bd32c-d689-4edf-97b9-c69ef0934f6d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:12.804535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5d1bd32c-d689-4edf-97b9-c69ef0934f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:12.821874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bd32c-d689-4edf-97b9-c69ef0934f6d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:12.829910 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 896/1796] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:12 2022] PUT /identity/v3/projects/dd6ddbb1205745e98bb3a45e115759dd/users/969df570424143548dd22b3acb8f4be8/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:12.831418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ef282-f7ee-4690-920a-5e0bbd472b4d None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:12.831891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ef282-f7ee-4690-920a-5e0bbd472b4d None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:12.832174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ef282-f7ee-4690-920a-5e0bbd472b4d None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:12.833494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 897/1797] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:47:12.834220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ef282-f7ee-4690-920a-5e0bbd472b4d None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:12.840892 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-286ef282-f7ee-4690-920a-5e0bbd472b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:12.954999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ef282-f7ee-4690-920a-5e0bbd472b4d None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:12.963934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c9a83-878a-46df-a57a-55c519d93b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:12.963934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9a83-878a-46df-a57a-55c519d93b04 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:12.963934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9a83-878a-46df-a57a-55c519d93b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:12.963934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9a83-878a-46df-a57a-55c519d93b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:12.968715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:12.969858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:12.970224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:12.970605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] PATH_INFO: `/v3/projects/e82d04c5c23c4d94b1174820b19c498e` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:12.982501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c9a83-878a-46df-a57a-55c519d93b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:12.986350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c9a83-878a-46df-a57a-55c519d93b04 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:12.987750 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82d04c5c23c4d94b1174820b19c498e)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:12.993564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:12.997777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 898/1798] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:12.999236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0ba29-d1ae-4fa9-b208-50d8cfc0f2a3 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:12.999525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0ba29-d1ae-4fa9-b208-50d8cfc0f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:12.999806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0ba29-d1ae-4fa9-b208-50d8cfc0f2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:13.051587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-91f0ba29-d1ae-4fa9-b208-50d8cfc0f2a3 None None] MFA Rules not processed for user `969df570424143548dd22b3acb8f4be8`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:13.053469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-91f0ba29-d1ae-4fa9-b208-50d8cfc0f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:13.165810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 899/1799] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:13.167025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0f2de-6270-4db7-a0f3-fb6c90c40048 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:13.167309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0f2de-6270-4db7-a0f3-fb6c90c40048 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:13.167584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0f2de-6270-4db7-a0f3-fb6c90c40048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:13.169832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82d04c5c23c4d94b1174820b19c498e', 'request_id': 'req-ba0021ce-dd22-49e6-ba16-39d4e559f845'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:13.188695 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-fcc0f2de-6270-4db7-a0f3-fb6c90c40048 None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:13.189904 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fcc0f2de-6270-4db7-a0f3-fb6c90c40048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:13.274942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82d04c5c23c4d94b1174820b19c498e', 'request_id': 'req-ba0021ce-dd22-49e6-ba16-39d4e559f845'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:13.282828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82d04c5c23c4d94b1174820b19c498e', 'request_id': 'req-ba0021ce-dd22-49e6-ba16-39d4e559f845'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:13.292570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 900/1800] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:47:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:13.294397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0f2de-6270-4db7-a0f3-fb6c90c40048 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:13.309760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] The token cache is being invalidate because project e82d04c5c23c4d94b1174820b19c498e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:13.310058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:13.311653 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:13.319845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 901/1801] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:12 2022] DELETE /identity/v3/projects/e82d04c5c23c4d94b1174820b19c498e => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:13.320808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:13.322909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:13.346535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0021ce-dd22-49e6-ba16-39d4e559f845 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:13.352735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607880f9-cdf5-4e78-9e41-d2b4751f8dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:13.353409 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607880f9-cdf5-4e78-9e41-d2b4751f8dda service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:13.353697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607880f9-cdf5-4e78-9e41-d2b4751f8dda service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:13.353979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607880f9-cdf5-4e78-9e41-d2b4751f8dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:13.355923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-607880f9-cdf5-4e78-9e41-d2b4751f8dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:13.371645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0f2de-6270-4db7-a0f3-fb6c90c40048 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:13.373908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607880f9-cdf5-4e78-9e41-d2b4751f8dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:13.376451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607880f9-cdf5-4e78-9e41-d2b4751f8dda service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:13.378380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a2cb6-20a9-4cbb-954c-ee2e2d74ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:13.379375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a2cb6-20a9-4cbb-954c-ee2e2d74ba1b admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:13.379860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a2cb6-20a9-4cbb-954c-ee2e2d74ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:13.380356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a2cb6-20a9-4cbb-954c-ee2e2d74ba1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:13.381235 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a2cb6-20a9-4cbb-954c-ee2e2d74ba1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:13.384072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a2cb6-20a9-4cbb-954c-ee2e2d74ba1b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:13.400828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 902/1802] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:13.401877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607880f9-cdf5-4e78-9e41-d2b4751f8dda service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:13.403381 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-607880f9-cdf5-4e78-9e41-d2b4751f8dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:13.419487 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607880f9-cdf5-4e78-9e41-d2b4751f8dda service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:13.425197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:13.426265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:13.426626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:13.427032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] PATH_INFO: `/v3/users/f6b7316d86c14c4a8506c59e4e3e8460` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:13.428426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b7316d86c14c4a8506c59e4e3e8460)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:13.431317 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:13.513945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 901/1803] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:13 2022] POST /identity/v3/projects => generated 371 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:13.517878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a2cb6-20a9-4cbb-954c-ee2e2d74ba1b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:13.529274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ef1a2cb6-20a9-4cbb-954c-ee2e2d74ba1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:13.645261 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b7316d86c14c4a8506c59e4e3e8460'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:13.645970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b7316d86c14c4a8506c59e4e3e8460'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:13.665342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a2cb6-20a9-4cbb-954c-ee2e2d74ba1b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:13.673560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b7316d86c14c4a8506c59e4e3e8460'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:13.679174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d34af0-d75d-451f-a740-578de18c6485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:13.679877 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d34af0-d75d-451f-a740-578de18c6485 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:13.680162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d34af0-d75d-451f-a740-578de18c6485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:13.680436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d34af0-d75d-451f-a740-578de18c6485 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:13.681307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d34af0-d75d-451f-a740-578de18c6485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:13.685526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d34af0-d75d-451f-a740-578de18c6485 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:13.708607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:13.760306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b7316d86c14c4a8506c59e4e3e8460'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:13.776743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b7316d86c14c4a8506c59e4e3e8460'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:13.783363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 903/1804] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:13 2022] DELETE /identity/v3/users/f6b7316d86c14c4a8506c59e4e3e8460 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:13.798359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 902/1805] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:13 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:13.800562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:13.802058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:13.871345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de56566-7cd9-40f8-92ec-0c8823133900 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:13.876361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c554c-2976-4ced-aa51-ed0387559e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:13.877043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c554c-2976-4ced-aa51-ed0387559e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:13.877345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c554c-2976-4ced-aa51-ed0387559e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:13.877612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c554c-2976-4ced-aa51-ed0387559e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:13.878532 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c554c-2976-4ced-aa51-ed0387559e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:13.882289 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c554c-2976-4ced-aa51-ed0387559e12 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:13.904234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d34af0-d75d-451f-a740-578de18c6485 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:13.910467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 904/1806] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:13.920348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d34af0-d75d-451f-a740-578de18c6485 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:13.939546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67476e8-1740-48a6-8748-1dc9b69e81fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:13.939546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67476e8-1740-48a6-8748-1dc9b69e81fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:13.939546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67476e8-1740-48a6-8748-1dc9b69e81fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:13.939546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67476e8-1740-48a6-8748-1dc9b69e81fb admin admin] PATH_INFO: `/v3/projects/94001a67310c43c6afc926afba00270e/users/59dd8b08fb654982b9ae3b263e62777b/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:13.967883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67476e8-1740-48a6-8748-1dc9b69e81fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=94001a67310c43c6afc926afba00270e, user_id=59dd8b08fb654982b9ae3b263e62777b, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:13.972049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67476e8-1740-48a6-8748-1dc9b69e81fb admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:14.041668 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c554c-2976-4ced-aa51-ed0387559e12 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:14.044293 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-458c554c-2976-4ced-aa51-ed0387559e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:14.066541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 903/1807] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:13 2022] PUT /identity/v3/projects/94001a67310c43c6afc926afba00270e/users/59dd8b08fb654982b9ae3b263e62777b/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:14.071345 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67476e8-1740-48a6-8748-1dc9b69e81fb admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:14.073870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c554c-2976-4ced-aa51-ed0387559e12 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:14.140636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:14.221802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67476e8-1740-48a6-8748-1dc9b69e81fb admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:14.229330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc596b-0c33-475f-a92f-6180b4d6db3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:14.230427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc596b-0c33-475f-a92f-6180b4d6db3c admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:14.231755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc596b-0c33-475f-a92f-6180b4d6db3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:14.231755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc596b-0c33-475f-a92f-6180b4d6db3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:14.232356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc596b-0c33-475f-a92f-6180b4d6db3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:14.234403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc596b-0c33-475f-a92f-6180b4d6db3c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:14.251967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 904/1808] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:14.252982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc596b-0c33-475f-a92f-6180b4d6db3c admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:14.255404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:14.256288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:14.256643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:14.257424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] PATH_INFO: `/v3/projects/45acee808c504056999c914710416d5f` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:14.259055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45acee808c504056999c914710416d5f)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:14.260993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:14.265748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc596b-0c33-475f-a92f-6180b4d6db3c admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:14.271923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb624cb5-8ecf-4c7d-95f4-72bb4a0c3d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:14.273219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb624cb5-8ecf-4c7d-95f4-72bb4a0c3d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:14.274284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb624cb5-8ecf-4c7d-95f4-72bb4a0c3d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:14.274927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb624cb5-8ecf-4c7d-95f4-72bb4a0c3d9f admin admin] PATH_INFO: `/v3/projects/94001a67310c43c6afc926afba00270e/users/59dd8b08fb654982b9ae3b263e62777b/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:14.282277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb624cb5-8ecf-4c7d-95f4-72bb4a0c3d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94001a67310c43c6afc926afba00270e, user_id=59dd8b08fb654982b9ae3b263e62777b, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:14.288010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb624cb5-8ecf-4c7d-95f4-72bb4a0c3d9f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:14.310821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 905/1809] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:14 2022] PUT /identity/v3/projects/94001a67310c43c6afc926afba00270e/users/59dd8b08fb654982b9ae3b263e62777b/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:14.328430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c97e7b-4db0-4937-8bab-8da4f599d4c4 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:14.328688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c97e7b-4db0-4937-8bab-8da4f599d4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:14.329672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c97e7b-4db0-4937-8bab-8da4f599d4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:14.392693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-d5c97e7b-4db0-4937-8bab-8da4f599d4c4 None None] MFA Rules not processed for user `59dd8b08fb654982b9ae3b263e62777b`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:14.395067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d5c97e7b-4db0-4937-8bab-8da4f599d4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:14.453767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45acee808c504056999c914710416d5f', 'request_id': 'req-f2d1bb22-cda2-425f-be0d-30090e70a669'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:14.536610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 906/1810] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:14.547371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c97e7b-4db0-4937-8bab-8da4f599d4c4 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:14.553246 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d5c97e7b-4db0-4937-8bab-8da4f599d4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:14.583275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45acee808c504056999c914710416d5f', 'request_id': 'req-f2d1bb22-cda2-425f-be0d-30090e70a669'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:14.598118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45acee808c504056999c914710416d5f', 'request_id': 'req-f2d1bb22-cda2-425f-be0d-30090e70a669'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:14.625650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] The token cache is being invalidate because project 45acee808c504056999c914710416d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:14.626080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:14.626932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f2d1bb22-cda2-425f-be0d-30090e70a669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:14.633228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 905/1811] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:14 2022] DELETE /identity/v3/projects/45acee808c504056999c914710416d5f => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:14.635250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da0093-8d06-4c98-a83d-14ccd5a91219 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:14.635673 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da0093-8d06-4c98-a83d-14ccd5a91219 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:14.636061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da0093-8d06-4c98-a83d-14ccd5a91219 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:14.637739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 906/1812] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:47:14.639086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da0093-8d06-4c98-a83d-14ccd5a91219 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:14.641448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-45da0093-8d06-4c98-a83d-14ccd5a91219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:14.688675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c97e7b-4db0-4937-8bab-8da4f599d4c4 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:14.778636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da0093-8d06-4c98-a83d-14ccd5a91219 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:14.796593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d41b09-7cf7-48f0-a83e-858648e72b75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:14.797292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41b09-7cf7-48f0-a83e-858648e72b75 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:14.797624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41b09-7cf7-48f0-a83e-858648e72b75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:14.797911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41b09-7cf7-48f0-a83e-858648e72b75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:14.804061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-79d41b09-7cf7-48f0-a83e-858648e72b75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:14.817176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:14.817176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:14.817176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:14.817176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] PATH_INFO: `/v3/users/d1807fff9e1c403faec4dc16a8e997f1` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:14.822860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1807fff9e1c403faec4dc16a8e997f1)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:14.824991 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:14.945902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d41b09-7cf7-48f0-a83e-858648e72b75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:14.950961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d41b09-7cf7-48f0-a83e-858648e72b75 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:14.963486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 907/1813] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:14.965522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd985eb-1a4b-45ca-b2cc-7f8815a3856f None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:14.965882 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd985eb-1a4b-45ca-b2cc-7f8815a3856f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:14.966230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd985eb-1a4b-45ca-b2cc-7f8815a3856f None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:14.968435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 908/1814] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:47:14.968986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a040fc-9024-4f39-9e4e-06b7c5e96970 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:14.969321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a040fc-9024-4f39-9e4e-06b7c5e96970 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:14.969688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a040fc-9024-4f39-9e4e-06b7c5e96970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:14.991634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-29a040fc-9024-4f39-9e4e-06b7c5e96970 None None] MFA Rules not processed for user `b1e0226354d14b9b9c4184063b2df9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:14.993102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-29a040fc-9024-4f39-9e4e-06b7c5e96970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:15.074300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1807fff9e1c403faec4dc16a8e997f1'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:15.076308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1807fff9e1c403faec4dc16a8e997f1'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:15.102305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1807fff9e1c403faec4dc16a8e997f1'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:15.110416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 909/1815] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:47:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:15.111806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d953f6-6f15-41c3-b44d-acfef4074f5c None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:15.112063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d953f6-6f15-41c3-b44d-acfef4074f5c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:15.112387 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d953f6-6f15-41c3-b44d-acfef4074f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:15.172834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1807fff9e1c403faec4dc16a8e997f1'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:15.182284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-81d953f6-6f15-41c3-b44d-acfef4074f5c None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:15.186750 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1807fff9e1c403faec4dc16a8e997f1'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:15.187192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-81d953f6-6f15-41c3-b44d-acfef4074f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:15.198219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 907/1816] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:14 2022] DELETE /identity/v3/users/d1807fff9e1c403faec4dc16a8e997f1 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:15.202196 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:15.214210 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:15.276407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:15.336737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 910/1817] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:47:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:15.338272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d953f6-6f15-41c3-b44d-acfef4074f5c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:15.339835 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-81d953f6-6f15-41c3-b44d-acfef4074f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:15.358141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa0a8-12c7-4d5e-9469-a81130ee27c0 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:15.367475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:15.368942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:15.369361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:15.369762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] PATH_INFO: `/v3/projects/3a027b8d7c00442ca32f917ae6e7df43` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:15.391747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a027b8d7c00442ca32f917ae6e7df43)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:15.391747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:15.396650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:15.404969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d953f6-6f15-41c3-b44d-acfef4074f5c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:15.520985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a027b8d7c00442ca32f917ae6e7df43', 'request_id': 'req-826e808b-ae87-43c4-b56f-1dd61b462755'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:15.542997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54571f7-6886-4766-89eb-fe307bcb59b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:15.543829 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54571f7-6886-4766-89eb-fe307bcb59b9 service placement] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:15.544276 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54571f7-6886-4766-89eb-fe307bcb59b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:15.544661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54571f7-6886-4766-89eb-fe307bcb59b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:15.554940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54571f7-6886-4766-89eb-fe307bcb59b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:15.558175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54571f7-6886-4766-89eb-fe307bcb59b9 service placement] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:15.569725 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 911/1818] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:15.570641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54571f7-6886-4766-89eb-fe307bcb59b9 service placement] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:15.572472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c54571f7-6886-4766-89eb-fe307bcb59b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:15.607094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a027b8d7c00442ca32f917ae6e7df43', 'request_id': 'req-826e808b-ae87-43c4-b56f-1dd61b462755'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:15.635220 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a027b8d7c00442ca32f917ae6e7df43', 'request_id': 'req-826e808b-ae87-43c4-b56f-1dd61b462755'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:15.656599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] The token cache is being invalidate because project 3a027b8d7c00442ca32f917ae6e7df43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:15.658261 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:15.659577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-826e808b-ae87-43c4-b56f-1dd61b462755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:15.661670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 908/1819] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:15 2022] DELETE /identity/v3/projects/3a027b8d7c00442ca32f917ae6e7df43 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:15.666584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56c7a-90bd-42f1-8a3c-892e2e6c0ff9 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:15.667170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56c7a-90bd-42f1-8a3c-892e2e6c0ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:15.667595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56c7a-90bd-42f1-8a3c-892e2e6c0ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:15.693489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-29a56c7a-90bd-42f1-8a3c-892e2e6c0ff9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:15.696180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-29a56c7a-90bd-42f1-8a3c-892e2e6c0ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:15.701181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54571f7-6886-4766-89eb-fe307bcb59b9 service placement] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:15.795928 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dcf41-7f12-4816-abe5-97128bb05203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:15.797154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dcf41-7f12-4816-abe5-97128bb05203 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:15.797454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dcf41-7f12-4816-abe5-97128bb05203 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:15.799196 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dcf41-7f12-4816-abe5-97128bb05203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:15.800481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f91dcf41-7f12-4816-abe5-97128bb05203 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:15.809099 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 909/1820] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:15.827998 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91dcf41-7f12-4816-abe5-97128bb05203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:15.827998 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91dcf41-7f12-4816-abe5-97128bb05203 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:15.828451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951634-eda9-47ad-88c7-e7b06e1dad5e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:15.829230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951634-eda9-47ad-88c7-e7b06e1dad5e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:15.830599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951634-eda9-47ad-88c7-e7b06e1dad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:15.840072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 912/1821] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:15.847011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:15.856216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-62951634-eda9-47ad-88c7-e7b06e1dad5e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:15.857969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-62951634-eda9-47ad-88c7-e7b06e1dad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:15.868356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 910/1822] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:15.872211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dcf41-7f12-4816-abe5-97128bb05203 service nova] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:15.899424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dcf41-7f12-4816-abe5-97128bb05203 service nova] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:15.902971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd471cd-68f3-4f1b-a2c2-f04c03ed7045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:15.905887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd471cd-68f3-4f1b-a2c2-f04c03ed7045 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:15.906350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd471cd-68f3-4f1b-a2c2-f04c03ed7045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:15.906720 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd471cd-68f3-4f1b-a2c2-f04c03ed7045 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:15.908380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd471cd-68f3-4f1b-a2c2-f04c03ed7045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:15.913320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd471cd-68f3-4f1b-a2c2-f04c03ed7045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:15.913320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd471cd-68f3-4f1b-a2c2-f04c03ed7045 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:15.945562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 913/1823] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:15.950085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62951634-eda9-47ad-88c7-e7b06e1dad5e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:15.962115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62951634-eda9-47ad-88c7-e7b06e1dad5e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:15.970405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb43fe-987c-4926-b4fa-81d8fa41e579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:15.970405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb43fe-987c-4926-b4fa-81d8fa41e579 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:15.970405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb43fe-987c-4926-b4fa-81d8fa41e579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:15.970852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb43fe-987c-4926-b4fa-81d8fa41e579 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:15.972234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb43fe-987c-4926-b4fa-81d8fa41e579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:15.974169 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb43fe-987c-4926-b4fa-81d8fa41e579 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:16.090542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 911/1824] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:15 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:16.094409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd471cd-68f3-4f1b-a2c2-f04c03ed7045 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:16.106796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd471cd-68f3-4f1b-a2c2-f04c03ed7045 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:16.180463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb43fe-987c-4926-b4fa-81d8fa41e579 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:16.184204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e9eb43fe-987c-4926-b4fa-81d8fa41e579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:16.216264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921da36-6774-4d49-bbf5-fde19fa82c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:16.216824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921da36-6774-4d49-bbf5-fde19fa82c28 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:16.217116 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921da36-6774-4d49-bbf5-fde19fa82c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:16.217457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921da36-6774-4d49-bbf5-fde19fa82c28 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:16.218221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921da36-6774-4d49-bbf5-fde19fa82c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:16.221203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921da36-6774-4d49-bbf5-fde19fa82c28 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:16.275130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb43fe-987c-4926-b4fa-81d8fa41e579 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:16.279982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c0274-f0c9-4858-ac51-b65db5e9c5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:16.281515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0274-f0c9-4858-ac51-b65db5e9c5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:16.281889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0274-f0c9-4858-ac51-b65db5e9c5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:16.282163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0274-f0c9-4858-ac51-b65db5e9c5e2 admin admin] PATH_INFO: `/v3/users/969df570424143548dd22b3acb8f4be8` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:16.283450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c0274-f0c9-4858-ac51-b65db5e9c5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=969df570424143548dd22b3acb8f4be8)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:16.285392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c0274-f0c9-4858-ac51-b65db5e9c5e2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:16.322043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 914/1825] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:16 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:16.323981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921da36-6774-4d49-bbf5-fde19fa82c28 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:16.333856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921da36-6774-4d49-bbf5-fde19fa82c28 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:16.339055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2a048-7a4d-433d-a35d-f55f7d6fb7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:16.339716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2a048-7a4d-433d-a35d-f55f7d6fb7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:16.340005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2a048-7a4d-433d-a35d-f55f7d6fb7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:16.340717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2a048-7a4d-433d-a35d-f55f7d6fb7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:16.341118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2a048-7a4d-433d-a35d-f55f7d6fb7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:16.342757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2a048-7a4d-433d-a35d-f55f7d6fb7c5 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:16.353481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 915/1826] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:16.357432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2a048-7a4d-433d-a35d-f55f7d6fb7c5 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:16.367738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2a048-7a4d-433d-a35d-f55f7d6fb7c5 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:16.372461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b4238-d5c6-4a93-87a0-40eee06e4867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:16.373110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b4238-d5c6-4a93-87a0-40eee06e4867 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:16.373399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b4238-d5c6-4a93-87a0-40eee06e4867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:16.373679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b4238-d5c6-4a93-87a0-40eee06e4867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:16.374458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b4238-d5c6-4a93-87a0-40eee06e4867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:16.376079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b4238-d5c6-4a93-87a0-40eee06e4867 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:16.389727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 916/1827] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:16.391510 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b4238-d5c6-4a93-87a0-40eee06e4867 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:16.413797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b4238-d5c6-4a93-87a0-40eee06e4867 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:16.419540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10d990-c789-49e6-b677-50051a225e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:16.419836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d990-c789-49e6-b677-50051a225e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:16.421464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d990-c789-49e6-b677-50051a225e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:16.421464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d990-c789-49e6-b677-50051a225e4e admin admin] PATH_INFO: `/v3/projects/8f373191ccb448a784d153ca89ac5209/users/4300eb9b1932489fb54a2d760f1376cc/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:16.449285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10d990-c789-49e6-b677-50051a225e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f373191ccb448a784d153ca89ac5209, user_id=4300eb9b1932489fb54a2d760f1376cc, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:16.449285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10d990-c789-49e6-b677-50051a225e4e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:16.507699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-289c0274-f0c9-4858-ac51-b65db5e9c5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '969df570424143548dd22b3acb8f4be8'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:16.508394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-289c0274-f0c9-4858-ac51-b65db5e9c5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '969df570424143548dd22b3acb8f4be8'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:16.525757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-289c0274-f0c9-4858-ac51-b65db5e9c5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '969df570424143548dd22b3acb8f4be8'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:16.536702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 917/1828] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:16 2022] PUT /identity/v3/projects/8f373191ccb448a784d153ca89ac5209/users/4300eb9b1932489fb54a2d760f1376cc/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:16.536702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10d990-c789-49e6-b677-50051a225e4e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:16.536702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3c10d990-c789-49e6-b677-50051a225e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:16.603967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-289c0274-f0c9-4858-ac51-b65db5e9c5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '969df570424143548dd22b3acb8f4be8'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:16.615812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10d990-c789-49e6-b677-50051a225e4e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:16.616887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-289c0274-f0c9-4858-ac51-b65db5e9c5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '969df570424143548dd22b3acb8f4be8'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:16.626876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 912/1829] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:16 2022] DELETE /identity/v3/users/969df570424143548dd22b3acb8f4be8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:16.626876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b957-9bc4-46b8-bd80-bfaa69ed152b None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:16.626876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b957-9bc4-46b8-bd80-bfaa69ed152b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:16.627176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b957-9bc4-46b8-bd80-bfaa69ed152b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:16.638627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:16.639728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:16.640436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:16.640992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] PATH_INFO: `/v3/projects/5dfb1e274245476193077893d2233f10` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:16.642413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dfb1e274245476193077893d2233f10)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:16.645108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:16.673025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-6500b957-9bc4-46b8-bd80-bfaa69ed152b None None] MFA Rules not processed for user `4300eb9b1932489fb54a2d760f1376cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:16.674287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-6500b957-9bc4-46b8-bd80-bfaa69ed152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:16.763343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfb1e274245476193077893d2233f10', 'request_id': 'req-0514aac8-5dbe-42ce-9723-7d9b99e05348'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:16.766703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 913/1830] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:16.769151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de553d4d-4eb1-472e-b6c4-a93bc1b8896d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:16.770253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de553d4d-4eb1-472e-b6c4-a93bc1b8896d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:16.771151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de553d4d-4eb1-472e-b6c4-a93bc1b8896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:16.793073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-de553d4d-4eb1-472e-b6c4-a93bc1b8896d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:16.794708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-de553d4d-4eb1-472e-b6c4-a93bc1b8896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:16.840191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfb1e274245476193077893d2233f10', 'request_id': 'req-0514aac8-5dbe-42ce-9723-7d9b99e05348'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:16.849086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfb1e274245476193077893d2233f10', 'request_id': 'req-0514aac8-5dbe-42ce-9723-7d9b99e05348'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:16.866754 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 914/1831] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:16.866754 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de553d4d-4eb1-472e-b6c4-a93bc1b8896d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:16.866754 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-de553d4d-4eb1-472e-b6c4-a93bc1b8896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:16.873908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] The token cache is being invalidate because project 5dfb1e274245476193077893d2233f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:16.874431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:16.875333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0514aac8-5dbe-42ce-9723-7d9b99e05348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:16.877489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 918/1832] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:16 2022] DELETE /identity/v3/projects/5dfb1e274245476193077893d2233f10 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:16.882507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c6b56-673d-4a18-b0b7-c72791dd5fce None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:16.882838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c6b56-673d-4a18-b0b7-c72791dd5fce None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:16.883126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c6b56-673d-4a18-b0b7-c72791dd5fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:16.903608 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-2b9c6b56-673d-4a18-b0b7-c72791dd5fce None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:16.904909 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2b9c6b56-673d-4a18-b0b7-c72791dd5fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:16.922689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 919/1833] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:16.922689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c6b56-673d-4a18-b0b7-c72791dd5fce None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:16.928370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2b9c6b56-673d-4a18-b0b7-c72791dd5fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:16.978772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de553d4d-4eb1-472e-b6c4-a93bc1b8896d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:16.984316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b68e2-b984-4571-a8dd-c2d4cf52c569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:16.986077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b68e2-b984-4571-a8dd-c2d4cf52c569 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:16.986404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b68e2-b984-4571-a8dd-c2d4cf52c569 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:16.986685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b68e2-b984-4571-a8dd-c2d4cf52c569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:16.989120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-6e6b68e2-b984-4571-a8dd-c2d4cf52c569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:17.008313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c6b56-673d-4a18-b0b7-c72791dd5fce None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:17.016457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078e200-fd98-4404-b525-33ac90eb1261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:17.017103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e200-fd98-4404-b525-33ac90eb1261 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:17.017493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e200-fd98-4404-b525-33ac90eb1261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:17.018298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e200-fd98-4404-b525-33ac90eb1261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:17.020841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2078e200-fd98-4404-b525-33ac90eb1261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:17.039389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078e200-fd98-4404-b525-33ac90eb1261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:17.041136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078e200-fd98-4404-b525-33ac90eb1261 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:17.052730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:17.059516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 920/1834] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:17.060887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec7d4-96bc-4415-be48-215e39b6b9b6 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:17.061323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec7d4-96bc-4415-be48-215e39b6b9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:17.061665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec7d4-96bc-4415-be48-215e39b6b9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:17.066834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b68e2-b984-4571-a8dd-c2d4cf52c569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:17.068600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b68e2-b984-4571-a8dd-c2d4cf52c569 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:17.080787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 915/1835] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:17.085343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-eecec7d4-96bc-4415-be48-215e39b6b9b6 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:17.087365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-eecec7d4-96bc-4415-be48-215e39b6b9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:17.098498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 921/1836] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:17.102360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b68e2-b984-4571-a8dd-c2d4cf52c569 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:17.103207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecec7d4-96bc-4415-be48-215e39b6b9b6 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:17.105066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-eecec7d4-96bc-4415-be48-215e39b6b9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:17.114154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b68e2-b984-4571-a8dd-c2d4cf52c569 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:17.118189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:17.123742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645925a4-5db2-40a3-8eba-35ddab6dbe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:17.124662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645925a4-5db2-40a3-8eba-35ddab6dbe7d admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:17.125416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645925a4-5db2-40a3-8eba-35ddab6dbe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:17.125789 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645925a4-5db2-40a3-8eba-35ddab6dbe7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:17.127154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645925a4-5db2-40a3-8eba-35ddab6dbe7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:17.127591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645925a4-5db2-40a3-8eba-35ddab6dbe7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:17.130275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645925a4-5db2-40a3-8eba-35ddab6dbe7d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:17.133460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecec7d4-96bc-4415-be48-215e39b6b9b6 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:17.151851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:17.154300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:17.154697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:17.155074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] PATH_INFO: `/v3/users/4300eb9b1932489fb54a2d760f1376cc` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:17.160593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4300eb9b1932489fb54a2d760f1376cc)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:17.165496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:17.166152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 916/1837] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:17.174498 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645925a4-5db2-40a3-8eba-35ddab6dbe7d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:17.177385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-645925a4-5db2-40a3-8eba-35ddab6dbe7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:17.211171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645925a4-5db2-40a3-8eba-35ddab6dbe7d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:17.221818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a142a6-0e54-42e2-8b2e-3909eaf26ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:17.222803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a142a6-0e54-42e2-8b2e-3909eaf26ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:17.223346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a142a6-0e54-42e2-8b2e-3909eaf26ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:17.223994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a142a6-0e54-42e2-8b2e-3909eaf26ae4 admin admin] PATH_INFO: `/v3/users/f5d3db3296784552976e511e3778bdad` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:17.225216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a142a6-0e54-42e2-8b2e-3909eaf26ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d3db3296784552976e511e3778bdad)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:17.227377 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a142a6-0e54-42e2-8b2e-3909eaf26ae4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:17.430809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4300eb9b1932489fb54a2d760f1376cc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:17.431570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4300eb9b1932489fb54a2d760f1376cc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:17.469438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-05a142a6-0e54-42e2-8b2e-3909eaf26ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d3db3296784552976e511e3778bdad'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:17.470603 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-05a142a6-0e54-42e2-8b2e-3909eaf26ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d3db3296784552976e511e3778bdad'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:17.504249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-05a142a6-0e54-42e2-8b2e-3909eaf26ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d3db3296784552976e511e3778bdad'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:17.516391 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:17.517371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4300eb9b1932489fb54a2d760f1376cc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:17.534178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4300eb9b1932489fb54a2d760f1376cc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:17.547840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4300eb9b1932489fb54a2d760f1376cc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:17.557609 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 922/1838] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:17 2022] DELETE /identity/v3/users/4300eb9b1932489fb54a2d760f1376cc => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:17.559542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:17.562073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:17.612776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-05a142a6-0e54-42e2-8b2e-3909eaf26ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d3db3296784552976e511e3778bdad'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:17.623976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-05a142a6-0e54-42e2-8b2e-3909eaf26ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d3db3296784552976e511e3778bdad'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:17.635123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 917/1839] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:17 2022] DELETE /identity/v3/users/f5d3db3296784552976e511e3778bdad => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:17.636464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993c915-be93-482d-b06b-86ee8832d410 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:17.637111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993c915-be93-482d-b06b-86ee8832d410 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:17.637512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993c915-be93-482d-b06b-86ee8832d410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:17.660069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-4993c915-be93-482d-b06b-86ee8832d410 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:17.663167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4993c915-be93-482d-b06b-86ee8832d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:17.664012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c3bf4-33a8-4fda-94d0-92959aa540bf admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:17.754525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6e0df-7153-4f1d-ace3-22054a282559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:17.761383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e0df-7153-4f1d-ace3-22054a282559 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:17.761383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e0df-7153-4f1d-ace3-22054a282559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:17.761758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 918/1840] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:17.761857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e0df-7153-4f1d-ace3-22054a282559 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:17.761857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6e0df-7153-4f1d-ace3-22054a282559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:17.761857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6e0df-7153-4f1d-ace3-22054a282559 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:17.770758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993c915-be93-482d-b06b-86ee8832d410 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:17.772758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4993c915-be93-482d-b06b-86ee8832d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:17.791811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993c915-be93-482d-b06b-86ee8832d410 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:17.809492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:17.810694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:17.810977 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:17.811282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] PATH_INFO: `/v3/projects/dd6ddbb1205745e98bb3a45e115759dd` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:17.818025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd6ddbb1205745e98bb3a45e115759dd)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:17.818025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:17.844882 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 923/1841] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:17 2022] POST /identity/v3/projects => generated 387 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:17.850019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6e0df-7153-4f1d-ace3-22054a282559 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:17.851923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-65c6e0df-7153-4f1d-ace3-22054a282559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:17.954790 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6e0df-7153-4f1d-ace3-22054a282559 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:17.966042 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd6ddbb1205745e98bb3a45e115759dd', 'request_id': 'req-3e2ff205-f3c4-432c-bd48-93b747285741'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.026340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0bdc4-2bc6-4d36-b648-c7082b53a4ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:18.026939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0bdc4-2bc6-4d36-b648-c7082b53a4ec service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:18.027212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0bdc4-2bc6-4d36-b648-c7082b53a4ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:18.027490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0bdc4-2bc6-4d36-b648-c7082b53a4ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:18.042023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd6ddbb1205745e98bb3a45e115759dd', 'request_id': 'req-3e2ff205-f3c4-432c-bd48-93b747285741'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.056829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd6ddbb1205745e98bb3a45e115759dd', 'request_id': 'req-3e2ff205-f3c4-432c-bd48-93b747285741'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.079969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] The token cache is being invalidate because project dd6ddbb1205745e98bb3a45e115759dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:18.083699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.086728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.091464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 919/1842] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:17 2022] DELETE /identity/v3/projects/dd6ddbb1205745e98bb3a45e115759dd => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:18.092409 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:18.097045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:18.126423 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0bdc4-2bc6-4d36-b648-c7082b53a4ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:18.128605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0bdc4-2bc6-4d36-b648-c7082b53a4ec service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:18.153688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 924/1843] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:18.154658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0bdc4-2bc6-4d36-b648-c7082b53a4ec service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:18.170466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0bdc4-2bc6-4d36-b648-c7082b53a4ec service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:18.185401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:18.186337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:18.186622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:18.186917 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] PATH_INFO: `/v3/users/59dd8b08fb654982b9ae3b263e62777b` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:18.189234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59dd8b08fb654982b9ae3b263e62777b)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:18.191212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:18.226441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ff205-f3c4-432c-bd48-93b747285741 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:18.234159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d71016-eda2-4e78-910e-0473243176cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:18.234611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d71016-eda2-4e78-910e-0473243176cb admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:18.234899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d71016-eda2-4e78-910e-0473243176cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:18.235178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d71016-eda2-4e78-910e-0473243176cb admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:18.235874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d71016-eda2-4e78-910e-0473243176cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:18.237871 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d71016-eda2-4e78-910e-0473243176cb admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:18.314930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:18.447558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 920/1844] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:18 2022] POST /identity/v3/users => generated 294 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:18.448493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d71016-eda2-4e78-910e-0473243176cb admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:18.450418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e2d71016-eda2-4e78-910e-0473243176cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:18.462962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d71016-eda2-4e78-910e-0473243176cb admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:18.467739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:18.468680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:18.469033 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:18.469385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] PATH_INFO: `/v3/projects/987d2d893ecb46ec94f06f9c75945554` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:18.470632 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=987d2d893ecb46ec94f06f9c75945554)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:18.472522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:18.483011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:18.492112 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59dd8b08fb654982b9ae3b263e62777b'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.492954 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59dd8b08fb654982b9ae3b263e62777b'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.583024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59dd8b08fb654982b9ae3b263e62777b'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.596088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59dd8b08fb654982b9ae3b263e62777b'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.603785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59dd8b08fb654982b9ae3b263e62777b'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.610720 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 925/1845] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:18 2022] DELETE /identity/v3/users/59dd8b08fb654982b9ae3b263e62777b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:18.611647 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:18.613018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:18.645154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987d2d893ecb46ec94f06f9c75945554', 'request_id': 'req-335867bb-048a-4121-9ac3-7b74de87dd3f'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.682991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dd976-87b1-4642-b2bc-5f7981059358 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:18.757245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19835a-1ce8-49de-b9ce-47d96267ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:18.758139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19835a-1ce8-49de-b9ce-47d96267ad47 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:18.758589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19835a-1ce8-49de-b9ce-47d96267ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:18.759005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19835a-1ce8-49de-b9ce-47d96267ad47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:18.760039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19835a-1ce8-49de-b9ce-47d96267ad47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:18.761806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19835a-1ce8-49de-b9ce-47d96267ad47 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:18.770268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987d2d893ecb46ec94f06f9c75945554', 'request_id': 'req-335867bb-048a-4121-9ac3-7b74de87dd3f'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.773447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 926/1846] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:18.774579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19835a-1ce8-49de-b9ce-47d96267ad47 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:18.776459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9d19835a-1ce8-49de-b9ce-47d96267ad47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:18.781551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987d2d893ecb46ec94f06f9c75945554', 'request_id': 'req-335867bb-048a-4121-9ac3-7b74de87dd3f'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.791965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19835a-1ce8-49de-b9ce-47d96267ad47 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:18.795900 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] The token cache is being invalidate because project 987d2d893ecb46ec94f06f9c75945554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:18.796191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.796832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:18.797436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:18.798496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:18.799063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:18.799166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 921/1847] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:18 2022] DELETE /identity/v3/projects/987d2d893ecb46ec94f06f9c75945554 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:18.799255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] PATH_INFO: `/v3/projects/8f373191ccb448a784d153ca89ac5209` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:18.800293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f373191ccb448a784d153ca89ac5209)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:18.802201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:18.802415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:18.803904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:18.817704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335867bb-048a-4121-9ac3-7b74de87dd3f admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:18.822830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c036a1-57e9-4c46-808a-293b5d7054f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:18.823504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c036a1-57e9-4c46-808a-293b5d7054f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:18.823787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c036a1-57e9-4c46-808a-293b5d7054f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:18.824062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c036a1-57e9-4c46-808a-293b5d7054f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:18.825060 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c036a1-57e9-4c46-808a-293b5d7054f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:18.826509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c036a1-57e9-4c46-808a-293b5d7054f7 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:18.842296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 922/1848] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:18.842296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c036a1-57e9-4c46-808a-293b5d7054f7 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:18.842932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d9c036a1-57e9-4c46-808a-293b5d7054f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:18.856667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c036a1-57e9-4c46-808a-293b5d7054f7 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:18.861966 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4bd18-4eb7-48ea-89a4-4146b892ada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:18.862933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4bd18-4eb7-48ea-89a4-4146b892ada4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:18.865780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4bd18-4eb7-48ea-89a4-4146b892ada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:18.865780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4bd18-4eb7-48ea-89a4-4146b892ada4 admin admin] PATH_INFO: `/v3/users/c8a09bfa2165445ba390bc5629dde437` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:18.865780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4bd18-4eb7-48ea-89a4-4146b892ada4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a09bfa2165445ba390bc5629dde437)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:18.866950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4bd18-4eb7-48ea-89a4-4146b892ada4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:18.933633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f373191ccb448a784d153ca89ac5209', 'request_id': 'req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:19.011977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f373191ccb448a784d153ca89ac5209', 'request_id': 'req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:19.019598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f373191ccb448a784d153ca89ac5209', 'request_id': 'req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:19.037155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] The token cache is being invalidate because project 8f373191ccb448a784d153ca89ac5209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:19.042619 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:19.049573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:19.051923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:19.058206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 927/1849] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:18 2022] DELETE /identity/v3/projects/8f373191ccb448a784d153ca89ac5209 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:19.060700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:19.063504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:19.066017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-e9b4bd18-4eb7-48ea-89a4-4146b892ada4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a09bfa2165445ba390bc5629dde437'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:19.067066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-e9b4bd18-4eb7-48ea-89a4-4146b892ada4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a09bfa2165445ba390bc5629dde437'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:19.084316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-e9b4bd18-4eb7-48ea-89a4-4146b892ada4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a09bfa2165445ba390bc5629dde437'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:19.153471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09f1b4-7a72-494b-9ec7-cccb7e0dae0a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:19.158822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acf3bf-88d1-4806-9d33-74725c5b7e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:19.159954 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acf3bf-88d1-4806-9d33-74725c5b7e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:19.160563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acf3bf-88d1-4806-9d33-74725c5b7e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:19.160674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acf3bf-88d1-4806-9d33-74725c5b7e01 admin admin] PATH_INFO: `/v3/projects/2ad3550d8a8b49d18bd6bce5f5381227/users/cfc1ff17bfdf4999ac109b8420fa7ce7/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:19.169918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-e9b4bd18-4eb7-48ea-89a4-4146b892ada4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a09bfa2165445ba390bc5629dde437'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:19.180657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-e9b4bd18-4eb7-48ea-89a4-4146b892ada4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a09bfa2165445ba390bc5629dde437'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:19.186573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38acf3bf-88d1-4806-9d33-74725c5b7e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad3550d8a8b49d18bd6bce5f5381227, user_id=cfc1ff17bfdf4999ac109b8420fa7ce7, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:19.188360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 923/1850] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:18 2022] DELETE /identity/v3/users/c8a09bfa2165445ba390bc5629dde437 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:19.189453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38acf3bf-88d1-4806-9d33-74725c5b7e01 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:19.190161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddaffc-8751-492d-90b3-fbaf0c680e01 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:19.190507 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddaffc-8751-492d-90b3-fbaf0c680e01 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:19.190794 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddaffc-8751-492d-90b3-fbaf0c680e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:19.214575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a7ddaffc-8751-492d-90b3-fbaf0c680e01 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:19.216732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a7ddaffc-8751-492d-90b3-fbaf0c680e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:19.308547 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 928/1851] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:19 2022] PUT /identity/v3/projects/2ad3550d8a8b49d18bd6bce5f5381227/users/cfc1ff17bfdf4999ac109b8420fa7ce7/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:19.321395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b49a8b-2cf7-4f78-a1d0-e91f559b3880 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:19.322914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b49a8b-2cf7-4f78-a1d0-e91f559b3880 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:19.324578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b49a8b-2cf7-4f78-a1d0-e91f559b3880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:19.328850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 924/1852] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:19.343179 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742faeae-dcf7-4476-88c2-cb67989e7806 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:19.343179 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742faeae-dcf7-4476-88c2-cb67989e7806 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:19.343179 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742faeae-dcf7-4476-88c2-cb67989e7806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:19.365565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-742faeae-dcf7-4476-88c2-cb67989e7806 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:19.367628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-742faeae-dcf7-4476-88c2-cb67989e7806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:19.371164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-b8b49a8b-2cf7-4f78-a1d0-e91f559b3880 None None] MFA Rules not processed for user `cfc1ff17bfdf4999ac109b8420fa7ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:19.373995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b8b49a8b-2cf7-4f78-a1d0-e91f559b3880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:19.445547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 925/1853] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:19.451290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742faeae-dcf7-4476-88c2-cb67989e7806 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:19.466039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742faeae-dcf7-4476-88c2-cb67989e7806 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:19.474188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a91454-bba3-4123-b11d-40ca8a3fdc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:19.475771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91454-bba3-4123-b11d-40ca8a3fdc87 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:19.476333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91454-bba3-4123-b11d-40ca8a3fdc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:19.476904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91454-bba3-4123-b11d-40ca8a3fdc87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:19.478168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91454-bba3-4123-b11d-40ca8a3fdc87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:19.478990 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91454-bba3-4123-b11d-40ca8a3fdc87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:19.487226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 929/1854] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:19.487368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91454-bba3-4123-b11d-40ca8a3fdc87 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:19.489523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b49a8b-2cf7-4f78-a1d0-e91f559b3880 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:19.492495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b8b49a8b-2cf7-4f78-a1d0-e91f559b3880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:19.513675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 926/1855] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:19.519250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a91454-bba3-4123-b11d-40ca8a3fdc87 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:19.523676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b49a8b-2cf7-4f78-a1d0-e91f559b3880 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:19.532989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a91454-bba3-4123-b11d-40ca8a3fdc87 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:19.535249 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffaad9-c8ad-4c90-a348-d9dad4ab6d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:19.536269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffaad9-c8ad-4c90-a348-d9dad4ab6d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:19.536561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffaad9-c8ad-4c90-a348-d9dad4ab6d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:19.536926 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffaad9-c8ad-4c90-a348-d9dad4ab6d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:19.537577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffaad9-c8ad-4c90-a348-d9dad4ab6d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:19.540856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffaad9-c8ad-4c90-a348-d9dad4ab6d42 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:19.545158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0926f-245d-4999-9e6b-a79efb8ab231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:19.545925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0926f-245d-4999-9e6b-a79efb8ab231 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:19.546216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0926f-245d-4999-9e6b-a79efb8ab231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:19.546565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0926f-245d-4999-9e6b-a79efb8ab231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:19.547219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0926f-245d-4999-9e6b-a79efb8ab231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:19.549130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0926f-245d-4999-9e6b-a79efb8ab231 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:19.704787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 927/1856] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:19 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:19.705757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0926f-245d-4999-9e6b-a79efb8ab231 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:19.724920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 930/1857] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:19 2022] POST /identity/v3/projects => generated 387 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:19.725872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffaad9-c8ad-4c90-a348-d9dad4ab6d42 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:19.818781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0926f-245d-4999-9e6b-a79efb8ab231 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:19.825680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af567e93-ec72-4e31-986a-2cfd5a7ba940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:19.826479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af567e93-ec72-4e31-986a-2cfd5a7ba940 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:19.826779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af567e93-ec72-4e31-986a-2cfd5a7ba940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:19.826959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af567e93-ec72-4e31-986a-2cfd5a7ba940 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:19.827707 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af567e93-ec72-4e31-986a-2cfd5a7ba940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:19.830705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af567e93-ec72-4e31-986a-2cfd5a7ba940 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:19.839515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffaad9-c8ad-4c90-a348-d9dad4ab6d42 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:19.845777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458b4d0-fc75-491c-8557-9f381714f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:19.846505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458b4d0-fc75-491c-8557-9f381714f3ea admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:19.846791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458b4d0-fc75-491c-8557-9f381714f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:19.847056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458b4d0-fc75-491c-8557-9f381714f3ea admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:19.847745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458b4d0-fc75-491c-8557-9f381714f3ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:19.849649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458b4d0-fc75-491c-8557-9f381714f3ea admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:19.890769 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:19.927345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 928/1858] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:19 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:19.928282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af567e93-ec72-4e31-986a-2cfd5a7ba940 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:19.934651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-af567e93-ec72-4e31-986a-2cfd5a7ba940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:19.943083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af567e93-ec72-4e31-986a-2cfd5a7ba940 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:19.948751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:19.949637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:19.949923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:19.950197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] PATH_INFO: `/v3/projects/bbedf667f16643a7ab5bfd39af438156` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:19.951425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbedf667f16643a7ab5bfd39af438156)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:19.953422 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:19.965957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 931/1859] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:19 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:19.965957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458b4d0-fc75-491c-8557-9f381714f3ea admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:19.966862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6458b4d0-fc75-491c-8557-9f381714f3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:19.979258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458b4d0-fc75-491c-8557-9f381714f3ea admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:19.996161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:19.997047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:19.997329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:19.997600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] PATH_INFO: `/v3/projects/94001a67310c43c6afc926afba00270e` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:19.999922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94001a67310c43c6afc926afba00270e)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:20.002060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:20.077122 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbedf667f16643a7ab5bfd39af438156', 'request_id': 'req-729aaa40-2f69-4fe0-8204-fe12bd124e82'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:20.195405 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94001a67310c43c6afc926afba00270e', 'request_id': 'req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:20.207881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbedf667f16643a7ab5bfd39af438156', 'request_id': 'req-729aaa40-2f69-4fe0-8204-fe12bd124e82'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:20.217159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbedf667f16643a7ab5bfd39af438156', 'request_id': 'req-729aaa40-2f69-4fe0-8204-fe12bd124e82'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:20.239622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] The token cache is being invalidate because project bbedf667f16643a7ab5bfd39af438156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:20.241159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:20.242301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:20.243887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 929/1860] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:19 2022] DELETE /identity/v3/projects/bbedf667f16643a7ab5bfd39af438156 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:20.244667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:20.245995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:20.309973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aaa40-2f69-4fe0-8204-fe12bd124e82 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:20.363891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58679744-526a-4ef6-a487-1771924be9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:20.364614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679744-526a-4ef6-a487-1771924be9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.364903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679744-526a-4ef6-a487-1771924be9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.365184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679744-526a-4ef6-a487-1771924be9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.366435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58679744-526a-4ef6-a487-1771924be9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:20.368492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58679744-526a-4ef6-a487-1771924be9c4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:20.377873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 930/1861] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:20.378736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58679744-526a-4ef6-a487-1771924be9c4 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:20.380451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-58679744-526a-4ef6-a487-1771924be9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:20.388842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94001a67310c43c6afc926afba00270e', 'request_id': 'req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:20.396756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58679744-526a-4ef6-a487-1771924be9c4 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:20.396890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94001a67310c43c6afc926afba00270e', 'request_id': 'req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:20.406400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84088fc7-3156-410b-83cf-f607e7f5c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:20.407197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84088fc7-3156-410b-83cf-f607e7f5c709 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.407557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84088fc7-3156-410b-83cf-f607e7f5c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.407909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84088fc7-3156-410b-83cf-f607e7f5c709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.408657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84088fc7-3156-410b-83cf-f607e7f5c709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:20.410359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84088fc7-3156-410b-83cf-f607e7f5c709 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:20.419343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] The token cache is being invalidate because project 94001a67310c43c6afc926afba00270e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:20.419779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:20.420338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7ecc966e-6cf9-4de9-8bf6-0a73f7253fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:20.428844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 932/1862] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:19 2022] DELETE /identity/v3/projects/94001a67310c43c6afc926afba00270e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:20.428844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086998f8-90f9-4a49-9649-dee1a5781c4d None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.429058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 931/1863] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:20.429133 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086998f8-90f9-4a49-9649-dee1a5781c4d None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.429133 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086998f8-90f9-4a49-9649-dee1a5781c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.430389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84088fc7-3156-410b-83cf-f607e7f5c709 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:20.434936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-84088fc7-3156-410b-83cf-f607e7f5c709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:20.448400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84088fc7-3156-410b-83cf-f607e7f5c709 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:20.448574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-086998f8-90f9-4a49-9649-dee1a5781c4d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:20.449637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-086998f8-90f9-4a49-9649-dee1a5781c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:20.453557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df160d-67ee-466d-a45b-c30b9f23be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:20.454651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df160d-67ee-466d-a45b-c30b9f23be03 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.454651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df160d-67ee-466d-a45b-c30b9f23be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.454870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df160d-67ee-466d-a45b-c30b9f23be03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.455621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df160d-67ee-466d-a45b-c30b9f23be03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:20.457216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df160d-67ee-466d-a45b-c30b9f23be03 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:20.465331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 933/1864] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:20.465331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6531d-bfd0-44e8-b98e-365eade81466 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.465331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6531d-bfd0-44e8-b98e-365eade81466 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.465331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6531d-bfd0-44e8-b98e-365eade81466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.478290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 932/1865] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:20.478290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df160d-67ee-466d-a45b-c30b9f23be03 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:20.479033 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-71df160d-67ee-466d-a45b-c30b9f23be03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:20.483467 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-5ac6531d-bfd0-44e8-b98e-365eade81466 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:20.484695 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5ac6531d-bfd0-44e8-b98e-365eade81466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:20.493100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df160d-67ee-466d-a45b-c30b9f23be03 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:20.494330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 934/1866] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:20.495281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88ba04-7b24-436c-93df-150a3eb6e429 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.495572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88ba04-7b24-436c-93df-150a3eb6e429 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.495848 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88ba04-7b24-436c-93df-150a3eb6e429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.503564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750ff46-c988-4294-8cf6-e1a68f2f8ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:20.504482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750ff46-c988-4294-8cf6-e1a68f2f8ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.504768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750ff46-c988-4294-8cf6-e1a68f2f8ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.505049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750ff46-c988-4294-8cf6-e1a68f2f8ddc admin admin] PATH_INFO: `/v3/projects/063eaccb394647d1bcaf0ba4eaf2c5f0/users/a76d62c8d9204640bdfe4f13677d69aa/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.514666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-3b88ba04-7b24-436c-93df-150a3eb6e429 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:20.515845 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3b88ba04-7b24-436c-93df-150a3eb6e429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:20.526119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750ff46-c988-4294-8cf6-e1a68f2f8ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=063eaccb394647d1bcaf0ba4eaf2c5f0, user_id=a76d62c8d9204640bdfe4f13677d69aa, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:20.529891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 935/1867] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:20.529891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88ba04-7b24-436c-93df-150a3eb6e429 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:20.530107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750ff46-c988-4294-8cf6-e1a68f2f8ddc admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:20.539548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88ba04-7b24-436c-93df-150a3eb6e429 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:20.544702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee856979-2f70-4402-8fc2-f16481b57304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:20.545632 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee856979-2f70-4402-8fc2-f16481b57304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.545920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee856979-2f70-4402-8fc2-f16481b57304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.546193 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee856979-2f70-4402-8fc2-f16481b57304 admin admin] PATH_INFO: `/v3/projects/a4559c4725414042845abf493c072f25/users/01e911c5ee604cd19dc2f56646938071/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.561978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee856979-2f70-4402-8fc2-f16481b57304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4559c4725414042845abf493c072f25, user_id=01e911c5ee604cd19dc2f56646938071, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:20.564717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee856979-2f70-4402-8fc2-f16481b57304 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:20.617077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 933/1868] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:20 2022] PUT /identity/v3/projects/063eaccb394647d1bcaf0ba4eaf2c5f0/users/a76d62c8d9204640bdfe4f13677d69aa/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:20.618397 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eea4e9-3f4f-4261-bc30-305e6a07025b None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.618688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eea4e9-3f4f-4261-bc30-305e6a07025b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.618984 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eea4e9-3f4f-4261-bc30-305e6a07025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.636227 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-83eea4e9-3f4f-4261-bc30-305e6a07025b None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:20.637411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-83eea4e9-3f4f-4261-bc30-305e6a07025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:20.660687 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 936/1869] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:20 2022] PUT /identity/v3/projects/a4559c4725414042845abf493c072f25/users/01e911c5ee604cd19dc2f56646938071/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:20.661668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee856979-2f70-4402-8fc2-f16481b57304 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:20.728533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 934/1870] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:20.728533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eea4e9-3f4f-4261-bc30-305e6a07025b None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:20.737925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eea4e9-3f4f-4261-bc30-305e6a07025b None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:20.757299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee856979-2f70-4402-8fc2-f16481b57304 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:20.762361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c4a05-9bde-45b8-998d-d7c04c3cdc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:20.763041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c4a05-9bde-45b8-998d-d7c04c3cdc3b admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.763318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c4a05-9bde-45b8-998d-d7c04c3cdc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.763776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c4a05-9bde-45b8-998d-d7c04c3cdc3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.764522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c4a05-9bde-45b8-998d-d7c04c3cdc3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:20.764833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c4a05-9bde-45b8-998d-d7c04c3cdc3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:20.766644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c4a05-9bde-45b8-998d-d7c04c3cdc3b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:20.779732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 937/1871] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:20.781322 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7adc04-ce82-47be-833e-ce4470ff9302 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.781661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7adc04-ce82-47be-833e-ce4470ff9302 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.781944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7adc04-ce82-47be-833e-ce4470ff9302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.814127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f418d2-6d01-4b32-b4b6-fbcf852f8426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:20.815002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f418d2-6d01-4b32-b4b6-fbcf852f8426 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.815325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f418d2-6d01-4b32-b4b6-fbcf852f8426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.815599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f418d2-6d01-4b32-b4b6-fbcf852f8426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.815888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-3e7adc04-ce82-47be-833e-ce4470ff9302 None None] MFA Rules not processed for user `01e911c5ee604cd19dc2f56646938071`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:20.816646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f418d2-6d01-4b32-b4b6-fbcf852f8426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:20.817232 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3e7adc04-ce82-47be-833e-ce4470ff9302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:20.818744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f418d2-6d01-4b32-b4b6-fbcf852f8426 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:20.839227 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 935/1872] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:20.840433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f418d2-6d01-4b32-b4b6-fbcf852f8426 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:20.852909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f418d2-6d01-4b32-b4b6-fbcf852f8426 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:20.858197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469c3b0-2eec-498d-a941-dd14707cfa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:20.858875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c3b0-2eec-498d-a941-dd14707cfa29 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.859154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c3b0-2eec-498d-a941-dd14707cfa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.859425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c3b0-2eec-498d-a941-dd14707cfa29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.860141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c3b0-2eec-498d-a941-dd14707cfa29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:20.860494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c3b0-2eec-498d-a941-dd14707cfa29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:20.862112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c3b0-2eec-498d-a941-dd14707cfa29 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:20.875304 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 936/1873] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:20.876121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469c3b0-2eec-498d-a941-dd14707cfa29 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:20.888526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469c3b0-2eec-498d-a941-dd14707cfa29 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:20.888980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 938/1874] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:20.890957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7adc04-ce82-47be-833e-ce4470ff9302 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:20.893543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d5e04-86b9-4926-b9f4-d35154ccd5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:20.894204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5e04-86b9-4926-b9f4-d35154ccd5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.895926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5e04-86b9-4926-b9f4-d35154ccd5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.895926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5e04-86b9-4926-b9f4-d35154ccd5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.895926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d5e04-86b9-4926-b9f4-d35154ccd5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:20.897953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d5e04-86b9-4926-b9f4-d35154ccd5f9 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:20.904047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7adc04-ce82-47be-833e-ce4470ff9302 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:20.908985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb285ac-0d55-4f01-a337-138a2660f370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:20.909872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb285ac-0d55-4f01-a337-138a2660f370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:20.910154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb285ac-0d55-4f01-a337-138a2660f370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:20.910462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb285ac-0d55-4f01-a337-138a2660f370 admin admin] PATH_INFO: `/v3/projects/063eaccb394647d1bcaf0ba4eaf2c5f0/users/a76d62c8d9204640bdfe4f13677d69aa/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:20.912599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb285ac-0d55-4f01-a337-138a2660f370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=063eaccb394647d1bcaf0ba4eaf2c5f0, user_id=a76d62c8d9204640bdfe4f13677d69aa, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:20.915785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb285ac-0d55-4f01-a337-138a2660f370 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:20.926160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 939/1875] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:20 2022] PUT /identity/v3/projects/063eaccb394647d1bcaf0ba4eaf2c5f0/users/a76d62c8d9204640bdfe4f13677d69aa/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:20.926940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb285ac-0d55-4f01-a337-138a2660f370 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.004797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb285ac-0d55-4f01-a337-138a2660f370 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.010012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f4bd0-a336-402e-bfe0-e37dbd979899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.010797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f4bd0-a336-402e-bfe0-e37dbd979899 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.011151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f4bd0-a336-402e-bfe0-e37dbd979899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.011494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f4bd0-a336-402e-bfe0-e37dbd979899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.012288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f4bd0-a336-402e-bfe0-e37dbd979899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.013739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 937/1876] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:20 2022] POST /identity/v3/projects => generated 409 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:21.014649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d5e04-86b9-4926-b9f4-d35154ccd5f9 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.015489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f4bd0-a336-402e-bfe0-e37dbd979899 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.095201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d5e04-86b9-4926-b9f4-d35154ccd5f9 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.107616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 940/1877] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:20 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:21.109332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995c0a-9fb0-4ea7-ae9e-c7b249b967d0 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.109622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995c0a-9fb0-4ea7-ae9e-c7b249b967d0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.109901 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995c0a-9fb0-4ea7-ae9e-c7b249b967d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.114956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98feba0c-6292-4f43-9f60-adf7e288b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.115638 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98feba0c-6292-4f43-9f60-adf7e288b54d admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.116070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98feba0c-6292-4f43-9f60-adf7e288b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.116348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98feba0c-6292-4f43-9f60-adf7e288b54d admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.117054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98feba0c-6292-4f43-9f60-adf7e288b54d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.119246 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98feba0c-6292-4f43-9f60-adf7e288b54d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.143557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-4c995c0a-9fb0-4ea7-ae9e-c7b249b967d0 None None] MFA Rules not processed for user `a76d62c8d9204640bdfe4f13677d69aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:21.144965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-4c995c0a-9fb0-4ea7-ae9e-c7b249b967d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:21.195503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:21.212748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 941/1878] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:21.213619 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995c0a-9fb0-4ea7-ae9e-c7b249b967d0 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.243064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 938/1879] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:21 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:21.243064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98feba0c-6292-4f43-9f60-adf7e288b54d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.281890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995c0a-9fb0-4ea7-ae9e-c7b249b967d0 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.312905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98feba0c-6292-4f43-9f60-adf7e288b54d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.318563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af2131-2e64-4b4c-84a9-b2af630f0144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.319985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af2131-2e64-4b4c-84a9-b2af630f0144 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.320267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af2131-2e64-4b4c-84a9-b2af630f0144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.320548 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af2131-2e64-4b4c-84a9-b2af630f0144 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.321245 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af2131-2e64-4b4c-84a9-b2af630f0144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.323461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af2131-2e64-4b4c-84a9-b2af630f0144 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.349411 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88770e-d8b9-40c0-80f2-4c3d65890265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.356907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88770e-d8b9-40c0-80f2-4c3d65890265 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.356907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88770e-d8b9-40c0-80f2-4c3d65890265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.356907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88770e-d8b9-40c0-80f2-4c3d65890265 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.356907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88770e-d8b9-40c0-80f2-4c3d65890265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.356907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88770e-d8b9-40c0-80f2-4c3d65890265 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.440286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 939/1880] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:21 2022] POST /identity/v3/users => generated 281 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:21.441225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af2131-2e64-4b4c-84a9-b2af630f0144 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.443321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a1af2131-2e64-4b4c-84a9-b2af630f0144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:21.468486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 942/1881] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:21 2022] POST /identity/v3/users => generated 305 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:21.469682 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88770e-d8b9-40c0-80f2-4c3d65890265 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.480081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88770e-d8b9-40c0-80f2-4c3d65890265 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.485950 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e5d7-206a-42c5-b2bd-d82ecace7c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.486715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e5d7-206a-42c5-b2bd-d82ecace7c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.487006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e5d7-206a-42c5-b2bd-d82ecace7c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.487284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e5d7-206a-42c5-b2bd-d82ecace7c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.488078 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506e5d7-206a-42c5-b2bd-d82ecace7c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.490042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506e5d7-206a-42c5-b2bd-d82ecace7c12 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.508938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af2131-2e64-4b4c-84a9-b2af630f0144 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.512691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b977de-805e-4d07-9ac1-1b3fc1f7a57e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.515928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b977de-805e-4d07-9ac1-1b3fc1f7a57e service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.515928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b977de-805e-4d07-9ac1-1b3fc1f7a57e service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.515928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b977de-805e-4d07-9ac1-1b3fc1f7a57e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.573490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 943/1882] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:21 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:21.573490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e5d7-206a-42c5-b2bd-d82ecace7c12 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.574090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b977de-805e-4d07-9ac1-1b3fc1f7a57e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.574922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b977de-805e-4d07-9ac1-1b3fc1f7a57e service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.582003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e5d7-206a-42c5-b2bd-d82ecace7c12 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.584674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 940/1883] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:21.585513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b977de-805e-4d07-9ac1-1b3fc1f7a57e service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.586640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cb1da-2053-4a54-9f0b-00911f683143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.587379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cb1da-2053-4a54-9f0b-00911f683143 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.587660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cb1da-2053-4a54-9f0b-00911f683143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.587932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cb1da-2053-4a54-9f0b-00911f683143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.588655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cb1da-2053-4a54-9f0b-00911f683143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.590519 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cb1da-2053-4a54-9f0b-00911f683143 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.595828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b977de-805e-4d07-9ac1-1b3fc1f7a57e service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.600732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85ac04-a40e-4aaf-96b7-7f36e80dfdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.601403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85ac04-a40e-4aaf-96b7-7f36e80dfdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.601687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85ac04-a40e-4aaf-96b7-7f36e80dfdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.602118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85ac04-a40e-4aaf-96b7-7f36e80dfdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.605243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 944/1884] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:21.605338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85ac04-a40e-4aaf-96b7-7f36e80dfdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.608636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cb1da-2053-4a54-9f0b-00911f683143 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.608757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85ac04-a40e-4aaf-96b7-7f36e80dfdb8 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.619069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 941/1885] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:21.619069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85ac04-a40e-4aaf-96b7-7f36e80dfdb8 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.621969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cb1da-2053-4a54-9f0b-00911f683143 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.627727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8b6ae-d75a-4b54-a272-8b78a5f80b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.627866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85ac04-a40e-4aaf-96b7-7f36e80dfdb8 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.629325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8b6ae-d75a-4b54-a272-8b78a5f80b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.629705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8b6ae-d75a-4b54-a272-8b78a5f80b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.630075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8b6ae-d75a-4b54-a272-8b78a5f80b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.630941 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8b6ae-d75a-4b54-a272-8b78a5f80b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.633260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d47b85-4fe3-4749-8bb4-0c06691e025a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.633801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8b6ae-d75a-4b54-a272-8b78a5f80b66 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.633913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d47b85-4fe3-4749-8bb4-0c06691e025a admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.634190 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d47b85-4fe3-4749-8bb4-0c06691e025a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.634514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d47b85-4fe3-4749-8bb4-0c06691e025a admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.635246 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d47b85-4fe3-4749-8bb4-0c06691e025a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.636999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d47b85-4fe3-4749-8bb4-0c06691e025a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.649236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 945/1886] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:21.650205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8b6ae-d75a-4b54-a272-8b78a5f80b66 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.653702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 942/1887] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:21.653702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d47b85-4fe3-4749-8bb4-0c06691e025a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.664830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d47b85-4fe3-4749-8bb4-0c06691e025a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.665152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8b6ae-d75a-4b54-a272-8b78a5f80b66 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.669548 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143e008-8ac6-4732-9af4-2a9b0e84b780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.669999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff97f4-04fc-4e20-8c61-b1e20c977860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.670206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143e008-8ac6-4732-9af4-2a9b0e84b780 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.670523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143e008-8ac6-4732-9af4-2a9b0e84b780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.670797 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143e008-8ac6-4732-9af4-2a9b0e84b780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.671027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff97f4-04fc-4e20-8c61-b1e20c977860 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.671378 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff97f4-04fc-4e20-8c61-b1e20c977860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.671528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143e008-8ac6-4732-9af4-2a9b0e84b780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.671774 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff97f4-04fc-4e20-8c61-b1e20c977860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.672853 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff97f4-04fc-4e20-8c61-b1e20c977860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.673237 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143e008-8ac6-4732-9af4-2a9b0e84b780 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.674743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff97f4-04fc-4e20-8c61-b1e20c977860 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.688075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 943/1888] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:21.688238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 946/1889] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:21.689119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff97f4-04fc-4e20-8c61-b1e20c977860 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.691052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143e008-8ac6-4732-9af4-2a9b0e84b780 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.702176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff97f4-04fc-4e20-8c61-b1e20c977860 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.706626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143e008-8ac6-4732-9af4-2a9b0e84b780 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.707222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed8ecb-2401-4fa8-90e5-9a1793ac87da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.708140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed8ecb-2401-4fa8-90e5-9a1793ac87da admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.708428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed8ecb-2401-4fa8-90e5-9a1793ac87da admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.708702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed8ecb-2401-4fa8-90e5-9a1793ac87da admin admin] PATH_INFO: `/v3/projects/256e9e1086584e3481ae2407ca914eec/users/321fed26a09c464d99d41d2b82904c20/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.713420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ed040-c22e-4222-82ef-b2f32bb4cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.714375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ed040-c22e-4222-82ef-b2f32bb4cc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.714662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ed040-c22e-4222-82ef-b2f32bb4cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.714942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ed040-c22e-4222-82ef-b2f32bb4cc09 admin admin] PATH_INFO: `/v3/projects/bc333cfc05ca4ac388a4790fda22d362/users/fa6cd3b841cd43b58977405f13cad5c4/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.731139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed8ecb-2401-4fa8-90e5-9a1793ac87da admin admin] RBAC: Authorizing `identity:create_grant(project_id=256e9e1086584e3481ae2407ca914eec, user_id=321fed26a09c464d99d41d2b82904c20, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.734543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed8ecb-2401-4fa8-90e5-9a1793ac87da admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.737586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ed040-c22e-4222-82ef-b2f32bb4cc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc333cfc05ca4ac388a4790fda22d362, user_id=fa6cd3b841cd43b58977405f13cad5c4, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.741316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ed040-c22e-4222-82ef-b2f32bb4cc09 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.823957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 947/1890] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:21 2022] PUT /identity/v3/projects/256e9e1086584e3481ae2407ca914eec/users/321fed26a09c464d99d41d2b82904c20/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:21.824906 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed8ecb-2401-4fa8-90e5-9a1793ac87da admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.853710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 944/1891] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:21 2022] PUT /identity/v3/projects/bc333cfc05ca4ac388a4790fda22d362/users/fa6cd3b841cd43b58977405f13cad5c4/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:21.854746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ed040-c22e-4222-82ef-b2f32bb4cc09 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:21.899990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed8ecb-2401-4fa8-90e5-9a1793ac87da admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.929870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ed040-c22e-4222-82ef-b2f32bb4cc09 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:21.935341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9e76f-bab6-42a6-817e-80ff5d1d77e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.936271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e76f-bab6-42a6-817e-80ff5d1d77e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.936554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e76f-bab6-42a6-817e-80ff5d1d77e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.936829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e76f-bab6-42a6-817e-80ff5d1d77e4 admin admin] PATH_INFO: `/v3/users/cfc1ff17bfdf4999ac109b8420fa7ce7` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.945809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9e76f-bab6-42a6-817e-80ff5d1d77e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc1ff17bfdf4999ac109b8420fa7ce7)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.948211 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9e76f-bab6-42a6-817e-80ff5d1d77e4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:21.955113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7e4b-945d-4cb2-b537-1c7fc6b551c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:21.956024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7e4b-945d-4cb2-b537-1c7fc6b551c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:21.956311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7e4b-945d-4cb2-b537-1c7fc6b551c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:21.956842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7e4b-945d-4cb2-b537-1c7fc6b551c2 admin admin] PATH_INFO: `/v3/projects/466b1f7a5d3e488ca2d08b2f432a4486/users/64822376d66744dfa54bc8b1821a1363/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:21.971679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f7e4b-945d-4cb2-b537-1c7fc6b551c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=466b1f7a5d3e488ca2d08b2f432a4486, user_id=64822376d66744dfa54bc8b1821a1363, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:21.974400 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f7e4b-945d-4cb2-b537-1c7fc6b551c2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:22.073879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:22.081537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 948/1892] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:21 2022] PUT /identity/v3/projects/466b1f7a5d3e488ca2d08b2f432a4486/users/64822376d66744dfa54bc8b1821a1363/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:22.082886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb4f55-aa68-4bef-898d-7e441ec40a29 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:22.083180 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb4f55-aa68-4bef-898d-7e441ec40a29 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:22.083523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb4f55-aa68-4bef-898d-7e441ec40a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:22.109085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c7eb4f55-aa68-4bef-898d-7e441ec40a29 None None] MFA Rules not processed for user `321fed26a09c464d99d41d2b82904c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:22.110391 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c7eb4f55-aa68-4bef-898d-7e441ec40a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:22.123188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-72c9e76f-bab6-42a6-817e-80ff5d1d77e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc1ff17bfdf4999ac109b8420fa7ce7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:22.128501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-72c9e76f-bab6-42a6-817e-80ff5d1d77e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc1ff17bfdf4999ac109b8420fa7ce7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:22.148777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-72c9e76f-bab6-42a6-817e-80ff5d1d77e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc1ff17bfdf4999ac109b8420fa7ce7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:22.180385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 949/1893] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:22.181748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d232a63-142c-44ed-a87b-cea65d89f014 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:22.182087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d232a63-142c-44ed-a87b-cea65d89f014 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:22.182403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d232a63-142c-44ed-a87b-cea65d89f014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:22.217224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-9d232a63-142c-44ed-a87b-cea65d89f014 None None] MFA Rules not processed for user `fa6cd3b841cd43b58977405f13cad5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:22.217224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9d232a63-142c-44ed-a87b-cea65d89f014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:22.235027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-72c9e76f-bab6-42a6-817e-80ff5d1d77e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc1ff17bfdf4999ac109b8420fa7ce7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:22.243206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-72c9e76f-bab6-42a6-817e-80ff5d1d77e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc1ff17bfdf4999ac109b8420fa7ce7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:22.251159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 945/1894] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:21 2022] DELETE /identity/v3/users/cfc1ff17bfdf4999ac109b8420fa7ce7 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:22.252683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acff1d-c5dc-4bea-8c1c-fde98c0eab81 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:22.252970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acff1d-c5dc-4bea-8c1c-fde98c0eab81 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:22.253247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acff1d-c5dc-4bea-8c1c-fde98c0eab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:22.281969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-41acff1d-c5dc-4bea-8c1c-fde98c0eab81 None None] MFA Rules not processed for user `64822376d66744dfa54bc8b1821a1363`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:22.283495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-41acff1d-c5dc-4bea-8c1c-fde98c0eab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:22.289652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 950/1895] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:22.290862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d232a63-142c-44ed-a87b-cea65d89f014 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:22.295727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9d232a63-142c-44ed-a87b-cea65d89f014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:22.360324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 946/1896] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:22.361860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eba8d5-fc1f-48e9-ab37-df5166d96bc4 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:22.362517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eba8d5-fc1f-48e9-ab37-df5166d96bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:22.362626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eba8d5-fc1f-48e9-ab37-df5166d96bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:22.378011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d232a63-142c-44ed-a87b-cea65d89f014 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:22.380071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-39eba8d5-fc1f-48e9-ab37-df5166d96bc4 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:22.381475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-39eba8d5-fc1f-48e9-ab37-df5166d96bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:22.440721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e77a7-8e0e-4616-8a6c-07d70ff0805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:22.441469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e77a7-8e0e-4616-8a6c-07d70ff0805d admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:22.441667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e77a7-8e0e-4616-8a6c-07d70ff0805d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:22.442003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e77a7-8e0e-4616-8a6c-07d70ff0805d admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:22.442764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e77a7-8e0e-4616-8a6c-07d70ff0805d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:22.445051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e77a7-8e0e-4616-8a6c-07d70ff0805d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:22.460090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 947/1897] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:22.461132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eba8d5-fc1f-48e9-ab37-df5166d96bc4 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:22.462625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-39eba8d5-fc1f-48e9-ab37-df5166d96bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:22.484084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eba8d5-fc1f-48e9-ab37-df5166d96bc4 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:22.493816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a2c47-b916-474e-8505-1def9856e012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:22.495346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a2c47-b916-474e-8505-1def9856e012 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:22.496101 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a2c47-b916-474e-8505-1def9856e012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:22.496772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a2c47-b916-474e-8505-1def9856e012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:22.498277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a2c47-b916-474e-8505-1def9856e012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:22.500394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a2c47-b916-474e-8505-1def9856e012 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:22.547851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 951/1898] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:22 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:22.549130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e77a7-8e0e-4616-8a6c-07d70ff0805d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:22.551611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-971e77a7-8e0e-4616-8a6c-07d70ff0805d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:22.617883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 948/1899] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:22 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:22.619002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a2c47-b916-474e-8505-1def9856e012 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:22.619735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e77a7-8e0e-4616-8a6c-07d70ff0805d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:22.621352 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-637a2c47-b916-474e-8505-1def9856e012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:22.679732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d084b-97b6-412c-9bc0-565f082bc64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:22.680403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d084b-97b6-412c-9bc0-565f082bc64d admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:22.680682 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d084b-97b6-412c-9bc0-565f082bc64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:22.680951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d084b-97b6-412c-9bc0-565f082bc64d admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:22.681821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d084b-97b6-412c-9bc0-565f082bc64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:22.683632 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a2c47-b916-474e-8505-1def9856e012 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:22.684466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d084b-97b6-412c-9bc0-565f082bc64d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:22.687778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbbb05-9c33-49a3-961c-78f756601157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:22.688246 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbbb05-9c33-49a3-961c-78f756601157 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:22.688534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbbb05-9c33-49a3-961c-78f756601157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:22.688813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbbb05-9c33-49a3-961c-78f756601157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:22.699303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbbb05-9c33-49a3-961c-78f756601157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:22.701670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbbb05-9c33-49a3-961c-78f756601157 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:22.711208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 949/1900] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:22.712001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbbb05-9c33-49a3-961c-78f756601157 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:22.721892 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbbb05-9c33-49a3-961c-78f756601157 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:22.726948 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f2829-8ae9-43d0-b174-9334c0eb0dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:22.727616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2829-8ae9-43d0-b174-9334c0eb0dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:22.728238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2829-8ae9-43d0-b174-9334c0eb0dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:22.728348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2829-8ae9-43d0-b174-9334c0eb0dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:22.731670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f2829-8ae9-43d0-b174-9334c0eb0dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:22.731670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f2829-8ae9-43d0-b174-9334c0eb0dd7 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:22.803998 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 952/1901] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:22 2022] POST /identity/v3/projects => generated 409 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:22.805494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d084b-97b6-412c-9bc0-565f082bc64d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:22.849075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 950/1902] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:22 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:22.850397 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f2829-8ae9-43d0-b174-9334c0eb0dd7 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:22.862120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f2829-8ae9-43d0-b174-9334c0eb0dd7 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:22.903493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d084b-97b6-412c-9bc0-565f082bc64d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:22.910500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb234b-2211-49b4-bce3-8e1d4fbcd84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:22.911270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb234b-2211-49b4-bce3-8e1d4fbcd84f admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:22.911633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb234b-2211-49b4-bce3-8e1d4fbcd84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:22.911988 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb234b-2211-49b4-bce3-8e1d4fbcd84f admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:22.913518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb234b-2211-49b4-bce3-8e1d4fbcd84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:22.916149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb234b-2211-49b4-bce3-8e1d4fbcd84f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:22.951277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d25377-7789-41de-bb7d-11259695f1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:22.951958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d25377-7789-41de-bb7d-11259695f1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:22.952294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d25377-7789-41de-bb7d-11259695f1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:22.952522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d25377-7789-41de-bb7d-11259695f1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:22.953228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d25377-7789-41de-bb7d-11259695f1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:22.955199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d25377-7789-41de-bb7d-11259695f1b2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:22.996647 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 953/1903] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:22 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:22.996647 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb234b-2211-49b4-bce3-8e1d4fbcd84f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.005416 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb234b-2211-49b4-bce3-8e1d4fbcd84f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.014514 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f139a4-3c66-4afd-9da1-da8c8acbe0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.016199 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f139a4-3c66-4afd-9da1-da8c8acbe0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.016674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f139a4-3c66-4afd-9da1-da8c8acbe0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.017115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f139a4-3c66-4afd-9da1-da8c8acbe0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.018037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f139a4-3c66-4afd-9da1-da8c8acbe0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.019691 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f139a4-3c66-4afd-9da1-da8c8acbe0f1 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.034417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 954/1904] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:23.035284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f139a4-3c66-4afd-9da1-da8c8acbe0f1 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.047197 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f139a4-3c66-4afd-9da1-da8c8acbe0f1 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.052710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae2315-953a-4a2c-9874-5f398b71c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.054052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2315-953a-4a2c-9874-5f398b71c094 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.055480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2315-953a-4a2c-9874-5f398b71c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.055480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2315-953a-4a2c-9874-5f398b71c094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.055480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae2315-953a-4a2c-9874-5f398b71c094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.056981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae2315-953a-4a2c-9874-5f398b71c094 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.067417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 955/1905] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:23.068342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae2315-953a-4a2c-9874-5f398b71c094 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.081035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 951/1906] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:22 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:23.082233 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d25377-7789-41de-bb7d-11259695f1b2 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.095644 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d25377-7789-41de-bb7d-11259695f1b2 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.098020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae2315-953a-4a2c-9874-5f398b71c094 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.100389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e622657-2186-49dc-bafa-519294db7351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.101474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622657-2186-49dc-bafa-519294db7351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.101803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622657-2186-49dc-bafa-519294db7351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.102158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622657-2186-49dc-bafa-519294db7351 admin admin] PATH_INFO: `/v3/projects/983c0807954a4f7ab1475eecb68d1d2f/users/ccc16b2666d64920805c112b91dc64a4/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.104887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b39053-0c6d-4d53-811e-eef6c344f0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.120869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b39053-0c6d-4d53-811e-eef6c344f0ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.122986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b39053-0c6d-4d53-811e-eef6c344f0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.123445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b39053-0c6d-4d53-811e-eef6c344f0ac admin admin] PATH_INFO: `/v3/projects/8e7e0811179c4cef80c5cb669ddf3ee1/users/39a76f770663413d8c6e76ae435f15d2/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.126995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e622657-2186-49dc-bafa-519294db7351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983c0807954a4f7ab1475eecb68d1d2f, user_id=ccc16b2666d64920805c112b91dc64a4, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.130560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e622657-2186-49dc-bafa-519294db7351 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.166278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b39053-0c6d-4d53-811e-eef6c344f0ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7e0811179c4cef80c5cb669ddf3ee1, user_id=39a76f770663413d8c6e76ae435f15d2, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.168995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b39053-0c6d-4d53-811e-eef6c344f0ac admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.216286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 952/1907] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:23 2022] PUT /identity/v3/projects/983c0807954a4f7ab1475eecb68d1d2f/users/ccc16b2666d64920805c112b91dc64a4/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:23.216286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e622657-2186-49dc-bafa-519294db7351 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.245495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 956/1908] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:23 2022] PUT /identity/v3/projects/8e7e0811179c4cef80c5cb669ddf3ee1/users/39a76f770663413d8c6e76ae435f15d2/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:23.246375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b39053-0c6d-4d53-811e-eef6c344f0ac admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.304726 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e622657-2186-49dc-bafa-519294db7351 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.326142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b39053-0c6d-4d53-811e-eef6c344f0ac admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.331000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f06c8-043c-4720-b1af-09a078c67d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.333264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f06c8-043c-4720-b1af-09a078c67d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.333264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f06c8-043c-4720-b1af-09a078c67d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.333264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f06c8-043c-4720-b1af-09a078c67d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.333264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f06c8-043c-4720-b1af-09a078c67d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.336570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f06c8-043c-4720-b1af-09a078c67d16 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.349018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 957/1909] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:23.349018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f06c8-043c-4720-b1af-09a078c67d16 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.370276 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f06c8-043c-4720-b1af-09a078c67d16 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.376539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f518d7-6b36-47df-8fe7-f46e61556e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.377153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59180cd-fdc4-4157-ab54-2f7ef50c2491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.378849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59180cd-fdc4-4157-ab54-2f7ef50c2491 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.379148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59180cd-fdc4-4157-ab54-2f7ef50c2491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.379429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59180cd-fdc4-4157-ab54-2f7ef50c2491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.380292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59180cd-fdc4-4157-ab54-2f7ef50c2491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.383448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59180cd-fdc4-4157-ab54-2f7ef50c2491 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.390544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f518d7-6b36-47df-8fe7-f46e61556e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.390852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f518d7-6b36-47df-8fe7-f46e61556e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.391131 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f518d7-6b36-47df-8fe7-f46e61556e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.391895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f518d7-6b36-47df-8fe7-f46e61556e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.393681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f518d7-6b36-47df-8fe7-f46e61556e90 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.404999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 953/1910] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:23.406359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59180cd-fdc4-4157-ab54-2f7ef50c2491 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.409200 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b59180cd-fdc4-4157-ab54-2f7ef50c2491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:23.416944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 958/1911] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:23.416944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f518d7-6b36-47df-8fe7-f46e61556e90 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.426480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f518d7-6b36-47df-8fe7-f46e61556e90 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.427899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59180cd-fdc4-4157-ab54-2f7ef50c2491 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.433249 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2ddf-8bef-4b50-96c3-45837136311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.433862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.434325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2ddf-8bef-4b50-96c3-45837136311e admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.434616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2ddf-8bef-4b50-96c3-45837136311e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.434899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2ddf-8bef-4b50-96c3-45837136311e admin admin] PATH_INFO: `/v3/projects/983c0807954a4f7ab1475eecb68d1d2f/users/ccc16b2666d64920805c112b91dc64a4/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.435201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.435592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.436052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] PATH_INFO: `/v3/projects/2ad3550d8a8b49d18bd6bce5f5381227` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.437072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f2ddf-8bef-4b50-96c3-45837136311e admin admin] RBAC: Authorizing `identity:create_grant(project_id=983c0807954a4f7ab1475eecb68d1d2f, user_id=ccc16b2666d64920805c112b91dc64a4, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.437470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad3550d8a8b49d18bd6bce5f5381227)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.439639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.440196 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f2ddf-8bef-4b50-96c3-45837136311e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.456178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 959/1912] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:23 2022] PUT /identity/v3/projects/983c0807954a4f7ab1475eecb68d1d2f/users/ccc16b2666d64920805c112b91dc64a4/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:23.459101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2ddf-8bef-4b50-96c3-45837136311e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.530046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2ddf-8bef-4b50-96c3-45837136311e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.534723 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bfa54-3bb6-44b6-b7b5-21b5c1aee66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.535642 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bfa54-3bb6-44b6-b7b5-21b5c1aee66e admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.535923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bfa54-3bb6-44b6-b7b5-21b5c1aee66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.536195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bfa54-3bb6-44b6-b7b5-21b5c1aee66e admin admin] PATH_INFO: `/v3/projects/7e02e8d2c0a2414d83de044ca281c209/users/d09dd8f28c624f48b3890deca19f2d72/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.551717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bfa54-3bb6-44b6-b7b5-21b5c1aee66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e02e8d2c0a2414d83de044ca281c209, user_id=d09dd8f28c624f48b3890deca19f2d72, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.555004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bfa54-3bb6-44b6-b7b5-21b5c1aee66e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.640874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 960/1913] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:23 2022] PUT /identity/v3/projects/7e02e8d2c0a2414d83de044ca281c209/users/d09dd8f28c624f48b3890deca19f2d72/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:23.642028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bfa54-3bb6-44b6-b7b5-21b5c1aee66e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.652023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad3550d8a8b49d18bd6bce5f5381227', 'request_id': 'req-f3c8137d-723a-45b7-9502-ce03094b97d0'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:23.705259 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bfa54-3bb6-44b6-b7b5-21b5c1aee66e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.718900 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad3550d8a8b49d18bd6bce5f5381227', 'request_id': 'req-f3c8137d-723a-45b7-9502-ce03094b97d0'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:23.728137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad3550d8a8b49d18bd6bce5f5381227', 'request_id': 'req-f3c8137d-723a-45b7-9502-ce03094b97d0'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:23.739794 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] The token cache is being invalidate because project 2ad3550d8a8b49d18bd6bce5f5381227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:23.740135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:23.741659 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f3c8137d-723a-45b7-9502-ce03094b97d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:23.746902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:23.747477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 954/1914] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:23 2022] DELETE /identity/v3/projects/2ad3550d8a8b49d18bd6bce5f5381227 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:23.751006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe05ec-d1f7-4ac8-a664-190e5abfd23c None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.751006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe05ec-d1f7-4ac8-a664-190e5abfd23c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.751006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe05ec-d1f7-4ac8-a664-190e5abfd23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.768709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e058e2c-2500-42d5-bd68-e8188dec445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.769624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058e2c-2500-42d5-bd68-e8188dec445e admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.769906 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058e2c-2500-42d5-bd68-e8188dec445e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.770181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058e2c-2500-42d5-bd68-e8188dec445e admin admin] PATH_INFO: `/v3/projects/8e7e0811179c4cef80c5cb669ddf3ee1/users/39a76f770663413d8c6e76ae435f15d2/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.772830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e058e2c-2500-42d5-bd68-e8188dec445e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7e0811179c4cef80c5cb669ddf3ee1, user_id=39a76f770663413d8c6e76ae435f15d2, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.775614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e058e2c-2500-42d5-bd68-e8188dec445e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.781002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-1bfe05ec-d1f7-4ac8-a664-190e5abfd23c None None] MFA Rules not processed for user `ccc16b2666d64920805c112b91dc64a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:23.785434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1bfe05ec-d1f7-4ac8-a664-190e5abfd23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:23.787344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 961/1915] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:23 2022] PUT /identity/v3/projects/8e7e0811179c4cef80c5cb669ddf3ee1/users/39a76f770663413d8c6e76ae435f15d2/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:23.788990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e058e2c-2500-42d5-bd68-e8188dec445e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.791716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-1e058e2c-2500-42d5-bd68-e8188dec445e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:23.857955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 955/1916] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:23.858962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe05ec-d1f7-4ac8-a664-190e5abfd23c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.862767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1bfe05ec-d1f7-4ac8-a664-190e5abfd23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:23.877403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e058e2c-2500-42d5-bd68-e8188dec445e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.878343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe05ec-d1f7-4ac8-a664-190e5abfd23c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:23.882205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fc94f-d312-43fc-9146-5d54664d9034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.882909 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fc94f-d312-43fc-9146-5d54664d9034 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.883195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fc94f-d312-43fc-9146-5d54664d9034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.883401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:23.883508 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fc94f-d312-43fc-9146-5d54664d9034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.884526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.884894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.885067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] PATH_INFO: `/v3/users/a76d62c8d9204640bdfe4f13677d69aa` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.885528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fc94f-d312-43fc-9146-5d54664d9034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.886494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76d62c8d9204640bdfe4f13677d69aa)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:23.887186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fc94f-d312-43fc-9146-5d54664d9034 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.888504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:23.898148 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 962/1917] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:23.899565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ec9d9-cd50-49be-9ce4-f989db6df407 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:23.899860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ec9d9-cd50-49be-9ce4-f989db6df407 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:23.900150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ec9d9-cd50-49be-9ce4-f989db6df407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:23.927212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-070ec9d9-cd50-49be-9ce4-f989db6df407 None None] MFA Rules not processed for user `39a76f770663413d8c6e76ae435f15d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:23.928525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-070ec9d9-cd50-49be-9ce4-f989db6df407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:23.996465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 963/1918] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:23.997385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ec9d9-cd50-49be-9ce4-f989db6df407 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:23.998698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-070ec9d9-cd50-49be-9ce4-f989db6df407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:24.007484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:24.056110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ec9d9-cd50-49be-9ce4-f989db6df407 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:24.059820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7b99-85d2-4dc4-a4e6-1d437336adc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:24.060450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7b99-85d2-4dc4-a4e6-1d437336adc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:24.060736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7b99-85d2-4dc4-a4e6-1d437336adc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:24.061015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7b99-85d2-4dc4-a4e6-1d437336adc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:24.069892 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d7b99-85d2-4dc4-a4e6-1d437336adc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:24.071380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d7b99-85d2-4dc4-a4e6-1d437336adc4 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:24.080837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 964/1919] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:24.081592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7b99-85d2-4dc4-a4e6-1d437336adc4 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:24.091763 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7b99-85d2-4dc4-a4e6-1d437336adc4 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:24.096285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379179ab-e97c-43ce-bdc8-d4c34939369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:24.097130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379179ab-e97c-43ce-bdc8-d4c34939369b admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:24.097412 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379179ab-e97c-43ce-bdc8-d4c34939369b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:24.097692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379179ab-e97c-43ce-bdc8-d4c34939369b admin admin] PATH_INFO: `/v3/projects/7e02e8d2c0a2414d83de044ca281c209/users/d09dd8f28c624f48b3890deca19f2d72/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:24.099648 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379179ab-e97c-43ce-bdc8-d4c34939369b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e02e8d2c0a2414d83de044ca281c209, user_id=d09dd8f28c624f48b3890deca19f2d72, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:24.102988 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379179ab-e97c-43ce-bdc8-d4c34939369b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:24.114765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 965/1920] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:24 2022] PUT /identity/v3/projects/7e02e8d2c0a2414d83de044ca281c209/users/d09dd8f28c624f48b3890deca19f2d72/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:24.115588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379179ab-e97c-43ce-bdc8-d4c34939369b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:24.117116 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-379179ab-e97c-43ce-bdc8-d4c34939369b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:24.118308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76d62c8d9204640bdfe4f13677d69aa'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:24.119085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76d62c8d9204640bdfe4f13677d69aa'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:24.131677 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76d62c8d9204640bdfe4f13677d69aa'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:24.180500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379179ab-e97c-43ce-bdc8-d4c34939369b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:24.184084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d241305-d81d-4828-af2b-21a9692e3636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:24.184722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d241305-d81d-4828-af2b-21a9692e3636 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:24.185001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d241305-d81d-4828-af2b-21a9692e3636 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:24.185271 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d241305-d81d-4828-af2b-21a9692e3636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:24.187107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9d241305-d81d-4828-af2b-21a9692e3636 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:24.249182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d241305-d81d-4828-af2b-21a9692e3636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:24.250961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d241305-d81d-4828-af2b-21a9692e3636 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:24.261523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 966/1921] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:24.262884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0bb0b-097e-40b2-988b-5dd73eb22f29 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:24.263179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0bb0b-097e-40b2-988b-5dd73eb22f29 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:24.263515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0bb0b-097e-40b2-988b-5dd73eb22f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:24.293495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-44c0bb0b-097e-40b2-988b-5dd73eb22f29 None None] MFA Rules not processed for user `d09dd8f28c624f48b3890deca19f2d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:24.294899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-44c0bb0b-097e-40b2-988b-5dd73eb22f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:24.303325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76d62c8d9204640bdfe4f13677d69aa'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:24.312549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76d62c8d9204640bdfe4f13677d69aa'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:24.320693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 956/1922] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:23 2022] DELETE /identity/v3/users/a76d62c8d9204640bdfe4f13677d69aa => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:24.397994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 967/1923] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:24.449773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:24.451580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:24.523455 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7540f3-520e-4fdd-b93b-0aaff3d928a9 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:24.527486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4342ece-a099-4da5-8d41-2395b0a0e35a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:24.528158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4342ece-a099-4da5-8d41-2395b0a0e35a service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:24.528442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4342ece-a099-4da5-8d41-2395b0a0e35a service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:24.528716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4342ece-a099-4da5-8d41-2395b0a0e35a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:24.640579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4342ece-a099-4da5-8d41-2395b0a0e35a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:24.642080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4342ece-a099-4da5-8d41-2395b0a0e35a service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:24.654459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 957/1924] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:24 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:24.967285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0bb0b-097e-40b2-988b-5dd73eb22f29 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:24.968953 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-44c0bb0b-097e-40b2-988b-5dd73eb22f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:25.059169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0bb0b-097e-40b2-988b-5dd73eb22f29 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:25.126818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:25.163118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:25.164026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:25.164308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:25.164581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] PATH_INFO: `/v3/projects/063eaccb394647d1bcaf0ba4eaf2c5f0` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:25.169794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=063eaccb394647d1bcaf0ba4eaf2c5f0)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:25.173168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:25.195839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4342ece-a099-4da5-8d41-2395b0a0e35a service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:25.209235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4342ece-a099-4da5-8d41-2395b0a0e35a service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:25.214029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e31141-7179-4062-bfd0-569be6c597ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:25.221418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31141-7179-4062-bfd0-569be6c597ba service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:25.221418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31141-7179-4062-bfd0-569be6c597ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:25.221418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31141-7179-4062-bfd0-569be6c597ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:25.221418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f8e31141-7179-4062-bfd0-569be6c597ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:25.286398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e31141-7179-4062-bfd0-569be6c597ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:25.288488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e31141-7179-4062-bfd0-569be6c597ba service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:25.297466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 958/1925] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:47:25.369674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063eaccb394647d1bcaf0ba4eaf2c5f0', 'request_id': 'req-5b6be6fc-770a-438a-aea9-4fcf57e30af7'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:25.463502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063eaccb394647d1bcaf0ba4eaf2c5f0', 'request_id': 'req-5b6be6fc-770a-438a-aea9-4fcf57e30af7'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:25.472039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063eaccb394647d1bcaf0ba4eaf2c5f0', 'request_id': 'req-5b6be6fc-770a-438a-aea9-4fcf57e30af7'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:25.486284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] The token cache is being invalidate because project 063eaccb394647d1bcaf0ba4eaf2c5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:25.486578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:25.487289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5b6be6fc-770a-438a-aea9-4fcf57e30af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:25.489254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 968/1926] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:24 2022] DELETE /identity/v3/projects/063eaccb394647d1bcaf0ba4eaf2c5f0 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:25.494855 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201b7c-2b00-46a4-afa0-edbcf57efab3 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:25.495358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201b7c-2b00-46a4-afa0-edbcf57efab3 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:25.502319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201b7c-2b00-46a4-afa0-edbcf57efab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:25.521600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-85201b7c-2b00-46a4-afa0-edbcf57efab3 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:25.526636 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-85201b7c-2b00-46a4-afa0-edbcf57efab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:25.620213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 959/1927] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:25.627462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298565f8-d26b-43be-9073-1036af2a31a1 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:25.628456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298565f8-d26b-43be-9073-1036af2a31a1 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:25.628969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298565f8-d26b-43be-9073-1036af2a31a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:25.648695 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-298565f8-d26b-43be-9073-1036af2a31a1 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:25.649897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-298565f8-d26b-43be-9073-1036af2a31a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:25.657848 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 969/1928] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:25.662228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85201b7c-2b00-46a4-afa0-edbcf57efab3 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:25.672639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85201b7c-2b00-46a4-afa0-edbcf57efab3 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:25.681144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61e1d6-6aa4-485c-8dd8-34908a019c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:25.681815 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61e1d6-6aa4-485c-8dd8-34908a019c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:25.682101 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61e1d6-6aa4-485c-8dd8-34908a019c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:25.682402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61e1d6-6aa4-485c-8dd8-34908a019c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:25.683137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61e1d6-6aa4-485c-8dd8-34908a019c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:25.683468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61e1d6-6aa4-485c-8dd8-34908a019c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:25.685554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61e1d6-6aa4-485c-8dd8-34908a019c29 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:25.702339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 960/1929] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:25.707660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298565f8-d26b-43be-9073-1036af2a31a1 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:25.718254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298565f8-d26b-43be-9073-1036af2a31a1 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:25.723071 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1875b10-3040-4d8a-ad51-0314b0e3f656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:25.723731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1875b10-3040-4d8a-ad51-0314b0e3f656 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:25.724008 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1875b10-3040-4d8a-ad51-0314b0e3f656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:25.724279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1875b10-3040-4d8a-ad51-0314b0e3f656 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:25.724990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1875b10-3040-4d8a-ad51-0314b0e3f656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:25.726927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1875b10-3040-4d8a-ad51-0314b0e3f656 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:25.814918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:25.817015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61e1d6-6aa4-485c-8dd8-34908a019c29 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:25.819292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9e61e1d6-6aa4-485c-8dd8-34908a019c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:25.825837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 970/1930] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:25 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:25.827830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1875b10-3040-4d8a-ad51-0314b0e3f656 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:25.832884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61e1d6-6aa4-485c-8dd8-34908a019c29 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:25.892514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c43dc7-dbd5-45eb-a74e-26a289a52903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:25.893496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c43dc7-dbd5-45eb-a74e-26a289a52903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:25.893784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c43dc7-dbd5-45eb-a74e-26a289a52903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:25.894107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c43dc7-dbd5-45eb-a74e-26a289a52903 admin admin] PATH_INFO: `/v3/users/fa6cd3b841cd43b58977405f13cad5c4` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:25.895411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c43dc7-dbd5-45eb-a74e-26a289a52903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6cd3b841cd43b58977405f13cad5c4)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:25.898200 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c43dc7-dbd5-45eb-a74e-26a289a52903 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:25.901069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1875b10-3040-4d8a-ad51-0314b0e3f656 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:25.907595 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f2d1-9bcc-492d-9897-88fe9ea34156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:25.908265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f2d1-9bcc-492d-9897-88fe9ea34156 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:25.908549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f2d1-9bcc-492d-9897-88fe9ea34156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:25.908825 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f2d1-9bcc-492d-9897-88fe9ea34156 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:25.909885 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5f2d1-9bcc-492d-9897-88fe9ea34156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:25.911911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5f2d1-9bcc-492d-9897-88fe9ea34156 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:25.994864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 971/1931] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:25 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:25.999064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f2d1-9bcc-492d-9897-88fe9ea34156 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:26.010498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f2d1-9bcc-492d-9897-88fe9ea34156 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:26.015596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b286-9c2d-459e-8967-6df761fdaa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:26.016268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b286-9c2d-459e-8967-6df761fdaa02 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:26.016556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b286-9c2d-459e-8967-6df761fdaa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:26.016846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b286-9c2d-459e-8967-6df761fdaa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:26.017569 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624b286-9c2d-459e-8967-6df761fdaa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:26.019634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624b286-9c2d-459e-8967-6df761fdaa02 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:26.030772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 972/1932] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:26.034498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b286-9c2d-459e-8967-6df761fdaa02 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:26.044978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b286-9c2d-459e-8967-6df761fdaa02 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:26.049623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170a89-db51-4986-ac57-be91b923c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:26.050307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170a89-db51-4986-ac57-be91b923c669 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:26.050611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170a89-db51-4986-ac57-be91b923c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:26.050887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170a89-db51-4986-ac57-be91b923c669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:26.051613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170a89-db51-4986-ac57-be91b923c669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:26.056374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170a89-db51-4986-ac57-be91b923c669 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:26.066524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 973/1933] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:26.070984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170a89-db51-4986-ac57-be91b923c669 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:26.081593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170a89-db51-4986-ac57-be91b923c669 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:26.086758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f9770-2b1d-4609-909e-f8d9cd960f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:26.091071 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f9770-2b1d-4609-909e-f8d9cd960f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:26.091071 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f9770-2b1d-4609-909e-f8d9cd960f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:26.091071 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f9770-2b1d-4609-909e-f8d9cd960f62 admin admin] PATH_INFO: `/v3/projects/abddcbdda6f54af9aff2137a87b6aa72/users/e6e95a264cbb4b9984cfea14382dbf0a/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:26.105413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f9770-2b1d-4609-909e-f8d9cd960f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abddcbdda6f54af9aff2137a87b6aa72, user_id=e6e95a264cbb4b9984cfea14382dbf0a, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:26.108455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f9770-2b1d-4609-909e-f8d9cd960f62 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:26.148252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d5c43dc7-dbd5-45eb-a74e-26a289a52903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6cd3b841cd43b58977405f13cad5c4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:26.149038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d5c43dc7-dbd5-45eb-a74e-26a289a52903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6cd3b841cd43b58977405f13cad5c4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:26.163638 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d5c43dc7-dbd5-45eb-a74e-26a289a52903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6cd3b841cd43b58977405f13cad5c4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:26.268333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d5c43dc7-dbd5-45eb-a74e-26a289a52903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6cd3b841cd43b58977405f13cad5c4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:26.288061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 974/1934] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:26 2022] PUT /identity/v3/projects/abddcbdda6f54af9aff2137a87b6aa72/users/e6e95a264cbb4b9984cfea14382dbf0a/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:26.291825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d5c43dc7-dbd5-45eb-a74e-26a289a52903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6cd3b841cd43b58977405f13cad5c4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:26.298483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8791fc-64ff-46ed-9208-307c32440164 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:26.298780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8791fc-64ff-46ed-9208-307c32440164 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:26.299059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8791fc-64ff-46ed-9208-307c32440164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:26.300513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 961/1935] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:25 2022] DELETE /identity/v3/users/fa6cd3b841cd43b58977405f13cad5c4 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:26.305863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56717d8-87f8-4963-b16d-00aa8e677019 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:26.306558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56717d8-87f8-4963-b16d-00aa8e677019 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:26.307249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56717d8-87f8-4963-b16d-00aa8e677019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:26.332190 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-e56717d8-87f8-4963-b16d-00aa8e677019 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:26.333598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e56717d8-87f8-4963-b16d-00aa8e677019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:26.387327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0e8791fc-64ff-46ed-9208-307c32440164 None None] MFA Rules not processed for user `e6e95a264cbb4b9984cfea14382dbf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:26.397787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0e8791fc-64ff-46ed-9208-307c32440164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:26.434089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 962/1936] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:26.452376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56717d8-87f8-4963-b16d-00aa8e677019 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:26.456351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e56717d8-87f8-4963-b16d-00aa8e677019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:26.524252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 975/1937] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:26.525812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8791fc-64ff-46ed-9208-307c32440164 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:26.529601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0e8791fc-64ff-46ed-9208-307c32440164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:26.597576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56717d8-87f8-4963-b16d-00aa8e677019 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:26.602616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dce27-12f4-43c4-b63f-418598857aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:26.603455 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dce27-12f4-43c4-b63f-418598857aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:26.603848 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dce27-12f4-43c4-b63f-418598857aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:26.604133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dce27-12f4-43c4-b63f-418598857aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:26.613962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dce27-12f4-43c4-b63f-418598857aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:26.616493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dce27-12f4-43c4-b63f-418598857aa1 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:26.620050 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8791fc-64ff-46ed-9208-307c32440164 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:26.624028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2fda9-f8d2-44fc-9be6-6f88fb270f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:26.624686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2fda9-f8d2-44fc-9be6-6f88fb270f2f service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:26.625056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2fda9-f8d2-44fc-9be6-6f88fb270f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:26.632330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2fda9-f8d2-44fc-9be6-6f88fb270f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:26.635940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 963/1938] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:26.635940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dce27-12f4-43c4-b63f-418598857aa1 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:26.635940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e82dce27-12f4-43c4-b63f-418598857aa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:26.644103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-edb2fda9-f8d2-44fc-9be6-6f88fb270f2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:26.649526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dce27-12f4-43c4-b63f-418598857aa1 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:26.657384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b6c1-1905-40d9-984e-5dc1f58ca997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:26.661319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b6c1-1905-40d9-984e-5dc1f58ca997 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:26.661319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b6c1-1905-40d9-984e-5dc1f58ca997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:26.661319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b6c1-1905-40d9-984e-5dc1f58ca997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:26.661319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b6c1-1905-40d9-984e-5dc1f58ca997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:26.664720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b6c1-1905-40d9-984e-5dc1f58ca997 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:26.755221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 964/1939] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:26 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:26.759501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b6c1-1905-40d9-984e-5dc1f58ca997 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:26.776024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2fda9-f8d2-44fc-9be6-6f88fb270f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:26.777832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2fda9-f8d2-44fc-9be6-6f88fb270f2f service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:26.801513 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 976/1940] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:26.872875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b6c1-1905-40d9-984e-5dc1f58ca997 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:26.883709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796d1b9-efc4-4b05-b679-246455e73720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:26.884397 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796d1b9-efc4-4b05-b679-246455e73720 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:26.884677 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796d1b9-efc4-4b05-b679-246455e73720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:26.884997 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796d1b9-efc4-4b05-b679-246455e73720 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:26.885747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796d1b9-efc4-4b05-b679-246455e73720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:26.887724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796d1b9-efc4-4b05-b679-246455e73720 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:26.989308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 965/1941] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:26 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:26.993271 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2fda9-f8d2-44fc-9be6-6f88fb270f2f service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:27.009410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2fda9-f8d2-44fc-9be6-6f88fb270f2f service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:27.017120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e83679-2d51-4f4d-8571-18bf4e2eaa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:27.018330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e83679-2d51-4f4d-8571-18bf4e2eaa0a admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:27.018896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e83679-2d51-4f4d-8571-18bf4e2eaa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:27.019378 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e83679-2d51-4f4d-8571-18bf4e2eaa0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:27.020371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e83679-2d51-4f4d-8571-18bf4e2eaa0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:27.024112 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e83679-2d51-4f4d-8571-18bf4e2eaa0a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:27.041666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 977/1942] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:27.045812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796d1b9-efc4-4b05-b679-246455e73720 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:27.059208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796d1b9-efc4-4b05-b679-246455e73720 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:27.068168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace013a3-386f-4795-af70-c5a3a0a9f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:27.069149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace013a3-386f-4795-af70-c5a3a0a9f4be admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:27.069462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace013a3-386f-4795-af70-c5a3a0a9f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:27.069710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace013a3-386f-4795-af70-c5a3a0a9f4be admin admin] PATH_INFO: `/v3/projects/85c2c34d12fd43608f9378caab42f0bc/users/44ca59d0ca9f404d8ae221b2eb74a75e/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:27.099710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace013a3-386f-4795-af70-c5a3a0a9f4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c2c34d12fd43608f9378caab42f0bc, user_id=44ca59d0ca9f404d8ae221b2eb74a75e, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:27.103930 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace013a3-386f-4795-af70-c5a3a0a9f4be admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:27.204995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 966/1943] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:27 2022] PUT /identity/v3/projects/85c2c34d12fd43608f9378caab42f0bc/users/44ca59d0ca9f404d8ae221b2eb74a75e/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:27.206385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e83679-2d51-4f4d-8571-18bf4e2eaa0a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:27.218482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e83679-2d51-4f4d-8571-18bf4e2eaa0a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:27.281154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17564d-6fd1-4065-a8a1-bd299ead14f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:27.281834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17564d-6fd1-4065-a8a1-bd299ead14f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:27.282123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17564d-6fd1-4065-a8a1-bd299ead14f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:27.282459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17564d-6fd1-4065-a8a1-bd299ead14f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:27.283200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17564d-6fd1-4065-a8a1-bd299ead14f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:27.286740 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17564d-6fd1-4065-a8a1-bd299ead14f0 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:27.297952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 978/1944] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:27.302321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace013a3-386f-4795-af70-c5a3a0a9f4be admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:27.313349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace013a3-386f-4795-af70-c5a3a0a9f4be admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:27.326609 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d818e6-18d8-48a4-b2e2-e522689e6eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:27.327397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17564d-6fd1-4065-a8a1-bd299ead14f0 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:27.327538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d818e6-18d8-48a4-b2e2-e522689e6eee admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:27.327796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d818e6-18d8-48a4-b2e2-e522689e6eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:27.328079 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d818e6-18d8-48a4-b2e2-e522689e6eee admin admin] PATH_INFO: `/v3/projects/85c2c34d12fd43608f9378caab42f0bc/users/44ca59d0ca9f404d8ae221b2eb74a75e/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:27.329957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8c17564d-6fd1-4065-a8a1-bd299ead14f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:27.330088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d818e6-18d8-48a4-b2e2-e522689e6eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c2c34d12fd43608f9378caab42f0bc, user_id=44ca59d0ca9f404d8ae221b2eb74a75e, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:27.332820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d818e6-18d8-48a4-b2e2-e522689e6eee admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:27.352729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 967/1945] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:27 2022] PUT /identity/v3/projects/85c2c34d12fd43608f9378caab42f0bc/users/44ca59d0ca9f404d8ae221b2eb74a75e/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:27.360163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17564d-6fd1-4065-a8a1-bd299ead14f0 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:27.365620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842325-8806-4c69-a1cb-3d2c290e62a5 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:27.367354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842325-8806-4c69-a1cb-3d2c290e62a5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:27.367354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842325-8806-4c69-a1cb-3d2c290e62a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:27.403711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-59842325-8806-4c69-a1cb-3d2c290e62a5 None None] MFA Rules not processed for user `44ca59d0ca9f404d8ae221b2eb74a75e`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:27.404982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-59842325-8806-4c69-a1cb-3d2c290e62a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:27.457909 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:27.458832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:27.459167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:27.459968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] PATH_INFO: `/v3/projects/bc333cfc05ca4ac388a4790fda22d362` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:27.462009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc333cfc05ca4ac388a4790fda22d362)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:27.464407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:27.485911 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 968/1946] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:27.497943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:27.625194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc333cfc05ca4ac388a4790fda22d362', 'request_id': 'req-632584b3-4014-4cb1-8eab-1ade69a15fbf'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:27.715384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc333cfc05ca4ac388a4790fda22d362', 'request_id': 'req-632584b3-4014-4cb1-8eab-1ade69a15fbf'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:27.728459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc333cfc05ca4ac388a4790fda22d362', 'request_id': 'req-632584b3-4014-4cb1-8eab-1ade69a15fbf'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:27.742891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59842325-8806-4c69-a1cb-3d2c290e62a5 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:27.745027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-59842325-8806-4c69-a1cb-3d2c290e62a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:27.745131 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] The token cache is being invalidate because project bc333cfc05ca4ac388a4790fda22d362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:27.745537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:27.746362 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:27.756781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 979/1947] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:27 2022] DELETE /identity/v3/projects/bc333cfc05ca4ac388a4790fda22d362 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:27.758558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:27.760292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:27.853861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59842325-8806-4c69-a1cb-3d2c290e62a5 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:27.860661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632584b3-4014-4cb1-8eab-1ade69a15fbf admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:27.866307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:27.868369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:27.868605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:27.868888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] PATH_INFO: `/v3/users/ccc16b2666d64920805c112b91dc64a4` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:27.870553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc16b2666d64920805c112b91dc64a4)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:27.872497 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:27.915095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:27.917515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da9278-eab7-4f8e-bad8-a89a1f271a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:27.918176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da9278-eab7-4f8e-bad8-a89a1f271a27 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:27.918574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da9278-eab7-4f8e-bad8-a89a1f271a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:27.918855 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da9278-eab7-4f8e-bad8-a89a1f271a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:27.920639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e1da9278-eab7-4f8e-bad8-a89a1f271a27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:27.989559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da9278-eab7-4f8e-bad8-a89a1f271a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:27.991798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da9278-eab7-4f8e-bad8-a89a1f271a27 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:28.003965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 969/1948] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:28.108550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc16b2666d64920805c112b91dc64a4'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:28.109352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc16b2666d64920805c112b91dc64a4'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:28.206043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc16b2666d64920805c112b91dc64a4'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:28.223550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc16b2666d64920805c112b91dc64a4'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:28.234304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc16b2666d64920805c112b91dc64a4'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:28.241340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 980/1949] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:27 2022] DELETE /identity/v3/users/ccc16b2666d64920805c112b91dc64a4 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:28.350559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da9278-eab7-4f8e-bad8-a89a1f271a27 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:28.352315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e1da9278-eab7-4f8e-bad8-a89a1f271a27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:28.372675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da9278-eab7-4f8e-bad8-a89a1f271a27 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:28.437583 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc1118-7329-47f3-8e89-b3dc650c1877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:28.439341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc1118-7329-47f3-8e89-b3dc650c1877 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:28.439784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc1118-7329-47f3-8e89-b3dc650c1877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:28.440203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc1118-7329-47f3-8e89-b3dc650c1877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:28.443551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-84fc1118-7329-47f3-8e89-b3dc650c1877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:28.539291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc1118-7329-47f3-8e89-b3dc650c1877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:28.540931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc1118-7329-47f3-8e89-b3dc650c1877 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:28.553868 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 970/1950] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:28.728185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:28.729813 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:28.814047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208637c-582d-44e7-abcb-bfa60e4c6541 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:28.819505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:28.820514 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:28.820796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:28.821067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] PATH_INFO: `/v3/projects/983c0807954a4f7ab1475eecb68d1d2f` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:28.822868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=983c0807954a4f7ab1475eecb68d1d2f)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:28.824911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:29.000884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983c0807954a4f7ab1475eecb68d1d2f', 'request_id': 'req-e59e96bd-7676-4c5b-af16-09146ed2ec01'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:29.119030 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983c0807954a4f7ab1475eecb68d1d2f', 'request_id': 'req-e59e96bd-7676-4c5b-af16-09146ed2ec01'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:29.132890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983c0807954a4f7ab1475eecb68d1d2f', 'request_id': 'req-e59e96bd-7676-4c5b-af16-09146ed2ec01'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:29.151253 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] The token cache is being invalidate because project 983c0807954a4f7ab1475eecb68d1d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:29.151600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:29.152792 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e59e96bd-7676-4c5b-af16-09146ed2ec01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:29.155679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 981/1951] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:28 2022] DELETE /identity/v3/projects/983c0807954a4f7ab1475eecb68d1d2f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:29.161100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c9a1e-760d-468d-b60d-ff86714c9714 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:29.161397 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c9a1e-760d-468d-b60d-ff86714c9714 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:29.161764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c9a1e-760d-468d-b60d-ff86714c9714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:29.182368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-f86c9a1e-760d-468d-b60d-ff86714c9714 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:29.183369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f86c9a1e-760d-468d-b60d-ff86714c9714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:29.252474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 971/1952] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:29.254200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945186c3-e867-4378-ac3b-20ef1d1ecd56 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:29.254530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945186c3-e867-4378-ac3b-20ef1d1ecd56 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:29.254811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945186c3-e867-4378-ac3b-20ef1d1ecd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:29.275103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-945186c3-e867-4378-ac3b-20ef1d1ecd56 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:29.276471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-945186c3-e867-4378-ac3b-20ef1d1ecd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:29.306265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 982/1953] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:29.310137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c9a1e-760d-468d-b60d-ff86714c9714 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:29.320854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c9a1e-760d-468d-b60d-ff86714c9714 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:29.326561 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0545ed4-e568-4b62-80fa-9ca2e175125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:29.327231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0545ed4-e568-4b62-80fa-9ca2e175125b admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:29.327537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0545ed4-e568-4b62-80fa-9ca2e175125b admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:29.327839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0545ed4-e568-4b62-80fa-9ca2e175125b admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:29.328532 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0545ed4-e568-4b62-80fa-9ca2e175125b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:29.328834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0545ed4-e568-4b62-80fa-9ca2e175125b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:29.330475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0545ed4-e568-4b62-80fa-9ca2e175125b admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:29.343490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 972/1954] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:29.347732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945186c3-e867-4378-ac3b-20ef1d1ecd56 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:29.357842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945186c3-e867-4378-ac3b-20ef1d1ecd56 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:29.362663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0053-0c0e-48a5-89ee-49413323f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:29.363332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0053-0c0e-48a5-89ee-49413323f280 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:29.363615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0053-0c0e-48a5-89ee-49413323f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:29.363894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0053-0c0e-48a5-89ee-49413323f280 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:29.364628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0053-0c0e-48a5-89ee-49413323f280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:29.366709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0053-0c0e-48a5-89ee-49413323f280 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:29.494290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 983/1955] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:29 2022] POST /identity/v3/projects => generated 357 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:29.497139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0545ed4-e568-4b62-80fa-9ca2e175125b admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:29.507563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0545ed4-e568-4b62-80fa-9ca2e175125b admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:29.571276 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9f9fb-77da-461f-a27a-7f1870ef25f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:29.572729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9f9fb-77da-461f-a27a-7f1870ef25f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:29.574032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:DELETE=14,keystone:SELECT=81,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:29.574564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9f9fb-77da-461f-a27a-7f1870ef25f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:29.574944 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9f9fb-77da-461f-a27a-7f1870ef25f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:29.575750 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9f9fb-77da-461f-a27a-7f1870ef25f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:29.578014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9f9fb-77da-461f-a27a-7f1870ef25f2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:29.675556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 973/1956] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:29 2022] POST /identity/v3/users => generated 279 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:29.689913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0053-0c0e-48a5-89ee-49413323f280 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:29.701942 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0053-0c0e-48a5-89ee-49413323f280 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:29.706714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9022cb-60c7-487c-87b2-e8cc53780eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:29.707496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9022cb-60c7-487c-87b2-e8cc53780eff admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:29.707854 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9022cb-60c7-487c-87b2-e8cc53780eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:29.708242 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9022cb-60c7-487c-87b2-e8cc53780eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:29.709706 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9022cb-60c7-487c-87b2-e8cc53780eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:29.711452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9022cb-60c7-487c-87b2-e8cc53780eff admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:29.722822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 984/1957] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:29.734330 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9f9fb-77da-461f-a27a-7f1870ef25f2 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:29.750630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9f9fb-77da-461f-a27a-7f1870ef25f2 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:29.755586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1248a-b4c6-43b1-9f0c-294bbe7c90bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:29.756941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1248a-b4c6-43b1-9f0c-294bbe7c90bf admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:29.757236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1248a-b4c6-43b1-9f0c-294bbe7c90bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:29.757515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1248a-b4c6-43b1-9f0c-294bbe7c90bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:29.758259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1248a-b4c6-43b1-9f0c-294bbe7c90bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:29.760001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1248a-b4c6-43b1-9f0c-294bbe7c90bf admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:29.770132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9022cb-60c7-487c-87b2-e8cc53780eff admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:29.772543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-bc9022cb-60c7-487c-87b2-e8cc53780eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:29.777326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 974/1958] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:29.782610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1248a-b4c6-43b1-9f0c-294bbe7c90bf admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:29.789153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1248a-b4c6-43b1-9f0c-294bbe7c90bf admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:29.794231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d1c89-5c31-4e08-a687-56fbcba97a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:29.795254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d1c89-5c31-4e08-a687-56fbcba97a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:29.795611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d1c89-5c31-4e08-a687-56fbcba97a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:29.795967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d1c89-5c31-4e08-a687-56fbcba97a53 admin admin] PATH_INFO: `/v3/projects/f09bec99b2ad4b6ca59f4ffaa2417595/users/f14c83df07ca4e84a2323ba5948d5bf6/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:29.812967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d1c89-5c31-4e08-a687-56fbcba97a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09bec99b2ad4b6ca59f4ffaa2417595, user_id=f14c83df07ca4e84a2323ba5948d5bf6, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:29.817122 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d1c89-5c31-4e08-a687-56fbcba97a53 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:29.834167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9022cb-60c7-487c-87b2-e8cc53780eff admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:29.837823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154142d1-f0fe-4bd5-bda9-c35b5d4b148f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:29.838526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154142d1-f0fe-4bd5-bda9-c35b5d4b148f service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:29.838812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154142d1-f0fe-4bd5-bda9-c35b5d4b148f service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:29.839106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154142d1-f0fe-4bd5-bda9-c35b5d4b148f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:29.840951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-154142d1-f0fe-4bd5-bda9-c35b5d4b148f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:29.885406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 975/1959] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:29 2022] PUT /identity/v3/projects/f09bec99b2ad4b6ca59f4ffaa2417595/users/f14c83df07ca4e84a2323ba5948d5bf6/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:29.895657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb102e-0339-4389-b06d-fc60ca1e9bff None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:29.895954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb102e-0339-4389-b06d-fc60ca1e9bff None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:29.896232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb102e-0339-4389-b06d-fc60ca1e9bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:29.906514 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154142d1-f0fe-4bd5-bda9-c35b5d4b148f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:29.907948 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154142d1-f0fe-4bd5-bda9-c35b5d4b148f service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:29.918878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 985/1960] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:29.924360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-cfdb102e-0339-4389-b06d-fc60ca1e9bff None None] MFA Rules not processed for user `f14c83df07ca4e84a2323ba5948d5bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:29.925304 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-cfdb102e-0339-4389-b06d-fc60ca1e9bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:29.992225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 976/1961] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:29 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:29.996724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154142d1-f0fe-4bd5-bda9-c35b5d4b148f service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:30.007760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154142d1-f0fe-4bd5-bda9-c35b5d4b148f service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:30.036269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:30.067852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d72ca-5e0b-44db-9205-9103121214e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:30.069155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d72ca-5e0b-44db-9205-9103121214e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:30.069442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d72ca-5e0b-44db-9205-9103121214e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:30.069719 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d72ca-5e0b-44db-9205-9103121214e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:30.070458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d72ca-5e0b-44db-9205-9103121214e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:30.072638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d72ca-5e0b-44db-9205-9103121214e2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:30.188541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 986/1962] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:29 2022] POST /identity/v3/projects => generated 357 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:30.192955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb102e-0339-4389-b06d-fc60ca1e9bff None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:30.204412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb102e-0339-4389-b06d-fc60ca1e9bff None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:30.264779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c76ceb-053d-437a-b923-f87811ed248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:30.265513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c76ceb-053d-437a-b923-f87811ed248d admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:30.265792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c76ceb-053d-437a-b923-f87811ed248d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:30.266232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c76ceb-053d-437a-b923-f87811ed248d admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:30.266982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c76ceb-053d-437a-b923-f87811ed248d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:30.268918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c76ceb-053d-437a-b923-f87811ed248d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:30.368393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 977/1963] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:30 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:30.372069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d72ca-5e0b-44db-9205-9103121214e2 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:30.388027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d72ca-5e0b-44db-9205-9103121214e2 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:30.410334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9cf06-2d7e-4f9d-9f95-3b4f8292f028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:30.410334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9cf06-2d7e-4f9d-9f95-3b4f8292f028 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:30.410334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9cf06-2d7e-4f9d-9f95-3b4f8292f028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:30.410334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9cf06-2d7e-4f9d-9f95-3b4f8292f028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:30.410834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9cf06-2d7e-4f9d-9f95-3b4f8292f028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:30.410834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9cf06-2d7e-4f9d-9f95-3b4f8292f028 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:30.431428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 987/1964] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:30.432600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c76ceb-053d-437a-b923-f87811ed248d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:30.448077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c76ceb-053d-437a-b923-f87811ed248d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:30.451169 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72a1dd-0265-404e-85b1-95b3a6713296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:30.452281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72a1dd-0265-404e-85b1-95b3a6713296 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:30.452562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72a1dd-0265-404e-85b1-95b3a6713296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:30.452836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72a1dd-0265-404e-85b1-95b3a6713296 admin admin] PATH_INFO: `/v3/projects/b313fc2228174e5eb63e42c1593885a1/users/e10e961f4ea9444a9a00718223266320/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:30.480073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72a1dd-0265-404e-85b1-95b3a6713296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b313fc2228174e5eb63e42c1593885a1, user_id=e10e961f4ea9444a9a00718223266320, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:30.482893 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72a1dd-0265-404e-85b1-95b3a6713296 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:30.566338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 978/1965] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:30 2022] PUT /identity/v3/projects/b313fc2228174e5eb63e42c1593885a1/users/e10e961f4ea9444a9a00718223266320/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:30.570206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9cf06-2d7e-4f9d-9f95-3b4f8292f028 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:30.580539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9cf06-2d7e-4f9d-9f95-3b4f8292f028 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:30.635301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89c2ef-9d79-4010-b98e-81eb3cb560e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:30.635982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89c2ef-9d79-4010-b98e-81eb3cb560e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:30.636263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89c2ef-9d79-4010-b98e-81eb3cb560e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:30.636534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89c2ef-9d79-4010-b98e-81eb3cb560e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:30.637258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89c2ef-9d79-4010-b98e-81eb3cb560e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:30.638915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89c2ef-9d79-4010-b98e-81eb3cb560e8 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:30.649080 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 988/1966] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:30.653150 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72a1dd-0265-404e-85b1-95b3a6713296 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:30.664020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72a1dd-0265-404e-85b1-95b3a6713296 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:30.668853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd84a5-f197-4fd9-8a67-7b99a26ab110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:30.669836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd84a5-f197-4fd9-8a67-7b99a26ab110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:30.670217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd84a5-f197-4fd9-8a67-7b99a26ab110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:30.670584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd84a5-f197-4fd9-8a67-7b99a26ab110 admin admin] PATH_INFO: `/v3/projects/b313fc2228174e5eb63e42c1593885a1/users/e10e961f4ea9444a9a00718223266320/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:30.672649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd84a5-f197-4fd9-8a67-7b99a26ab110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b313fc2228174e5eb63e42c1593885a1, user_id=e10e961f4ea9444a9a00718223266320, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:30.675485 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd84a5-f197-4fd9-8a67-7b99a26ab110 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:30.686524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 979/1967] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:30 2022] PUT /identity/v3/projects/b313fc2228174e5eb63e42c1593885a1/users/e10e961f4ea9444a9a00718223266320/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:30.697536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145cdd9-e159-4aba-962e-1273024a2423 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:30.697824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145cdd9-e159-4aba-962e-1273024a2423 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:30.698123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145cdd9-e159-4aba-962e-1273024a2423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:30.725693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-2145cdd9-e159-4aba-962e-1273024a2423 None None] MFA Rules not processed for user `e10e961f4ea9444a9a00718223266320`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:30.726918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2145cdd9-e159-4aba-962e-1273024a2423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:30.794185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 989/1968] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:30 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:30.807603 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd84a5-f197-4fd9-8a67-7b99a26ab110 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:30.863743 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd84a5-f197-4fd9-8a67-7b99a26ab110 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:30.867616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4236c-643c-46dc-8ea0-a5a2ef40f114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:30.868277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4236c-643c-46dc-8ea0-a5a2ef40f114 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:30.868564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4236c-643c-46dc-8ea0-a5a2ef40f114 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:30.868842 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4236c-643c-46dc-8ea0-a5a2ef40f114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:30.881216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4236c-643c-46dc-8ea0-a5a2ef40f114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:30.888732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4236c-643c-46dc-8ea0-a5a2ef40f114 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:30.892607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 980/1969] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:30 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:31.114447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:31.122732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145cdd9-e159-4aba-962e-1273024a2423 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:31.132929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145cdd9-e159-4aba-962e-1273024a2423 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:31.136580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9bc53-0977-4bae-b17d-c90c0e5691fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:31.137532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9bc53-0977-4bae-b17d-c90c0e5691fb service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:31.137532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9bc53-0977-4bae-b17d-c90c0e5691fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:31.137846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9bc53-0977-4bae-b17d-c90c0e5691fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:31.154724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:31.201934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9bc53-0977-4bae-b17d-c90c0e5691fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:31.203538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9bc53-0977-4bae-b17d-c90c0e5691fb service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:31.214563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 990/1970] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:31 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:32.358665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:32.387274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:33.205962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:33.772014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:33.926827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:34.534350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:34.724092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:36.128930 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:36.194704 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:36.351596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4236c-643c-46dc-8ea0-a5a2ef40f114 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:36.353545 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-97b4236c-643c-46dc-8ea0-a5a2ef40f114 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:36.405568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9bc53-0977-4bae-b17d-c90c0e5691fb service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:36.407370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ebe9bc53-0977-4bae-b17d-c90c0e5691fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:36.440778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4236c-643c-46dc-8ea0-a5a2ef40f114 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:36.447826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f242bc9-34f2-4795-b227-ab7b806aa328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:36.449097 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f242bc9-34f2-4795-b227-ab7b806aa328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:36.449511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f242bc9-34f2-4795-b227-ab7b806aa328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:36.449934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f242bc9-34f2-4795-b227-ab7b806aa328 admin admin] PATH_INFO: `/v3/users/64822376d66744dfa54bc8b1821a1363` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:36.451358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f242bc9-34f2-4795-b227-ab7b806aa328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64822376d66744dfa54bc8b1821a1363)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:36.453708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f242bc9-34f2-4795-b227-ab7b806aa328 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:36.506027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9bc53-0977-4bae-b17d-c90c0e5691fb service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:36.511724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754880b-9666-4211-98f9-fb31c5be8b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:36.512976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754880b-9666-4211-98f9-fb31c5be8b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:36.513337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754880b-9666-4211-98f9-fb31c5be8b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:36.513721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754880b-9666-4211-98f9-fb31c5be8b09 admin admin] PATH_INFO: `/v3/users/01e911c5ee604cd19dc2f56646938071` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:36.515109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754880b-9666-4211-98f9-fb31c5be8b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e911c5ee604cd19dc2f56646938071)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:36.517262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754880b-9666-4211-98f9-fb31c5be8b09 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:36.694188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-1f242bc9-34f2-4795-b227-ab7b806aa328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64822376d66744dfa54bc8b1821a1363'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:36.696209 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-1f242bc9-34f2-4795-b227-ab7b806aa328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64822376d66744dfa54bc8b1821a1363'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:36.727190 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-1f242bc9-34f2-4795-b227-ab7b806aa328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64822376d66744dfa54bc8b1821a1363'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:36.790425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7754880b-9666-4211-98f9-fb31c5be8b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e911c5ee604cd19dc2f56646938071'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:36.791271 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7754880b-9666-4211-98f9-fb31c5be8b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e911c5ee604cd19dc2f56646938071'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:36.855805 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-1f242bc9-34f2-4795-b227-ab7b806aa328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64822376d66744dfa54bc8b1821a1363'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:36.869053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-1f242bc9-34f2-4795-b227-ab7b806aa328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64822376d66744dfa54bc8b1821a1363'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:36.876860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 981/1971] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:36 2022] DELETE /identity/v3/users/64822376d66744dfa54bc8b1821a1363 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:36.881601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6635e0-ccb2-477f-8f81-f424f09e23f2 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:36.882517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6635e0-ccb2-477f-8f81-f424f09e23f2 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:36.882932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6635e0-ccb2-477f-8f81-f424f09e23f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:36.903588 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-fc6635e0-ccb2-477f-8f81-f424f09e23f2 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:36.904807 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-fc6635e0-ccb2-477f-8f81-f424f09e23f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:36.919072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7754880b-9666-4211-98f9-fb31c5be8b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e911c5ee604cd19dc2f56646938071'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:36.932434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7754880b-9666-4211-98f9-fb31c5be8b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e911c5ee604cd19dc2f56646938071'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:36.939849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7754880b-9666-4211-98f9-fb31c5be8b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e911c5ee604cd19dc2f56646938071'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:36.946881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 991/1972] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:36 2022] DELETE /identity/v3/users/01e911c5ee604cd19dc2f56646938071 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:36.951456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5762d5-e867-4d6a-9a80-371f31a5d977 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:36.951823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5762d5-e867-4d6a-9a80-371f31a5d977 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:36.952293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5762d5-e867-4d6a-9a80-371f31a5d977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:36.970484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-6f5762d5-e867-4d6a-9a80-371f31a5d977 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:36.971874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6f5762d5-e867-4d6a-9a80-371f31a5d977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:36.979009 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 982/1973] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:36.987306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6635e0-ccb2-477f-8f81-f424f09e23f2 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:36.988933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-fc6635e0-ccb2-477f-8f81-f424f09e23f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:37.062721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6635e0-ccb2-477f-8f81-f424f09e23f2 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:37.068023 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 992/1974] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:37.076434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5762d5-e867-4d6a-9a80-371f31a5d977 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:37.109857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:37.171631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5762d5-e867-4d6a-9a80-371f31a5d977 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:37.176205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41c9cf-c318-47ef-806d-bd0a1e56b7ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:37.177262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41c9cf-c318-47ef-806d-bd0a1e56b7ae service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:37.177721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41c9cf-c318-47ef-806d-bd0a1e56b7ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:37.177862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41c9cf-c318-47ef-806d-bd0a1e56b7ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:37.191593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41c9cf-c318-47ef-806d-bd0a1e56b7ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:37.201744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41c9cf-c318-47ef-806d-bd0a1e56b7ae service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:37.202375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2272f4-dab1-4271-8e06-9477cce0fc6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:37.202375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2272f4-dab1-4271-8e06-9477cce0fc6f service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:37.202375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2272f4-dab1-4271-8e06-9477cce0fc6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:37.202375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2272f4-dab1-4271-8e06-9477cce0fc6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:37.209625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 993/1975] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:47:37.238910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2272f4-dab1-4271-8e06-9477cce0fc6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:37.240395 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2272f4-dab1-4271-8e06-9477cce0fc6f service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:37.266542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 983/1976] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:37.313783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:37.873449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41c9cf-c318-47ef-806d-bd0a1e56b7ae service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:37.876509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ed41c9cf-c318-47ef-806d-bd0a1e56b7ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:37.908544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:37.924630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41c9cf-c318-47ef-806d-bd0a1e56b7ae service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:37.943867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:37.943867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:37.943867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:37.943867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] PATH_INFO: `/v3/projects/466b1f7a5d3e488ca2d08b2f432a4486` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:37.947368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=466b1f7a5d3e488ca2d08b2f432a4486)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:37.949353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:38.120099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '466b1f7a5d3e488ca2d08b2f432a4486', 'request_id': 'req-2ac44002-7994-418a-b98a-540e42cb36aa'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.221755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '466b1f7a5d3e488ca2d08b2f432a4486', 'request_id': 'req-2ac44002-7994-418a-b98a-540e42cb36aa'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.230949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '466b1f7a5d3e488ca2d08b2f432a4486', 'request_id': 'req-2ac44002-7994-418a-b98a-540e42cb36aa'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.244216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] The token cache is being invalidate because project 466b1f7a5d3e488ca2d08b2f432a4486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:38.244729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.245395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.246989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 994/1977] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:37 2022] DELETE /identity/v3/projects/466b1f7a5d3e488ca2d08b2f432a4486 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:38.251118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2272f4-dab1-4271-8e06-9477cce0fc6f service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:38.261260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2272f4-dab1-4271-8e06-9477cce0fc6f service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:38.295600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:38.296991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:38.335877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:38.340399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:38.340399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:38.340399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] PATH_INFO: `/v3/users/d09dd8f28c624f48b3890deca19f2d72` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:38.341367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09dd8f28c624f48b3890deca19f2d72)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:38.357650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:38.411495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44002-7994-418a-b98a-540e42cb36aa admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:38.417896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6912f7-893c-4df6-a2f3-465b674978ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:38.418838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6912f7-893c-4df6-a2f3-465b674978ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:38.421708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6912f7-893c-4df6-a2f3-465b674978ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:38.421708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6912f7-893c-4df6-a2f3-465b674978ad admin admin] PATH_INFO: `/v3/users/e6e95a264cbb4b9984cfea14382dbf0a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:38.421708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6912f7-893c-4df6-a2f3-465b674978ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e95a264cbb4b9984cfea14382dbf0a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:38.422689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6912f7-893c-4df6-a2f3-465b674978ad admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:38.533732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09dd8f28c624f48b3890deca19f2d72'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.534535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09dd8f28c624f48b3890deca19f2d72'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.551261 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09dd8f28c624f48b3890deca19f2d72'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.587947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2a6912f7-893c-4df6-a2f3-465b674978ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e95a264cbb4b9984cfea14382dbf0a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.588643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2a6912f7-893c-4df6-a2f3-465b674978ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e95a264cbb4b9984cfea14382dbf0a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.594749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:38.650228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09dd8f28c624f48b3890deca19f2d72'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.657523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09dd8f28c624f48b3890deca19f2d72'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.663771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 984/1978] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:38 2022] DELETE /identity/v3/users/d09dd8f28c624f48b3890deca19f2d72 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:38.664562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:38.666035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:38.707588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:38.732814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b1bea-09ea-49e8-8364-719ad781f8a4 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:38.739031 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:38.739249 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2a6912f7-893c-4df6-a2f3-465b674978ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e95a264cbb4b9984cfea14382dbf0a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.740502 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:38.740790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:38.741611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] PATH_INFO: `/v3/projects/a4559c4725414042845abf493c072f25` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:38.743068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4559c4725414042845abf493c072f25)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:38.745470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:38.759115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2a6912f7-893c-4df6-a2f3-465b674978ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e95a264cbb4b9984cfea14382dbf0a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.774891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2a6912f7-893c-4df6-a2f3-465b674978ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e95a264cbb4b9984cfea14382dbf0a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.781542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 995/1979] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:38 2022] DELETE /identity/v3/users/e6e95a264cbb4b9984cfea14382dbf0a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:38.786183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2506-0bfd-4448-b0c4-51270df136eb None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:38.786566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2506-0bfd-4448-b0c4-51270df136eb None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:38.786844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2506-0bfd-4448-b0c4-51270df136eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:38.803460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-f5bb2506-0bfd-4448-b0c4-51270df136eb None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:38.805186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f5bb2506-0bfd-4448-b0c4-51270df136eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:38.865109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 996/1980] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:38.874848 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4559c4725414042845abf493c072f25', 'request_id': 'req-671c2e0c-1a21-4ea4-874d-93f62c586527'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.875782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb2506-0bfd-4448-b0c4-51270df136eb None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:38.877230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f5bb2506-0bfd-4448-b0c4-51270df136eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:38.936088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb2506-0bfd-4448-b0c4-51270df136eb None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:38.938650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:38.965739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4559c4725414042845abf493c072f25', 'request_id': 'req-671c2e0c-1a21-4ea4-874d-93f62c586527'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.974709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4559c4725414042845abf493c072f25', 'request_id': 'req-671c2e0c-1a21-4ea4-874d-93f62c586527'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.987836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] The token cache is being invalidate because project a4559c4725414042845abf493c072f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:38.988124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.988795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:38.993785 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 985/1981] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:38 2022] DELETE /identity/v3/projects/a4559c4725414042845abf493c072f25 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:38.994755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:38.995824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e7b7-a9d3-4110-be6e-7f4ad88b8371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:38.996123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:38.996882 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e7b7-a9d3-4110-be6e-7f4ad88b8371 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:38.997543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e7b7-a9d3-4110-be6e-7f4ad88b8371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:38.997543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e7b7-a9d3-4110-be6e-7f4ad88b8371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:38.999465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ca27e7b7-a9d3-4110-be6e-7f4ad88b8371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:39.003286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:39.069918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27e7b7-a9d3-4110-be6e-7f4ad88b8371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:39.071438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27e7b7-a9d3-4110-be6e-7f4ad88b8371 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:39.077779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c2e0c-1a21-4ea4-874d-93f62c586527 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:39.081704 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 997/1982] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:39.082656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd81a56-2b51-41f2-b349-a0c59a77cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:39.083582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd81a56-2b51-41f2-b349-a0c59a77cac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:39.083864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd81a56-2b51-41f2-b349-a0c59a77cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:39.084137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd81a56-2b51-41f2-b349-a0c59a77cac9 admin admin] PATH_INFO: `/v3/users/321fed26a09c464d99d41d2b82904c20` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:39.085443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd81a56-2b51-41f2-b349-a0c59a77cac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321fed26a09c464d99d41d2b82904c20)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:39.087393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd81a56-2b51-41f2-b349-a0c59a77cac9 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:39.123766 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e7b7-a9d3-4110-be6e-7f4ad88b8371 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:39.125024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ca27e7b7-a9d3-4110-be6e-7f4ad88b8371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:39.146482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e7b7-a9d3-4110-be6e-7f4ad88b8371 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:39.151787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:39.152715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:39.153306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:39.153306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] PATH_INFO: `/v3/projects/7e02e8d2c0a2414d83de044ca281c209` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:39.154619 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e02e8d2c0a2414d83de044ca281c209)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:39.156590 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:39.308544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e02e8d2c0a2414d83de044ca281c209', 'request_id': 'req-2729f979-c704-4d9c-9231-3f0c8c024114'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.310761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5bd81a56-2b51-41f2-b349-a0c59a77cac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321fed26a09c464d99d41d2b82904c20'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.312334 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5bd81a56-2b51-41f2-b349-a0c59a77cac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321fed26a09c464d99d41d2b82904c20'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.326398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5bd81a56-2b51-41f2-b349-a0c59a77cac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321fed26a09c464d99d41d2b82904c20'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.354069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e02e8d2c0a2414d83de044ca281c209', 'request_id': 'req-2729f979-c704-4d9c-9231-3f0c8c024114'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.360441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e02e8d2c0a2414d83de044ca281c209', 'request_id': 'req-2729f979-c704-4d9c-9231-3f0c8c024114'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.371978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] The token cache is being invalidate because project 7e02e8d2c0a2414d83de044ca281c209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:39.372262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.372928 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2729f979-c704-4d9c-9231-3f0c8c024114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.376947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 998/1983] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:39 2022] DELETE /identity/v3/projects/7e02e8d2c0a2414d83de044ca281c209 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:39.379258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa353e-4c0b-4dab-9488-4ea231b73a35 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:39.379556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa353e-4c0b-4dab-9488-4ea231b73a35 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:39.379965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa353e-4c0b-4dab-9488-4ea231b73a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:39.399299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0baa353e-4c0b-4dab-9488-4ea231b73a35 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:39.401038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0baa353e-4c0b-4dab-9488-4ea231b73a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:39.418586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5bd81a56-2b51-41f2-b349-a0c59a77cac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321fed26a09c464d99d41d2b82904c20'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.429785 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5bd81a56-2b51-41f2-b349-a0c59a77cac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321fed26a09c464d99d41d2b82904c20'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.437112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 986/1984] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:38 2022] DELETE /identity/v3/users/321fed26a09c464d99d41d2b82904c20 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:39.502415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 999/1985] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:39.508171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6234e0-7e1d-42ff-806e-07c53bd10931 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:39.508666 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6234e0-7e1d-42ff-806e-07c53bd10931 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:39.509100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6234e0-7e1d-42ff-806e-07c53bd10931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:39.528154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-7f6234e0-7e1d-42ff-806e-07c53bd10931 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:39.535434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7f6234e0-7e1d-42ff-806e-07c53bd10931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:39.566273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:39.575623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa353e-4c0b-4dab-9488-4ea231b73a35 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:39.577198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0baa353e-4c0b-4dab-9488-4ea231b73a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:39.597110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa353e-4c0b-4dab-9488-4ea231b73a35 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:39.604834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:39.606091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:39.606473 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:39.607357 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] PATH_INFO: `/v3/projects/abddcbdda6f54af9aff2137a87b6aa72` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:39.609847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 987/1986] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:39.613945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6234e0-7e1d-42ff-806e-07c53bd10931 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:39.615406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] RBAC: Authorizing `identity:delete_project(project_id=abddcbdda6f54af9aff2137a87b6aa72)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:39.618412 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:39.625985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6234e0-7e1d-42ff-806e-07c53bd10931 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:39.631870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65c0f5-8913-40cd-8fce-251d9dca205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:39.632568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65c0f5-8913-40cd-8fce-251d9dca205d admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:39.632853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65c0f5-8913-40cd-8fce-251d9dca205d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:39.633130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65c0f5-8913-40cd-8fce-251d9dca205d admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:39.633863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65c0f5-8913-40cd-8fce-251d9dca205d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:39.634174 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65c0f5-8913-40cd-8fce-251d9dca205d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:39.636416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65c0f5-8913-40cd-8fce-251d9dca205d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:39.640115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:39.653471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 988/1987] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:47:39.657573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65c0f5-8913-40cd-8fce-251d9dca205d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:39.675176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65c0f5-8913-40cd-8fce-251d9dca205d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:39.680776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47467d7f-61b8-4c82-855b-26a42d20d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:39.681495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47467d7f-61b8-4c82-855b-26a42d20d64c admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:39.681780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47467d7f-61b8-4c82-855b-26a42d20d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:39.682058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47467d7f-61b8-4c82-855b-26a42d20d64c admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:39.682787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47467d7f-61b8-4c82-855b-26a42d20d64c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:39.684707 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47467d7f-61b8-4c82-855b-26a42d20d64c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:39.736122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abddcbdda6f54af9aff2137a87b6aa72', 'request_id': 'req-9999de1f-fa4a-469b-b088-324a202a311a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.822759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 989/1988] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:39 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:39.826685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47467d7f-61b8-4c82-855b-26a42d20d64c admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:39.834623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abddcbdda6f54af9aff2137a87b6aa72', 'request_id': 'req-9999de1f-fa4a-469b-b088-324a202a311a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.843667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abddcbdda6f54af9aff2137a87b6aa72', 'request_id': 'req-9999de1f-fa4a-469b-b088-324a202a311a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.859526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] The token cache is being invalidate because project abddcbdda6f54af9aff2137a87b6aa72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:39.859732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.860311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:39.862194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1000/1989] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:39 2022] DELETE /identity/v3/projects/abddcbdda6f54af9aff2137a87b6aa72 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:39.867016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:39.872200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:39.915365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47467d7f-61b8-4c82-855b-26a42d20d64c admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:39.922317 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290b6c2-8934-4db3-87fe-abdac39c6f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:39.923120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290b6c2-8934-4db3-87fe-abdac39c6f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:39.923467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290b6c2-8934-4db3-87fe-abdac39c6f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:39.924045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290b6c2-8934-4db3-87fe-abdac39c6f4a admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:39.924883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290b6c2-8934-4db3-87fe-abdac39c6f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:39.926954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290b6c2-8934-4db3-87fe-abdac39c6f4a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:39.959751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999de1f-fa4a-469b-b088-324a202a311a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:39.965770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:39.966696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:39.966979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:39.967254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] PATH_INFO: `/v3/users/44ca59d0ca9f404d8ae221b2eb74a75e` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:39.968507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ca59d0ca9f404d8ae221b2eb74a75e)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:39.970569 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:40.052905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 990/1990] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:39 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:40.052905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290b6c2-8934-4db3-87fe-abdac39c6f4a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:40.054976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a290b6c2-8934-4db3-87fe-abdac39c6f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:40.081221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290b6c2-8934-4db3-87fe-abdac39c6f4a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:40.087660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:40.088560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:40.088844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:40.089120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] PATH_INFO: `/v3/projects/256e9e1086584e3481ae2407ca914eec` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:40.090360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=256e9e1086584e3481ae2407ca914eec)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:40.092293 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:40.224579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ca59d0ca9f404d8ae221b2eb74a75e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.225413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ca59d0ca9f404d8ae221b2eb74a75e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.263332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:40.280417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256e9e1086584e3481ae2407ca914eec', 'request_id': 'req-41bf99ca-a549-4ab4-a770-1ab324fec801'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.347047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ca59d0ca9f404d8ae221b2eb74a75e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.359268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ca59d0ca9f404d8ae221b2eb74a75e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.366624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ca59d0ca9f404d8ae221b2eb74a75e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.372550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1001/1991] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:39 2022] DELETE /identity/v3/users/44ca59d0ca9f404d8ae221b2eb74a75e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:40.373316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:40.380025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:40.444972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408bb84-95e3-4a1b-b6c3-798c2b657319 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:40.450935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ca20d-dee7-4a8b-8afb-e0065d59de29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:40.451071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256e9e1086584e3481ae2407ca914eec', 'request_id': 'req-41bf99ca-a549-4ab4-a770-1ab324fec801'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.452290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ca20d-dee7-4a8b-8afb-e0065d59de29 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:40.452699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ca20d-dee7-4a8b-8afb-e0065d59de29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:40.453070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ca20d-dee7-4a8b-8afb-e0065d59de29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:40.453976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ca20d-dee7-4a8b-8afb-e0065d59de29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:40.455838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ca20d-dee7-4a8b-8afb-e0065d59de29 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:40.458413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256e9e1086584e3481ae2407ca914eec', 'request_id': 'req-41bf99ca-a549-4ab4-a770-1ab324fec801'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.469620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1002/1992] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:40.470932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ca20d-dee7-4a8b-8afb-e0065d59de29 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:40.471346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] The token cache is being invalidate because project 256e9e1086584e3481ae2407ca914eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:40.471885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.472777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.474470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 991/1993] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:40 2022] DELETE /identity/v3/projects/256e9e1086584e3481ae2407ca914eec => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:40.478579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:40.480370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:40.480760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ca20d-dee7-4a8b-8afb-e0065d59de29 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:40.485675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9661-33db-4e80-a2a5-22a28ce628f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:40.486373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9661-33db-4e80-a2a5-22a28ce628f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:40.489073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9661-33db-4e80-a2a5-22a28ce628f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:40.489073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9661-33db-4e80-a2a5-22a28ce628f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:40.489073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a9661-33db-4e80-a2a5-22a28ce628f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:40.489605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a9661-33db-4e80-a2a5-22a28ce628f4 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:40.500231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1003/1994] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:40.504107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9661-33db-4e80-a2a5-22a28ce628f4 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:40.505799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-233a9661-33db-4e80-a2a5-22a28ce628f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:40.520257 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9661-33db-4e80-a2a5-22a28ce628f4 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:40.528196 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab7d9f-bebf-4de4-a993-d8beb4690bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:40.529295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7d9f-bebf-4de4-a993-d8beb4690bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:40.529684 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7d9f-bebf-4de4-a993-d8beb4690bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:40.530066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7d9f-bebf-4de4-a993-d8beb4690bce admin admin] PATH_INFO: `/v3/projects/675ddaf008ec4563a3cf70c0e59b221f/users/a51d2ebdd0b4473390a99632953fe594/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:40.550719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf99ca-a549-4ab4-a770-1ab324fec801 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:40.554483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab7d9f-bebf-4de4-a993-d8beb4690bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=675ddaf008ec4563a3cf70c0e59b221f, user_id=a51d2ebdd0b4473390a99632953fe594, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:40.557458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab7d9f-bebf-4de4-a993-d8beb4690bce admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:40.557574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:40.558637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:40.558918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:40.559191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] PATH_INFO: `/v3/users/39a76f770663413d8c6e76ae435f15d2` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:40.560459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a76f770663413d8c6e76ae435f15d2)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:40.562412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:40.668338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1004/1995] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:40 2022] PUT /identity/v3/projects/675ddaf008ec4563a3cf70c0e59b221f/users/a51d2ebdd0b4473390a99632953fe594/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:40.681562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f41338-7cac-4c0c-92e3-c99c405f2031 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:40.681859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f41338-7cac-4c0c-92e3-c99c405f2031 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:40.682137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f41338-7cac-4c0c-92e3-c99c405f2031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:40.697948 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:40.728585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-30f41338-7cac-4c0c-92e3-c99c405f2031 None None] MFA Rules not processed for user `a51d2ebdd0b4473390a99632953fe594`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:40.733215 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-30f41338-7cac-4c0c-92e3-c99c405f2031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:40.750997 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a76f770663413d8c6e76ae435f15d2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.751682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a76f770663413d8c6e76ae435f15d2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.765858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a76f770663413d8c6e76ae435f15d2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.819066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1005/1996] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:40.820436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f41338-7cac-4c0c-92e3-c99c405f2031 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:40.821326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-30f41338-7cac-4c0c-92e3-c99c405f2031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:40.829296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a76f770663413d8c6e76ae435f15d2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.837064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a76f770663413d8c6e76ae435f15d2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:40.846886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 992/1997] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:40 2022] DELETE /identity/v3/users/39a76f770663413d8c6e76ae435f15d2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:40.847753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:40.849360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:40.903369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f41338-7cac-4c0c-92e3-c99c405f2031 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:40.919829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ca49e-fca7-4d49-84fe-5cbb0940cd19 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:40.925467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055392e-051f-4fcf-bc96-f76c82b3a14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:40.926473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055392e-051f-4fcf-bc96-f76c82b3a14e admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:40.926473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055392e-051f-4fcf-bc96-f76c82b3a14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:40.926789 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055392e-051f-4fcf-bc96-f76c82b3a14e admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:40.927405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055392e-051f-4fcf-bc96-f76c82b3a14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:40.930405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055392e-051f-4fcf-bc96-f76c82b3a14e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:40.965460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:40.966376 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:40.966659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:40.966939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] PATH_INFO: `/v3/projects/85c2c34d12fd43608f9378caab42f0bc` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:40.968338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c2c34d12fd43608f9378caab42f0bc)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:40.970553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.024647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 993/1998] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:40 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:41.028399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055392e-051f-4fcf-bc96-f76c82b3a14e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.123415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c2c34d12fd43608f9378caab42f0bc', 'request_id': 'req-a202c064-031c-4894-9456-11db26b51040'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:41.138779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055392e-051f-4fcf-bc96-f76c82b3a14e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.160843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:41.182943 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c2c34d12fd43608f9378caab42f0bc', 'request_id': 'req-a202c064-031c-4894-9456-11db26b51040'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:41.190083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c2c34d12fd43608f9378caab42f0bc', 'request_id': 'req-a202c064-031c-4894-9456-11db26b51040'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:41.197473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d13de-98f1-4ed3-9673-03a6b21a7f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.198208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d13de-98f1-4ed3-9673-03a6b21a7f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.198522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d13de-98f1-4ed3-9673-03a6b21a7f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.198796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d13de-98f1-4ed3-9673-03a6b21a7f6a admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.199493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d13de-98f1-4ed3-9673-03a6b21a7f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.201415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d13de-98f1-4ed3-9673-03a6b21a7f6a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.202689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] The token cache is being invalidate because project 85c2c34d12fd43608f9378caab42f0bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:41.202989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:41.203667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a202c064-031c-4894-9456-11db26b51040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:41.205507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1006/1999] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:40 2022] DELETE /identity/v3/projects/85c2c34d12fd43608f9378caab42f0bc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:41.210794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dbb30-d184-40f6-befb-80957ea0114a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.218888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dbb30-d184-40f6-befb-80957ea0114a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.218888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dbb30-d184-40f6-befb-80957ea0114a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.229919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-564dbb30-d184-40f6-befb-80957ea0114a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:41.231204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-564dbb30-d184-40f6-befb-80957ea0114a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:41.239436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1007/2000] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:41.247163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154032c1-92a4-460a-a5f5-e08c57cab522 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.247574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154032c1-92a4-460a-a5f5-e08c57cab522 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.247965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154032c1-92a4-460a-a5f5-e08c57cab522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.267413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-154032c1-92a4-460a-a5f5-e08c57cab522 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:41.268618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-154032c1-92a4-460a-a5f5-e08c57cab522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:41.277012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1008/2001] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:41.281033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154032c1-92a4-460a-a5f5-e08c57cab522 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.291298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154032c1-92a4-460a-a5f5-e08c57cab522 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.296700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 994/2002] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:41 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:41.297598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d13de-98f1-4ed3-9673-03a6b21a7f6a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.299380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-759d13de-98f1-4ed3-9673-03a6b21a7f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:41.299738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204a785-8676-4fc5-aea9-7428f4bfba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.300410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a785-8676-4fc5-aea9-7428f4bfba78 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.300692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a785-8676-4fc5-aea9-7428f4bfba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.300966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a785-8676-4fc5-aea9-7428f4bfba78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.301974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204a785-8676-4fc5-aea9-7428f4bfba78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:41.302445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204a785-8676-4fc5-aea9-7428f4bfba78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.304083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204a785-8676-4fc5-aea9-7428f4bfba78 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.312918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d13de-98f1-4ed3-9673-03a6b21a7f6a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.317961 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.318898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.319306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.319772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1009/2003] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:47:41.321157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204a785-8676-4fc5-aea9-7428f4bfba78 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.323157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] PATH_INFO: `/v3/projects/8e7e0811179c4cef80c5cb669ddf3ee1` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.323389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-1204a785-8676-4fc5-aea9-7428f4bfba78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:41.324525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7e0811179c4cef80c5cb669ddf3ee1)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.326503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.339326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204a785-8676-4fc5-aea9-7428f4bfba78 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.344488 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d693b4-b680-44bd-ab9e-b290f8cd7e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.345163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d693b4-b680-44bd-ab9e-b290f8cd7e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.345450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d693b4-b680-44bd-ab9e-b290f8cd7e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.345729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d693b4-b680-44bd-ab9e-b290f8cd7e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.346564 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d693b4-b680-44bd-ab9e-b290f8cd7e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.348163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d693b4-b680-44bd-ab9e-b290f8cd7e2b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.359430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1010/2004] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:41.360227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d693b4-b680-44bd-ab9e-b290f8cd7e2b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.369975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d693b4-b680-44bd-ab9e-b290f8cd7e2b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.374574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a253f10-6274-4075-a44b-58f9cca24ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.375230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a253f10-6274-4075-a44b-58f9cca24ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.375558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a253f10-6274-4075-a44b-58f9cca24ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.375843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a253f10-6274-4075-a44b-58f9cca24ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.376745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a253f10-6274-4075-a44b-58f9cca24ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.379250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a253f10-6274-4075-a44b-58f9cca24ee0 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.428940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7e0811179c4cef80c5cb669ddf3ee1', 'request_id': 'req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:41.450601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1011/2005] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:41 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:41.450601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a253f10-6274-4075-a44b-58f9cca24ee0 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.485207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7e0811179c4cef80c5cb669ddf3ee1', 'request_id': 'req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:41.492958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7e0811179c4cef80c5cb669ddf3ee1', 'request_id': 'req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:41.503110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] The token cache is being invalidate because project 8e7e0811179c4cef80c5cb669ddf3ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:41.503397 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:41.504066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:41.505622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 995/2006] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:41 2022] DELETE /identity/v3/projects/8e7e0811179c4cef80c5cb669ddf3ee1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:41.506499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.511284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:41.513151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a253f10-6274-4075-a44b-58f9cca24ee0 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.517960 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3060762-c117-40f8-bbaf-666a2a91d209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.518890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060762-c117-40f8-bbaf-666a2a91d209 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.519179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060762-c117-40f8-bbaf-666a2a91d209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.519473 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060762-c117-40f8-bbaf-666a2a91d209 admin admin] PATH_INFO: `/v3/projects/a7668a39790e4115a09e74a2aee73871/users/2afe6839f9944fdfaeec9f065a383dae/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.532201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:41.535359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3060762-c117-40f8-bbaf-666a2a91d209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7668a39790e4115a09e74a2aee73871, user_id=2afe6839f9944fdfaeec9f065a383dae, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.539983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3060762-c117-40f8-bbaf-666a2a91d209 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.574557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a052cbe-9d21-4f43-8fb8-489fa20f64a5 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.579353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c9375-98a1-4706-adab-03c10c119f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.580023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c9375-98a1-4706-adab-03c10c119f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.580309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c9375-98a1-4706-adab-03c10c119f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.580588 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c9375-98a1-4706-adab-03c10c119f1a admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.581271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c9375-98a1-4706-adab-03c10c119f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.583225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c9375-98a1-4706-adab-03c10c119f1a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.673537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1012/2007] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:41 2022] PUT /identity/v3/projects/a7668a39790e4115a09e74a2aee73871/users/2afe6839f9944fdfaeec9f065a383dae/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:41.674943 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01259f1b-3249-4f46-883a-96b405e5ac37 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.675234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01259f1b-3249-4f46-883a-96b405e5ac37 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.675515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01259f1b-3249-4f46-883a-96b405e5ac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.692599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-01259f1b-3249-4f46-883a-96b405e5ac37 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:41.693787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-01259f1b-3249-4f46-883a-96b405e5ac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:41.704350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 996/2008] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:41 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:41.704350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c9375-98a1-4706-adab-03c10c119f1a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.705728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2d6c9375-98a1-4706-adab-03c10c119f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:41.721734 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c9375-98a1-4706-adab-03c10c119f1a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.771232 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1013/2009] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:41.775597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01259f1b-3249-4f46-883a-96b405e5ac37 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.792316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01259f1b-3249-4f46-883a-96b405e5ac37 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.794778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379a9e9-88fb-4702-b6db-66c0ff354568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.795526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379a9e9-88fb-4702-b6db-66c0ff354568 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.795819 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379a9e9-88fb-4702-b6db-66c0ff354568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.796093 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379a9e9-88fb-4702-b6db-66c0ff354568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.796980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379a9e9-88fb-4702-b6db-66c0ff354568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.797363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8e88-b589-4b3d-bf97-47f07c1367a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.798104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8e88-b589-4b3d-bf97-47f07c1367a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.798480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8e88-b589-4b3d-bf97-47f07c1367a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.798639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379a9e9-88fb-4702-b6db-66c0ff354568 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.798873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8e88-b589-4b3d-bf97-47f07c1367a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.799671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc8e88-b589-4b3d-bf97-47f07c1367a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.801324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc8e88-b589-4b3d-bf97-47f07c1367a6 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.815572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 997/2010] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:41.815969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1014/2011] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:41.816057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9a7c4-6a1b-4a89-9fa9-6e12ac8152a9 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.816145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379a9e9-88fb-4702-b6db-66c0ff354568 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.816236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9a7c4-6a1b-4a89-9fa9-6e12ac8152a9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.816236 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9a7c4-6a1b-4a89-9fa9-6e12ac8152a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.829336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379a9e9-88fb-4702-b6db-66c0ff354568 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.834863 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdb241-948b-47c0-a116-1b7e08897c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.835396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-56f9a7c4-6a1b-4a89-9fa9-6e12ac8152a9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:41.835552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdb241-948b-47c0-a116-1b7e08897c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.835971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdb241-948b-47c0-a116-1b7e08897c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.836104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdb241-948b-47c0-a116-1b7e08897c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.836606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-56f9a7c4-6a1b-4a89-9fa9-6e12ac8152a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:41.836833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdb241-948b-47c0-a116-1b7e08897c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.838623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdb241-948b-47c0-a116-1b7e08897c1a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.850097 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 998/2012] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:41.850097 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9a7c4-6a1b-4a89-9fa9-6e12ac8152a9 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.850392 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1015/2013] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:41.851054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdb241-948b-47c0-a116-1b7e08897c1a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.860955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9a7c4-6a1b-4a89-9fa9-6e12ac8152a9 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.862048 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdb241-948b-47c0-a116-1b7e08897c1a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.867041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646c199-d9f8-499f-8488-9ca29568535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.867724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176be2a6-3db8-4189-898c-79f43912149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.868315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646c199-d9f8-499f-8488-9ca29568535e admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.868441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be2a6-3db8-4189-898c-79f43912149e admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.868597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646c199-d9f8-499f-8488-9ca29568535e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.868692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be2a6-3db8-4189-898c-79f43912149e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.868924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be2a6-3db8-4189-898c-79f43912149e admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.869051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646c199-d9f8-499f-8488-9ca29568535e admin admin] PATH_INFO: `/v3/projects/a7668a39790e4115a09e74a2aee73871/users/2afe6839f9944fdfaeec9f065a383dae/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.869660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176be2a6-3db8-4189-898c-79f43912149e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:41.869961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176be2a6-3db8-4189-898c-79f43912149e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.871354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646c199-d9f8-499f-8488-9ca29568535e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7668a39790e4115a09e74a2aee73871, user_id=2afe6839f9944fdfaeec9f065a383dae, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.871587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176be2a6-3db8-4189-898c-79f43912149e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.875315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646c199-d9f8-499f-8488-9ca29568535e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.888432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1016/2014] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:41.888432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176be2a6-3db8-4189-898c-79f43912149e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.888849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 999/2015] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:41 2022] PUT /identity/v3/projects/a7668a39790e4115a09e74a2aee73871/users/2afe6839f9944fdfaeec9f065a383dae/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:41.897018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:41.898527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646c199-d9f8-499f-8488-9ca29568535e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:41.901063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176be2a6-3db8-4189-898c-79f43912149e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.956947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdf427-fde9-46b1-aea7-7f493315130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.961346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdf427-fde9-46b1-aea7-7f493315130f admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.961346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdf427-fde9-46b1-aea7-7f493315130f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.961346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdf427-fde9-46b1-aea7-7f493315130f admin admin] PATH_INFO: `/v3/projects/70140477eae741eb8eacb1617fc0637b/users/4125c0b1d9e24201942e1d86bae15ce0/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.963454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646c199-d9f8-499f-8488-9ca29568535e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:41.968105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab7305-4c84-41cf-aace-b2d6d107449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:41.968764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab7305-4c84-41cf-aace-b2d6d107449e admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:41.969053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab7305-4c84-41cf-aace-b2d6d107449e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:41.969333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab7305-4c84-41cf-aace-b2d6d107449e admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:41.970039 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab7305-4c84-41cf-aace-b2d6d107449e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.972022 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab7305-4c84-41cf-aace-b2d6d107449e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:41.973420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdf427-fde9-46b1-aea7-7f493315130f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70140477eae741eb8eacb1617fc0637b, user_id=4125c0b1d9e24201942e1d86bae15ce0, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:41.976190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdf427-fde9-46b1-aea7-7f493315130f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:42.045944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1017/2016] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:41 2022] PUT /identity/v3/projects/70140477eae741eb8eacb1617fc0637b/users/4125c0b1d9e24201942e1d86bae15ce0/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:42.048183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4127cd8-a487-4e16-be69-b11132447a18 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.048470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4127cd8-a487-4e16-be69-b11132447a18 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.048744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4127cd8-a487-4e16-be69-b11132447a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.078007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c4127cd8-a487-4e16-be69-b11132447a18 None None] MFA Rules not processed for user `2afe6839f9944fdfaeec9f065a383dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:42.079257 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c4127cd8-a487-4e16-be69-b11132447a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:42.083029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1000/2017] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:41 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:42.083029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72990-c2a4-473d-95ef-960337344c12 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.083029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72990-c2a4-473d-95ef-960337344c12 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.083029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72990-c2a4-473d-95ef-960337344c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.110602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-33f72990-c2a4-473d-95ef-960337344c12 None None] MFA Rules not processed for user `4125c0b1d9e24201942e1d86bae15ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:42.111838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-33f72990-c2a4-473d-95ef-960337344c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:42.158972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1018/2018] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:42.158972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4127cd8-a487-4e16-be69-b11132447a18 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:42.185375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1001/2019] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:42.190822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f72990-c2a4-473d-95ef-960337344c12 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:42.258142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4127cd8-a487-4e16-be69-b11132447a18 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:42.262773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efbad5-19bd-4b0d-94f9-eed14495e483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:42.263443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efbad5-19bd-4b0d-94f9-eed14495e483 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.263722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efbad5-19bd-4b0d-94f9-eed14495e483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.263994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efbad5-19bd-4b0d-94f9-eed14495e483 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.264818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efbad5-19bd-4b0d-94f9-eed14495e483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:42.266794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efbad5-19bd-4b0d-94f9-eed14495e483 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:42.268654 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f72990-c2a4-473d-95ef-960337344c12 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:42.273234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b907a3c-eede-4f6f-95a6-72e35d7a3742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:42.274084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907a3c-eede-4f6f-95a6-72e35d7a3742 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.274824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907a3c-eede-4f6f-95a6-72e35d7a3742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.275144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907a3c-eede-4f6f-95a6-72e35d7a3742 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.275845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b907a3c-eede-4f6f-95a6-72e35d7a3742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:42.277812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b907a3c-eede-4f6f-95a6-72e35d7a3742 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:42.383168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:42.392013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1019/2020] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:42 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:42.392013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efbad5-19bd-4b0d-94f9-eed14495e483 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:42.392013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-01efbad5-19bd-4b0d-94f9-eed14495e483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:42.451051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1002/2021] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:42 2022] POST /identity/v3/projects => generated 387 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:42.451051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b907a3c-eede-4f6f-95a6-72e35d7a3742 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:42.483446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efbad5-19bd-4b0d-94f9-eed14495e483 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:42.536955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b907a3c-eede-4f6f-95a6-72e35d7a3742 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:42.543151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e80595-0352-402e-86db-e6bbf2ab78bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:42.543830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e80595-0352-402e-86db-e6bbf2ab78bd admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.544117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e80595-0352-402e-86db-e6bbf2ab78bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.544395 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e80595-0352-402e-86db-e6bbf2ab78bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.545203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e80595-0352-402e-86db-e6bbf2ab78bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:42.547406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e80595-0352-402e-86db-e6bbf2ab78bd admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:42.568405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1003/2022] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:42.568405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e80595-0352-402e-86db-e6bbf2ab78bd admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:42.571031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27893107-3de5-4df9-a11a-5c05ed1e973e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:42.571758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27893107-3de5-4df9-a11a-5c05ed1e973e service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.572294 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27893107-3de5-4df9-a11a-5c05ed1e973e service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.572804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27893107-3de5-4df9-a11a-5c05ed1e973e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.585719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e80595-0352-402e-86db-e6bbf2ab78bd admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:42.591132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc07fbe-63d6-47f9-aaed-719bd937d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:42.591868 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07fbe-63d6-47f9-aaed-719bd937d35d admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.592154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07fbe-63d6-47f9-aaed-719bd937d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.592429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07fbe-63d6-47f9-aaed-719bd937d35d admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.594218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc07fbe-63d6-47f9-aaed-719bd937d35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:42.596389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc07fbe-63d6-47f9-aaed-719bd937d35d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:42.639152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:42.641411 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27893107-3de5-4df9-a11a-5c05ed1e973e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:42.643038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27893107-3de5-4df9-a11a-5c05ed1e973e service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:42.653091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1020/2023] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:42.653974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27893107-3de5-4df9-a11a-5c05ed1e973e service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:42.665681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27893107-3de5-4df9-a11a-5c05ed1e973e service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:42.670838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad6462-f635-434b-aaa0-896a5db13bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:42.671481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad6462-f635-434b-aaa0-896a5db13bee admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.672184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad6462-f635-434b-aaa0-896a5db13bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.672184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad6462-f635-434b-aaa0-896a5db13bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.673179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad6462-f635-434b-aaa0-896a5db13bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:42.675168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad6462-f635-434b-aaa0-896a5db13bee admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:42.685302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1021/2024] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:42.689487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad6462-f635-434b-aaa0-896a5db13bee admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:42.699494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad6462-f635-434b-aaa0-896a5db13bee admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:42.704162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00ed57-90dd-4e21-9c95-97d4135d59b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:42.705043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ed57-90dd-4e21-9c95-97d4135d59b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.705329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ed57-90dd-4e21-9c95-97d4135d59b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.705715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ed57-90dd-4e21-9c95-97d4135d59b2 admin admin] PATH_INFO: `/v3/projects/608554a1f9d04b55888eb9168dab3b32/users/f19592c32cea4fabaa7301b099bac14b/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.722586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00ed57-90dd-4e21-9c95-97d4135d59b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608554a1f9d04b55888eb9168dab3b32, user_id=f19592c32cea4fabaa7301b099bac14b, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:42.724914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00ed57-90dd-4e21-9c95-97d4135d59b2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:42.744866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:42.750792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1004/2025] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:42 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:42.754682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc07fbe-63d6-47f9-aaed-719bd937d35d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:42.773551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc07fbe-63d6-47f9-aaed-719bd937d35d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:42.778849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e194c9-fc6b-4c35-be62-e2141fd57c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:42.784951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e194c9-fc6b-4c35-be62-e2141fd57c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.784951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e194c9-fc6b-4c35-be62-e2141fd57c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.784951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e194c9-fc6b-4c35-be62-e2141fd57c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.784951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e194c9-fc6b-4c35-be62-e2141fd57c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:42.784951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e194c9-fc6b-4c35-be62-e2141fd57c45 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:42.796983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1005/2026] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:42.801096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e194c9-fc6b-4c35-be62-e2141fd57c45 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:42.815765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1022/2027] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:42 2022] PUT /identity/v3/projects/608554a1f9d04b55888eb9168dab3b32/users/f19592c32cea4fabaa7301b099bac14b/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:42.817122 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e194c9-fc6b-4c35-be62-e2141fd57c45 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:42.817252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a702a9-e70d-499c-8e8a-de32dc22cc1e None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.817476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a702a9-e70d-499c-8e8a-de32dc22cc1e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.817757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a702a9-e70d-499c-8e8a-de32dc22cc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.847452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-89a702a9-e70d-499c-8e8a-de32dc22cc1e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:42.848823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-89a702a9-e70d-499c-8e8a-de32dc22cc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:42.945697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a5d96-5306-4baf-a7b7-48b187f2cb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:42.947161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a5d96-5306-4baf-a7b7-48b187f2cb09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:42.947505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a5d96-5306-4baf-a7b7-48b187f2cb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:42.947854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a5d96-5306-4baf-a7b7-48b187f2cb09 admin admin] PATH_INFO: `/v3/projects/216061c9fdd049e984eece6f54bd6f62/users/e0488abac5344c2fb2a92bc4b22b2b26/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:42.948515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1023/2028] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:42.963107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a702a9-e70d-499c-8e8a-de32dc22cc1e None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:42.963962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-89a702a9-e70d-499c-8e8a-de32dc22cc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:42.976198 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a5d96-5306-4baf-a7b7-48b187f2cb09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216061c9fdd049e984eece6f54bd6f62, user_id=e0488abac5344c2fb2a92bc4b22b2b26, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:42.979015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a5d96-5306-4baf-a7b7-48b187f2cb09 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:43.013893 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:43.028028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a702a9-e70d-499c-8e8a-de32dc22cc1e None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:43.031875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf2bf9-4170-4d4b-ba9a-bb4de058bd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:43.032608 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf2bf9-4170-4d4b-ba9a-bb4de058bd08 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:43.032961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf2bf9-4170-4d4b-ba9a-bb4de058bd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:43.033302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf2bf9-4170-4d4b-ba9a-bb4de058bd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:43.042697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf2bf9-4170-4d4b-ba9a-bb4de058bd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:43.044186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf2bf9-4170-4d4b-ba9a-bb4de058bd08 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:43.055818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1024/2029] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:43.056697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf2bf9-4170-4d4b-ba9a-bb4de058bd08 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:43.057937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0bcf2bf9-4170-4d4b-ba9a-bb4de058bd08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:43.072551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf2bf9-4170-4d4b-ba9a-bb4de058bd08 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:43.081353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1006/2030] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:42 2022] PUT /identity/v3/projects/216061c9fdd049e984eece6f54bd6f62/users/e0488abac5344c2fb2a92bc4b22b2b26/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:43.082463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a5d96-5306-4baf-a7b7-48b187f2cb09 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:43.102830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:43.153925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a5d96-5306-4baf-a7b7-48b187f2cb09 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:43.158127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:43.159149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:43.159433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:43.159711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] PATH_INFO: `/v3/users/fda3862bb0834113bea7e9fc3265b7dc` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:43.160326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688342b5-00ff-4e01-a666-52f5398bd98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:43.161003 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688342b5-00ff-4e01-a666-52f5398bd98a admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:43.161109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda3862bb0834113bea7e9fc3265b7dc)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:43.161289 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688342b5-00ff-4e01-a666-52f5398bd98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:43.161569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688342b5-00ff-4e01-a666-52f5398bd98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:43.162477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688342b5-00ff-4e01-a666-52f5398bd98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:43.163247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:43.164161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688342b5-00ff-4e01-a666-52f5398bd98a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:43.179540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1007/2031] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:43.183484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688342b5-00ff-4e01-a666-52f5398bd98a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:43.199533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688342b5-00ff-4e01-a666-52f5398bd98a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:43.204365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3442ece-5e02-433d-8369-4c5f21cc33b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:43.205265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3442ece-5e02-433d-8369-4c5f21cc33b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:43.205559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3442ece-5e02-433d-8369-4c5f21cc33b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:43.205866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3442ece-5e02-433d-8369-4c5f21cc33b1 admin admin] PATH_INFO: `/v3/projects/216061c9fdd049e984eece6f54bd6f62/users/e0488abac5344c2fb2a92bc4b22b2b26/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:43.208094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3442ece-5e02-433d-8369-4c5f21cc33b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216061c9fdd049e984eece6f54bd6f62, user_id=e0488abac5344c2fb2a92bc4b22b2b26, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:43.211162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3442ece-5e02-433d-8369-4c5f21cc33b1 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:43.221810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1008/2032] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:43 2022] PUT /identity/v3/projects/216061c9fdd049e984eece6f54bd6f62/users/e0488abac5344c2fb2a92bc4b22b2b26/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:43.231718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5dee4-a143-4b48-9797-e2d72f1d73a3 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:43.232006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5dee4-a143-4b48-9797-e2d72f1d73a3 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:43.232440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5dee4-a143-4b48-9797-e2d72f1d73a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:43.260964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5ed5dee4-a143-4b48-9797-e2d72f1d73a3 None None] MFA Rules not processed for user `e0488abac5344c2fb2a92bc4b22b2b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:43.262222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5ed5dee4-a143-4b48-9797-e2d72f1d73a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:43.338948 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1009/2033] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:43.354127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5dee4-a143-4b48-9797-e2d72f1d73a3 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:43.410671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5dee4-a143-4b48-9797-e2d72f1d73a3 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:43.415053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8760a15-e9ed-4686-bf66-2546c246f99c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:43.415729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8760a15-e9ed-4686-bf66-2546c246f99c service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:43.416221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8760a15-e9ed-4686-bf66-2546c246f99c service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:43.416440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8760a15-e9ed-4686-bf66-2546c246f99c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:43.428054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8760a15-e9ed-4686-bf66-2546c246f99c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:43.431127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8760a15-e9ed-4686-bf66-2546c246f99c service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:43.437289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda3862bb0834113bea7e9fc3265b7dc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:43.438560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda3862bb0834113bea7e9fc3265b7dc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:43.445595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1010/2034] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:47:43.445595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8760a15-e9ed-4686-bf66-2546c246f99c service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:43.512110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8760a15-e9ed-4686-bf66-2546c246f99c service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:43.516790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929c329-3fd8-4501-a0eb-0713b6ab33cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:43.517661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929c329-3fd8-4501-a0eb-0713b6ab33cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:43.517947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929c329-3fd8-4501-a0eb-0713b6ab33cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:43.518224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929c329-3fd8-4501-a0eb-0713b6ab33cb admin admin] PATH_INFO: `/v3/users/a51d2ebdd0b4473390a99632953fe594` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:43.519457 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929c329-3fd8-4501-a0eb-0713b6ab33cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51d2ebdd0b4473390a99632953fe594)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:43.521378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929c329-3fd8-4501-a0eb-0713b6ab33cb admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:43.540702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda3862bb0834113bea7e9fc3265b7dc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:43.555090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda3862bb0834113bea7e9fc3265b7dc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:43.562161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda3862bb0834113bea7e9fc3265b7dc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:43.569045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1025/2035] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:43 2022] DELETE /identity/v3/users/fda3862bb0834113bea7e9fc3265b7dc => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:43.652823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:43.737054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-a929c329-3fd8-4501-a0eb-0713b6ab33cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51d2ebdd0b4473390a99632953fe594'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:43.737867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-a929c329-3fd8-4501-a0eb-0713b6ab33cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51d2ebdd0b4473390a99632953fe594'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:43.772809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-a929c329-3fd8-4501-a0eb-0713b6ab33cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51d2ebdd0b4473390a99632953fe594'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:43.840481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-a929c329-3fd8-4501-a0eb-0713b6ab33cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51d2ebdd0b4473390a99632953fe594'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:43.848277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-a929c329-3fd8-4501-a0eb-0713b6ab33cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51d2ebdd0b4473390a99632953fe594'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:43.848930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:43.851152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:43.855504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1011/2036] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:43 2022] DELETE /identity/v3/users/a51d2ebdd0b4473390a99632953fe594 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:43.860387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf649ae-5a4d-462e-a4c8-0d20d1b66d68 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:43.860895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf649ae-5a4d-462e-a4c8-0d20d1b66d68 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:43.861187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf649ae-5a4d-462e-a4c8-0d20d1b66d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:43.881182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ddf649ae-5a4d-462e-a4c8-0d20d1b66d68 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:43.882529 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ddf649ae-5a4d-462e-a4c8-0d20d1b66d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:43.942425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07b98b-c2f1-45d9-a07c-4ed0284fd372 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:43.954011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1012/2037] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:43.974369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf649ae-5a4d-462e-a4c8-0d20d1b66d68 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:43.977862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ddf649ae-5a4d-462e-a4c8-0d20d1b66d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:44.023941 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:44.024968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:44.025369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:44.025814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] PATH_INFO: `/v3/projects/573ff4baad10445dac71f2889c2ec6bf` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:44.027250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] RBAC: Authorizing `identity:delete_project(project_id=573ff4baad10445dac71f2889c2ec6bf)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:44.029250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:44.064582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf649ae-5a4d-462e-a4c8-0d20d1b66d68 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:44.068317 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ecdd5-e26b-433e-bc3c-8630f224924a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:44.068973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ecdd5-e26b-433e-bc3c-8630f224924a service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:44.069795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ecdd5-e26b-433e-bc3c-8630f224924a service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:44.070074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ecdd5-e26b-433e-bc3c-8630f224924a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:44.079744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ecdd5-e26b-433e-bc3c-8630f224924a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:44.081218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ecdd5-e26b-433e-bc3c-8630f224924a service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:44.091307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1013/2038] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:44.108716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:44.180579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573ff4baad10445dac71f2889c2ec6bf', 'request_id': 'req-8644a184-3550-45e3-8190-2c4ce8a7827a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:44.249604 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573ff4baad10445dac71f2889c2ec6bf', 'request_id': 'req-8644a184-3550-45e3-8190-2c4ce8a7827a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:44.258610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573ff4baad10445dac71f2889c2ec6bf', 'request_id': 'req-8644a184-3550-45e3-8190-2c4ce8a7827a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:44.282824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] The token cache is being invalidate because project 573ff4baad10445dac71f2889c2ec6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:44.282824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:44.282824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8644a184-3550-45e3-8190-2c4ce8a7827a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:44.286685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1026/2039] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:43 2022] DELETE /identity/v3/projects/573ff4baad10445dac71f2889c2ec6bf => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:44.287972 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2b6f0-087d-4835-9394-ae507b619927 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:44.288263 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2b6f0-087d-4835-9394-ae507b619927 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:44.288525 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2b6f0-087d-4835-9394-ae507b619927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:44.310048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-8fc2b6f0-087d-4835-9394-ae507b619927 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:44.311392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8fc2b6f0-087d-4835-9394-ae507b619927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:44.384432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1014/2040] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:44.393319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50626a5-1b3c-491b-9ca8-6c3ea104383d None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:44.393639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50626a5-1b3c-491b-9ca8-6c3ea104383d None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:44.393958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50626a5-1b3c-491b-9ca8-6c3ea104383d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:44.414486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-b50626a5-1b3c-491b-9ca8-6c3ea104383d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:44.415979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b50626a5-1b3c-491b-9ca8-6c3ea104383d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:44.428222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1027/2041] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:44.432981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2b6f0-087d-4835-9394-ae507b619927 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:44.445391 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2b6f0-087d-4835-9394-ae507b619927 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:44.453690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea169d-d9ff-415c-abf8-8507616ed9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:44.457094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea169d-d9ff-415c-abf8-8507616ed9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:44.458319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea169d-d9ff-415c-abf8-8507616ed9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:44.458804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea169d-d9ff-415c-abf8-8507616ed9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:44.459803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea169d-d9ff-415c-abf8-8507616ed9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:44.460449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea169d-d9ff-415c-abf8-8507616ed9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:44.463642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea169d-d9ff-415c-abf8-8507616ed9f1 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:44.482869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1015/2042] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:44.487131 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50626a5-1b3c-491b-9ca8-6c3ea104383d None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:44.499578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50626a5-1b3c-491b-9ca8-6c3ea104383d None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:44.504695 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bf7ca-3add-44b6-a986-a71ef55062ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:44.505433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bf7ca-3add-44b6-a986-a71ef55062ed admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:44.505787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bf7ca-3add-44b6-a986-a71ef55062ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:44.506150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bf7ca-3add-44b6-a986-a71ef55062ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:44.506982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bf7ca-3add-44b6-a986-a71ef55062ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:44.508955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bf7ca-3add-44b6-a986-a71ef55062ed admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:44.554304 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33d48a-9838-4ff2-9161-9a1a902a004c None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:44.554606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33d48a-9838-4ff2-9161-9a1a902a004c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:44.554906 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33d48a-9838-4ff2-9161-9a1a902a004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:44.584709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9c33d48a-9838-4ff2-9161-9a1a902a004c None None] MFA Rules not processed for user `f19592c32cea4fabaa7301b099bac14b`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:44.586011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9c33d48a-9838-4ff2-9161-9a1a902a004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:44.628862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1028/2043] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:44 2022] POST /identity/v3/projects => generated 391 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:44.632724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bf7ca-3add-44b6-a986-a71ef55062ed admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:44.693214 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1016/2044] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:44.694521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33d48a-9838-4ff2-9161-9a1a902a004c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:44.705208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9c33d48a-9838-4ff2-9161-9a1a902a004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:44.714012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bf7ca-3add-44b6-a986-a71ef55062ed admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:44.719617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af5a95-97ac-4833-b94f-87b091277f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:44.721027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5a95-97ac-4833-b94f-87b091277f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:44.721027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5a95-97ac-4833-b94f-87b091277f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:44.721027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af5a95-97ac-4833-b94f-87b091277f5a admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:44.721536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af5a95-97ac-4833-b94f-87b091277f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:44.723545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af5a95-97ac-4833-b94f-87b091277f5a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:44.723661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:44.729635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33d48a-9838-4ff2-9161-9a1a902a004c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:44.735170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:44.736038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:44.736320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:44.736591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] PATH_INFO: `/v3/projects/675ddaf008ec4563a3cf70c0e59b221f` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:44.737792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=675ddaf008ec4563a3cf70c0e59b221f)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:44.739775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:44.804339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1029/2045] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:44 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:44.805181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af5a95-97ac-4833-b94f-87b091277f5a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:44.806860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-75af5a95-97ac-4833-b94f-87b091277f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:44.849262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675ddaf008ec4563a3cf70c0e59b221f', 'request_id': 'req-82aa9492-5de5-4150-b91a-61ec9fed8e61'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:44.866110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af5a95-97ac-4833-b94f-87b091277f5a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:44.906981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675ddaf008ec4563a3cf70c0e59b221f', 'request_id': 'req-82aa9492-5de5-4150-b91a-61ec9fed8e61'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:44.914266 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675ddaf008ec4563a3cf70c0e59b221f', 'request_id': 'req-82aa9492-5de5-4150-b91a-61ec9fed8e61'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:44.914850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77526f-a934-4c01-b778-535f08382816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:44.915506 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77526f-a934-4c01-b778-535f08382816 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:44.915786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77526f-a934-4c01-b778-535f08382816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:44.916057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77526f-a934-4c01-b778-535f08382816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:44.925541 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] The token cache is being invalidate because project 675ddaf008ec4563a3cf70c0e59b221f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:44.925852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:44.926546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:44.928730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1017/2046] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:44 2022] DELETE /identity/v3/projects/675ddaf008ec4563a3cf70c0e59b221f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:44.929283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:44.931006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:44.976221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77526f-a934-4c01-b778-535f08382816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:44.977644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77526f-a934-4c01-b778-535f08382816 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:44.988637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1030/2047] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:44.994169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77526f-a934-4c01-b778-535f08382816 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:44.994169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6b77526f-a934-4c01-b778-535f08382816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:44.995469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa9492-5de5-4150-b91a-61ec9fed8e61 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:45.001050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683bc44-86a5-4c08-8967-d51199c03617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:45.001511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683bc44-86a5-4c08-8967-d51199c03617 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:45.001928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683bc44-86a5-4c08-8967-d51199c03617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:45.002229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683bc44-86a5-4c08-8967-d51199c03617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:45.002977 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683bc44-86a5-4c08-8967-d51199c03617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:45.004563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683bc44-86a5-4c08-8967-d51199c03617 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:45.005036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77526f-a934-4c01-b778-535f08382816 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:45.010804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:45.011672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:45.011987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:45.012261 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] PATH_INFO: `/v3/users/4125c0b1d9e24201942e1d86bae15ce0` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:45.013477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4125c0b1d9e24201942e1d86bae15ce0)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:45.015411 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:45.017062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1018/2048] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:45.018051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683bc44-86a5-4c08-8967-d51199c03617 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:45.019870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2683bc44-86a5-4c08-8967-d51199c03617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:45.034180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683bc44-86a5-4c08-8967-d51199c03617 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:45.041145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32de427-8082-4601-a047-779e2dcf150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:45.042171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de427-8082-4601-a047-779e2dcf150c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:45.042486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de427-8082-4601-a047-779e2dcf150c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:45.042761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de427-8082-4601-a047-779e2dcf150c admin admin] PATH_INFO: `/v3/users/2afe6839f9944fdfaeec9f065a383dae` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:45.044730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32de427-8082-4601-a047-779e2dcf150c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2afe6839f9944fdfaeec9f065a383dae)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:45.046739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32de427-8082-4601-a047-779e2dcf150c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:45.139581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:45.242993 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f32de427-8082-4601-a047-779e2dcf150c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2afe6839f9944fdfaeec9f065a383dae'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:45.243204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4125c0b1d9e24201942e1d86bae15ce0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:45.243586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f32de427-8082-4601-a047-779e2dcf150c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2afe6839f9944fdfaeec9f065a383dae'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:45.243704 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4125c0b1d9e24201942e1d86bae15ce0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:45.255248 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f32de427-8082-4601-a047-779e2dcf150c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2afe6839f9944fdfaeec9f065a383dae'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:45.318178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4125c0b1d9e24201942e1d86bae15ce0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:45.331255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4125c0b1d9e24201942e1d86bae15ce0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:45.338139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4125c0b1d9e24201942e1d86bae15ce0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:45.344255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1031/2049] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:44 2022] DELETE /identity/v3/users/4125c0b1d9e24201942e1d86bae15ce0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:45.345049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:45.346445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:45.370864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f32de427-8082-4601-a047-779e2dcf150c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2afe6839f9944fdfaeec9f065a383dae'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:45.384085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f32de427-8082-4601-a047-779e2dcf150c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2afe6839f9944fdfaeec9f065a383dae'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:45.385705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1019/2050] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:45 2022] DELETE /identity/v3/users/2afe6839f9944fdfaeec9f065a383dae => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:45.390067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5592a6-c781-4d0e-98a5-d3bd34e618c2 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:45.390470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5592a6-c781-4d0e-98a5-d3bd34e618c2 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:45.390831 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5592a6-c781-4d0e-98a5-d3bd34e618c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:45.429851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f86e8-2e67-4227-a4d4-15ab387d8d7e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:45.430364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-8f5592a6-c781-4d0e-98a5-d3bd34e618c2 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:45.431720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8f5592a6-c781-4d0e-98a5-d3bd34e618c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:45.495186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614d078-2dd7-4aaf-ab14-720e82f66414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:45.496374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614d078-2dd7-4aaf-ab14-720e82f66414 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:45.496669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614d078-2dd7-4aaf-ab14-720e82f66414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:45.496946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614d078-2dd7-4aaf-ab14-720e82f66414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:45.497693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614d078-2dd7-4aaf-ab14-720e82f66414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:45.499945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614d078-2dd7-4aaf-ab14-720e82f66414 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:45.515343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1032/2051] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:45.517128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614d078-2dd7-4aaf-ab14-720e82f66414 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:45.528272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1020/2052] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:45.537445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614d078-2dd7-4aaf-ab14-720e82f66414 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:45.537582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5592a6-c781-4d0e-98a5-d3bd34e618c2 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:45.539546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8f5592a6-c781-4d0e-98a5-d3bd34e618c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:45.543262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bbea9-a410-4b55-9df0-24c5106b739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:45.544162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bbea9-a410-4b55-9df0-24c5106b739b admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:45.544447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bbea9-a410-4b55-9df0-24c5106b739b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:45.544721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bbea9-a410-4b55-9df0-24c5106b739b admin admin] PATH_INFO: `/v3/projects/2c2a51a4ac7e425ea0e4dc0067024520/users/d89fede014d94157aeaeebbbceac28a7/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:45.559802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bbea9-a410-4b55-9df0-24c5106b739b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2a51a4ac7e425ea0e4dc0067024520, user_id=d89fede014d94157aeaeebbbceac28a7, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:45.562503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bbea9-a410-4b55-9df0-24c5106b739b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:45.599438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5592a6-c781-4d0e-98a5-d3bd34e618c2 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:45.603746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172e285-436a-464a-b14e-1fb72568ae18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:45.604408 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172e285-436a-464a-b14e-1fb72568ae18 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:45.604695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172e285-436a-464a-b14e-1fb72568ae18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:45.604973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172e285-436a-464a-b14e-1fb72568ae18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:45.620073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172e285-436a-464a-b14e-1fb72568ae18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:45.620361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172e285-436a-464a-b14e-1fb72568ae18 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:45.632611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1021/2053] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:47:45.667129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1033/2054] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:45 2022] PUT /identity/v3/projects/2c2a51a4ac7e425ea0e4dc0067024520/users/d89fede014d94157aeaeebbbceac28a7/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:45.673031 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dafd5-3e43-4a18-9b8b-b4d3629d0aa6 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:45.674778 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dafd5-3e43-4a18-9b8b-b4d3629d0aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:45.674986 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dafd5-3e43-4a18-9b8b-b4d3629d0aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:45.704166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b82dafd5-3e43-4a18-9b8b-b4d3629d0aa6 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:45.705862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b82dafd5-3e43-4a18-9b8b-b4d3629d0aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:45.784178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:45.793983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1022/2055] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:45.809050 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bbea9-a410-4b55-9df0-24c5106b739b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:45.877580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bbea9-a410-4b55-9df0-24c5106b739b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:45.882619 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76fef2-7fde-4888-a276-69bb7c0a441e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:45.883279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76fef2-7fde-4888-a276-69bb7c0a441e service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:45.883567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76fef2-7fde-4888-a276-69bb7c0a441e service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:45.883913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76fef2-7fde-4888-a276-69bb7c0a441e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:45.894522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76fef2-7fde-4888-a276-69bb7c0a441e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:45.895999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76fef2-7fde-4888-a276-69bb7c0a441e service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:45.907462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1034/2056] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:46.066524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dafd5-3e43-4a18-9b8b-b4d3629d0aa6 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:46.067964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b82dafd5-3e43-4a18-9b8b-b4d3629d0aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:46.081251 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dafd5-3e43-4a18-9b8b-b4d3629d0aa6 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:46.092303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:46.092303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:46.092303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:46.092303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] PATH_INFO: `/v3/projects/a7668a39790e4115a09e74a2aee73871` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:46.092601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7668a39790e4115a09e74a2aee73871)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:46.093146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:46.290902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7668a39790e4115a09e74a2aee73871', 'request_id': 'req-25f0876e-9d93-4b11-870c-fda66af11d2c'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:46.372593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76fef2-7fde-4888-a276-69bb7c0a441e service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:46.374224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5d76fef2-7fde-4888-a276-69bb7c0a441e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:46.383937 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7668a39790e4115a09e74a2aee73871', 'request_id': 'req-25f0876e-9d93-4b11-870c-fda66af11d2c'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:46.392190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76fef2-7fde-4888-a276-69bb7c0a441e service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:46.393584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7668a39790e4115a09e74a2aee73871', 'request_id': 'req-25f0876e-9d93-4b11-870c-fda66af11d2c'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:46.405020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] The token cache is being invalidate because project a7668a39790e4115a09e74a2aee73871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:46.405310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:46.406672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-25f0876e-9d93-4b11-870c-fda66af11d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:46.412880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1023/2057] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:46 2022] DELETE /identity/v3/projects/a7668a39790e4115a09e74a2aee73871 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:46.418429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfcf45-4f9b-4cf1-9108-98ec6a46f063 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:46.422643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfcf45-4f9b-4cf1-9108-98ec6a46f063 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:46.422643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfcf45-4f9b-4cf1-9108-98ec6a46f063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:46.453726 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-7ebfcf45-4f9b-4cf1-9108-98ec6a46f063 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:46.455015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7ebfcf45-4f9b-4cf1-9108-98ec6a46f063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:46.464911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:46.465781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:46.467220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:46.467220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] PATH_INFO: `/v3/projects/70140477eae741eb8eacb1617fc0637b` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:46.467864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=70140477eae741eb8eacb1617fc0637b)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:46.470053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:46.517694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1024/2058] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:46.525406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66eb8f-8368-4ad9-b417-438413a7f8be None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:46.525703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66eb8f-8368-4ad9-b417-438413a7f8be None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:46.525983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66eb8f-8368-4ad9-b417-438413a7f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:46.543400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-bc66eb8f-8368-4ad9-b417-438413a7f8be None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:46.544637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-bc66eb8f-8368-4ad9-b417-438413a7f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:46.552837 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1025/2059] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:46.557345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66eb8f-8368-4ad9-b417-438413a7f8be None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:46.566194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66eb8f-8368-4ad9-b417-438413a7f8be None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:46.571467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a639b52-614f-4b8e-aeba-d545fdccda1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:46.572360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a639b52-614f-4b8e-aeba-d545fdccda1d admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:46.572642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a639b52-614f-4b8e-aeba-d545fdccda1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:46.572918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a639b52-614f-4b8e-aeba-d545fdccda1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:46.573631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a639b52-614f-4b8e-aeba-d545fdccda1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:46.573989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a639b52-614f-4b8e-aeba-d545fdccda1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:46.575608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a639b52-614f-4b8e-aeba-d545fdccda1d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:46.587045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1026/2060] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:47:46.591156 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a639b52-614f-4b8e-aeba-d545fdccda1d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:46.600717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a639b52-614f-4b8e-aeba-d545fdccda1d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:46.605284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e1526-2402-4623-8de8-27e399946e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:46.605926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1526-2402-4623-8de8-27e399946e30 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:46.606205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1526-2402-4623-8de8-27e399946e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:46.606513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1526-2402-4623-8de8-27e399946e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:46.607195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e1526-2402-4623-8de8-27e399946e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:46.609131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e1526-2402-4623-8de8-27e399946e30 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:46.656769 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70140477eae741eb8eacb1617fc0637b', 'request_id': 'req-2aef203a-74ed-45b4-8cc6-e07204749fef'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:46.726035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:46.734677 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1027/2061] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:46 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:46.742697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e1526-2402-4623-8de8-27e399946e30 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:46.765652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70140477eae741eb8eacb1617fc0637b', 'request_id': 'req-2aef203a-74ed-45b4-8cc6-e07204749fef'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:46.775352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70140477eae741eb8eacb1617fc0637b', 'request_id': 'req-2aef203a-74ed-45b4-8cc6-e07204749fef'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:46.812384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] The token cache is being invalidate because project 70140477eae741eb8eacb1617fc0637b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:46.812384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:46.812384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2aef203a-74ed-45b4-8cc6-e07204749fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:46.812384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1035/2062] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:46 2022] DELETE /identity/v3/projects/70140477eae741eb8eacb1617fc0637b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:46.812384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df6c8-9572-43e2-afec-a3e11c62e1c1 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:46.812944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df6c8-9572-43e2-afec-a3e11c62e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:46.812944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df6c8-9572-43e2-afec-a3e11c62e1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:46.815972 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e1526-2402-4623-8de8-27e399946e30 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:46.821640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05437cd6-d91a-4785-89e4-a13cb0293d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:46.822586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05437cd6-d91a-4785-89e4-a13cb0293d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:46.822874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05437cd6-d91a-4785-89e4-a13cb0293d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:46.825301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05437cd6-d91a-4785-89e4-a13cb0293d1e admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:46.826035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05437cd6-d91a-4785-89e4-a13cb0293d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:46.828569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05437cd6-d91a-4785-89e4-a13cb0293d1e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:46.832806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a43df6c8-9572-43e2-afec-a3e11c62e1c1 None None] MFA Rules not processed for user `f19592c32cea4fabaa7301b099bac14b`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:46.834656 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a43df6c8-9572-43e2-afec-a3e11c62e1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:46.897615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1036/2063] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:46.898689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43df6c8-9572-43e2-afec-a3e11c62e1c1 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:46.902987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a43df6c8-9572-43e2-afec-a3e11c62e1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:46.917721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43df6c8-9572-43e2-afec-a3e11c62e1c1 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:46.921529 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1028/2064] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:46 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:46.923965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:46.924858 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:46.925148 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:46.925536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] PATH_INFO: `/v3/users/e0488abac5344c2fb2a92bc4b22b2b26` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:46.926986 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05437cd6-d91a-4785-89e4-a13cb0293d1e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:46.927179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0488abac5344c2fb2a92bc4b22b2b26)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:46.929851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:46.930043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-05437cd6-d91a-4785-89e4-a13cb0293d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:46.964436 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05437cd6-d91a-4785-89e4-a13cb0293d1e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:46.969731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004aaae-795b-4ace-bc2c-a7a0b23a1708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:46.970494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004aaae-795b-4ace-bc2c-a7a0b23a1708 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:46.973091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004aaae-795b-4ace-bc2c-a7a0b23a1708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:46.973091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004aaae-795b-4ace-bc2c-a7a0b23a1708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:46.973091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004aaae-795b-4ace-bc2c-a7a0b23a1708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:46.973858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004aaae-795b-4ace-bc2c-a7a0b23a1708 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:46.989424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1029/2065] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:46.994891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004aaae-795b-4ace-bc2c-a7a0b23a1708 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:47.004899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004aaae-795b-4ace-bc2c-a7a0b23a1708 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:47.010075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34996d01-86b1-4e06-a2b4-47e0c825bd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:47.010917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34996d01-86b1-4e06-a2b4-47e0c825bd8a admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:47.011203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34996d01-86b1-4e06-a2b4-47e0c825bd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:47.011484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34996d01-86b1-4e06-a2b4-47e0c825bd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:47.012224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34996d01-86b1-4e06-a2b4-47e0c825bd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:47.013994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34996d01-86b1-4e06-a2b4-47e0c825bd8a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:47.029171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1030/2066] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:47.031078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34996d01-86b1-4e06-a2b4-47e0c825bd8a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:47.043358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34996d01-86b1-4e06-a2b4-47e0c825bd8a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:47.050708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4abc0-8a07-4fc3-9425-729986f3c2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:47.051945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4abc0-8a07-4fc3-9425-729986f3c2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:47.052289 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4abc0-8a07-4fc3-9425-729986f3c2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:47.052630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4abc0-8a07-4fc3-9425-729986f3c2a5 admin admin] PATH_INFO: `/v3/projects/205238d4cb1a41f4b081826a79083124/users/3529dcdbde024997a361df6e3b253589/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:47.070181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4abc0-8a07-4fc3-9425-729986f3c2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=205238d4cb1a41f4b081826a79083124, user_id=3529dcdbde024997a361df6e3b253589, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:47.073358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4abc0-8a07-4fc3-9425-729986f3c2a5 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:47.116094 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0488abac5344c2fb2a92bc4b22b2b26'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:47.116783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0488abac5344c2fb2a92bc4b22b2b26'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:47.188212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0488abac5344c2fb2a92bc4b22b2b26'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:47.196667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1031/2067] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:47 2022] PUT /identity/v3/projects/205238d4cb1a41f4b081826a79083124/users/3529dcdbde024997a361df6e3b253589/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:47.202227 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653fcb-cce8-44ad-a70f-7c951244f52f None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:47.203217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653fcb-cce8-44ad-a70f-7c951244f52f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:47.204459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653fcb-cce8-44ad-a70f-7c951244f52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:47.206417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0488abac5344c2fb2a92bc4b22b2b26'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:47.222024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0488abac5344c2fb2a92bc4b22b2b26'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:47.232349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a2653fcb-cce8-44ad-a70f-7c951244f52f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:47.233999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1037/2068] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:46 2022] DELETE /identity/v3/users/e0488abac5344c2fb2a92bc4b22b2b26 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:47.235073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a2653fcb-cce8-44ad-a70f-7c951244f52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:47.241887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:47.301672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1032/2069] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:47.311528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:47.313094 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:47.372184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8694-b440-49e4-a710-3bbac149e121 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:47.375980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a9810-b960-4119-886c-e1be021f0970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:47.376698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9810-b960-4119-886c-e1be021f0970 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:47.377045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9810-b960-4119-886c-e1be021f0970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:47.377385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9810-b960-4119-886c-e1be021f0970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:47.387659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a9810-b960-4119-886c-e1be021f0970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:47.389897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a9810-b960-4119-886c-e1be021f0970 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:47.399601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1038/2070] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:47.880680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2653fcb-cce8-44ad-a70f-7c951244f52f None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:47.882730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a2653fcb-cce8-44ad-a70f-7c951244f52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:47.894688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2653fcb-cce8-44ad-a70f-7c951244f52f None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:47.901048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:47.901048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:47.901048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:47.901343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] PATH_INFO: `/v3/projects/216061c9fdd049e984eece6f54bd6f62` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:47.902557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216061c9fdd049e984eece6f54bd6f62)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:47.904568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:48.031303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216061c9fdd049e984eece6f54bd6f62', 'request_id': 'req-b336d615-46e4-4c2e-897f-86827e7bcb24'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:48.132829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216061c9fdd049e984eece6f54bd6f62', 'request_id': 'req-b336d615-46e4-4c2e-897f-86827e7bcb24'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:48.145561 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216061c9fdd049e984eece6f54bd6f62', 'request_id': 'req-b336d615-46e4-4c2e-897f-86827e7bcb24'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:48.171167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] The token cache is being invalidate because project 216061c9fdd049e984eece6f54bd6f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:48.171299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:48.172593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b336d615-46e4-4c2e-897f-86827e7bcb24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:48.175071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1033/2071] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:47 2022] DELETE /identity/v3/projects/216061c9fdd049e984eece6f54bd6f62 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:48.181420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf763c9-b864-4a83-a112-61801fdd7359 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:48.181847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf763c9-b864-4a83-a112-61801fdd7359 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:48.182626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf763c9-b864-4a83-a112-61801fdd7359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:48.222634 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:48.242134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-bdf763c9-b864-4a83-a112-61801fdd7359 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:48.244270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-bdf763c9-b864-4a83-a112-61801fdd7359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:48.320869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1039/2072] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:48.329745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2aae-1bb0-4735-be8a-cdf874cae930 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:48.330111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2aae-1bb0-4735-be8a-cdf874cae930 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:48.330501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2aae-1bb0-4735-be8a-cdf874cae930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:48.364984 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-1d4e2aae-1bb0-4735-be8a-cdf874cae930 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:48.364984 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1d4e2aae-1bb0-4735-be8a-cdf874cae930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:48.395246 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1034/2073] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:48.400468 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf763c9-b864-4a83-a112-61801fdd7359 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:48.414065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf763c9-b864-4a83-a112-61801fdd7359 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:48.430965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d93d0-4f4d-4864-9668-49aa9e40573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:48.431715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d93d0-4f4d-4864-9668-49aa9e40573a admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:48.432008 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d93d0-4f4d-4864-9668-49aa9e40573a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:48.432285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d93d0-4f4d-4864-9668-49aa9e40573a admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:48.436835 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d93d0-4f4d-4864-9668-49aa9e40573a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:48.437199 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d93d0-4f4d-4864-9668-49aa9e40573a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:48.438939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d93d0-4f4d-4864-9668-49aa9e40573a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:48.467675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1040/2074] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:48.469546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e2aae-1bb0-4735-be8a-cdf874cae930 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:48.480232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e2aae-1bb0-4735-be8a-cdf874cae930 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:48.491233 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe60edc-4087-40ac-8815-2b016be93c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:48.492060 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe60edc-4087-40ac-8815-2b016be93c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:48.492222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe60edc-4087-40ac-8815-2b016be93c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:48.492469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe60edc-4087-40ac-8815-2b016be93c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:48.493355 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe60edc-4087-40ac-8815-2b016be93c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:48.495854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe60edc-4087-40ac-8815-2b016be93c15 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:48.590873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1035/2075] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:48 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:48.594986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d93d0-4f4d-4864-9668-49aa9e40573a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:48.609027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d93d0-4f4d-4864-9668-49aa9e40573a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:48.699775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfa732-7ba0-44b2-96f3-fb30a27b035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:48.700456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa732-7ba0-44b2-96f3-fb30a27b035f admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:48.700743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa732-7ba0-44b2-96f3-fb30a27b035f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:48.701023 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa732-7ba0-44b2-96f3-fb30a27b035f admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:48.701717 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfa732-7ba0-44b2-96f3-fb30a27b035f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:48.703824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfa732-7ba0-44b2-96f3-fb30a27b035f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:48.861429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1041/2076] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:48 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:48.866760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe60edc-4087-40ac-8815-2b016be93c15 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:48.882828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe60edc-4087-40ac-8815-2b016be93c15 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:48.889063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760f13e-fd95-454d-994d-11b1484d5b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:48.889868 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760f13e-fd95-454d-994d-11b1484d5b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:48.890163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760f13e-fd95-454d-994d-11b1484d5b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:48.890547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760f13e-fd95-454d-994d-11b1484d5b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:48.891513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760f13e-fd95-454d-994d-11b1484d5b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:48.893362 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760f13e-fd95-454d-994d-11b1484d5b02 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:48.910312 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1036/2077] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:48.916078 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfa732-7ba0-44b2-96f3-fb30a27b035f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:48.929560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfa732-7ba0-44b2-96f3-fb30a27b035f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:48.936887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007bfe-01ad-42a8-82ed-71fcf2e8d5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:48.937590 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007bfe-01ad-42a8-82ed-71fcf2e8d5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:48.937878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007bfe-01ad-42a8-82ed-71fcf2e8d5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:48.939097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007bfe-01ad-42a8-82ed-71fcf2e8d5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:48.945273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7007bfe-01ad-42a8-82ed-71fcf2e8d5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:48.957423 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7007bfe-01ad-42a8-82ed-71fcf2e8d5e9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:48.994330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1042/2078] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:48.997482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760f13e-fd95-454d-994d-11b1484d5b02 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:49.009989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760f13e-fd95-454d-994d-11b1484d5b02 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:49.018230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79019b-92e5-404d-a5fa-86b7bd441dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:49.019759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79019b-92e5-404d-a5fa-86b7bd441dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:49.020531 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79019b-92e5-404d-a5fa-86b7bd441dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:49.021048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79019b-92e5-404d-a5fa-86b7bd441dbe admin admin] PATH_INFO: `/v3/projects/2e887955a08643a2a535a385d38384f0/users/551a8926e5864266948a02ea99e8758a/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:49.041512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79019b-92e5-404d-a5fa-86b7bd441dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e887955a08643a2a535a385d38384f0, user_id=551a8926e5864266948a02ea99e8758a, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:49.044814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79019b-92e5-404d-a5fa-86b7bd441dbe admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:49.057345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:49.123433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1037/2079] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:48 2022] PUT /identity/v3/projects/2e887955a08643a2a535a385d38384f0/users/551a8926e5864266948a02ea99e8758a/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:49.127358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b14ddc-63b8-4e92-8b59-aacacab6894c None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:49.127958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b14ddc-63b8-4e92-8b59-aacacab6894c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:49.127958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b14ddc-63b8-4e92-8b59-aacacab6894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:49.158397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-d1b14ddc-63b8-4e92-8b59-aacacab6894c None None] MFA Rules not processed for user `551a8926e5864266948a02ea99e8758a`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:49.159616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d1b14ddc-63b8-4e92-8b59-aacacab6894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:49.231563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1043/2080] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:49.236497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79019b-92e5-404d-a5fa-86b7bd441dbe admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:49.271108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ead5-6c26-4d71-86a1-a65fa8160e86 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:49.271417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ead5-6c26-4d71-86a1-a65fa8160e86 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:49.271725 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ead5-6c26-4d71-86a1-a65fa8160e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:49.319905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79019b-92e5-404d-a5fa-86b7bd441dbe admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:49.324727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-fcb3ead5-6c26-4d71-86a1-a65fa8160e86 None None] MFA Rules not processed for user `3529dcdbde024997a361df6e3b253589`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:49.326007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb537b2-cd99-4859-83d3-9ab404489002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:49.326171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fcb3ead5-6c26-4d71-86a1-a65fa8160e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:49.326931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb537b2-cd99-4859-83d3-9ab404489002 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:49.327126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb537b2-cd99-4859-83d3-9ab404489002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:49.327364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb537b2-cd99-4859-83d3-9ab404489002 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:49.328065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb537b2-cd99-4859-83d3-9ab404489002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:49.329999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb537b2-cd99-4859-83d3-9ab404489002 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:49.422017 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1044/2081] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:49.423002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3ead5-6c26-4d71-86a1-a65fa8160e86 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:49.424866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fcb3ead5-6c26-4d71-86a1-a65fa8160e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:49.434447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1038/2082] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:49 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:49.440578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3ead5-6c26-4d71-86a1-a65fa8160e86 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:49.441003 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb537b2-cd99-4859-83d3-9ab404489002 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:49.537243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930827d3-c40f-48f9-aece-73ef5e525a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:49.537976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930827d3-c40f-48f9-aece-73ef5e525a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:49.538458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930827d3-c40f-48f9-aece-73ef5e525a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:49.538743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930827d3-c40f-48f9-aece-73ef5e525a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:49.539504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930827d3-c40f-48f9-aece-73ef5e525a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:49.542095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930827d3-c40f-48f9-aece-73ef5e525a61 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:49.547768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb537b2-cd99-4859-83d3-9ab404489002 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:49.552691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8b85-7d4d-4ca1-b865-9a4e145d9831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:49.554098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8b85-7d4d-4ca1-b865-9a4e145d9831 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:49.560001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8b85-7d4d-4ca1-b865-9a4e145d9831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:49.560299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8b85-7d4d-4ca1-b865-9a4e145d9831 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:49.561034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b8b85-7d4d-4ca1-b865-9a4e145d9831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:49.563191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b8b85-7d4d-4ca1-b865-9a4e145d9831 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:49.663463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1039/2083] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:49 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:49.663662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1045/2084] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:49 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:49.664683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8b85-7d4d-4ca1-b865-9a4e145d9831 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:49.668063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930827d3-c40f-48f9-aece-73ef5e525a61 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:49.684739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8b85-7d4d-4ca1-b865-9a4e145d9831 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:49.760082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffe488-a1ab-40bf-8fe6-f44265f10cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:49.760763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffe488-a1ab-40bf-8fe6-f44265f10cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:49.761048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffe488-a1ab-40bf-8fe6-f44265f10cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:49.761289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930827d3-c40f-48f9-aece-73ef5e525a61 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:49.761398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffe488-a1ab-40bf-8fe6-f44265f10cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:49.762111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffe488-a1ab-40bf-8fe6-f44265f10cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:49.763970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffe488-a1ab-40bf-8fe6-f44265f10cc5 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:49.767171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacc9ee-4e61-4204-9e2b-57eb46d983e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:49.767931 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc9ee-4e61-4204-9e2b-57eb46d983e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:49.768450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc9ee-4e61-4204-9e2b-57eb46d983e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:49.768450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc9ee-4e61-4204-9e2b-57eb46d983e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:49.770140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacc9ee-4e61-4204-9e2b-57eb46d983e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:49.771575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacc9ee-4e61-4204-9e2b-57eb46d983e3 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:49.776595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1040/2085] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:49.780779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffe488-a1ab-40bf-8fe6-f44265f10cc5 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:49.794031 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffe488-a1ab-40bf-8fe6-f44265f10cc5 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:49.799023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a38204-820e-4fb8-b5b8-27d80ed33867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:49.800306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a38204-820e-4fb8-b5b8-27d80ed33867 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:49.800306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a38204-820e-4fb8-b5b8-27d80ed33867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:49.800479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a38204-820e-4fb8-b5b8-27d80ed33867 admin admin] PATH_INFO: `/v3/projects/8b8a3c0a84c645e1a602e78de6837cc5/users/692ba079b4f74c7c92719bd5afcdd968/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:49.817353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a38204-820e-4fb8-b5b8-27d80ed33867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8a3c0a84c645e1a602e78de6837cc5, user_id=692ba079b4f74c7c92719bd5afcdd968, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:49.820137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a38204-820e-4fb8-b5b8-27d80ed33867 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:49.911092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1046/2086] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:49 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:49.915812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacc9ee-4e61-4204-9e2b-57eb46d983e3 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:49.920013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1041/2087] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:49 2022] PUT /identity/v3/projects/8b8a3c0a84c645e1a602e78de6837cc5/users/692ba079b4f74c7c92719bd5afcdd968/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:49.923365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a38204-820e-4fb8-b5b8-27d80ed33867 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:49.930208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacc9ee-4e61-4204-9e2b-57eb46d983e3 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:50.032124 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cc07c-0b11-4f0a-9ddb-ed082726d92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:50.032970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc07c-0b11-4f0a-9ddb-ed082726d92a admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:50.050124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a38204-820e-4fb8-b5b8-27d80ed33867 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:50.062412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bc714-076b-4ce7-96fc-56a5ad793446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:50.064843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc07c-0b11-4f0a-9ddb-ed082726d92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:50.065557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc07c-0b11-4f0a-9ddb-ed082726d92a admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:50.066290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bc714-076b-4ce7-96fc-56a5ad793446 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:50.066621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bc714-076b-4ce7-96fc-56a5ad793446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:50.067046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bc714-076b-4ce7-96fc-56a5ad793446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:50.067827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bc714-076b-4ce7-96fc-56a5ad793446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:50.069515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bc714-076b-4ce7-96fc-56a5ad793446 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:50.073354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cc07c-0b11-4f0a-9ddb-ed082726d92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:50.075028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cc07c-0b11-4f0a-9ddb-ed082726d92a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:50.089941 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1047/2088] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:50.094107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cc07c-0b11-4f0a-9ddb-ed082726d92a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:50.115759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1042/2089] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:50.129350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cc07c-0b11-4f0a-9ddb-ed082726d92a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:50.132644 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bc714-076b-4ce7-96fc-56a5ad793446 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:50.144897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a4b88-de76-412b-a20d-fdd88e73616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:50.152454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4b88-de76-412b-a20d-fdd88e73616f admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:50.152454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4b88-de76-412b-a20d-fdd88e73616f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:50.152454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4b88-de76-412b-a20d-fdd88e73616f admin admin] PATH_INFO: `/v3/projects/0850a6583ceb4178a975fb89616c3c12/users/8f453537049340b4946a058eb49eab50/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:50.154106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bc714-076b-4ce7-96fc-56a5ad793446 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:50.169932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c5535-659e-41a0-b1cd-39a835ff884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:50.170888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c5535-659e-41a0-b1cd-39a835ff884c admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:50.171207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c5535-659e-41a0-b1cd-39a835ff884c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:50.171492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c5535-659e-41a0-b1cd-39a835ff884c admin admin] PATH_INFO: `/v3/projects/8b8a3c0a84c645e1a602e78de6837cc5/users/692ba079b4f74c7c92719bd5afcdd968/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:50.175647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c5535-659e-41a0-b1cd-39a835ff884c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8a3c0a84c645e1a602e78de6837cc5, user_id=692ba079b4f74c7c92719bd5afcdd968, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:50.178468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c5535-659e-41a0-b1cd-39a835ff884c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:50.183159 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a4b88-de76-412b-a20d-fdd88e73616f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0850a6583ceb4178a975fb89616c3c12, user_id=8f453537049340b4946a058eb49eab50, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:50.185929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a4b88-de76-412b-a20d-fdd88e73616f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:50.202658 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1043/2090] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:50 2022] PUT /identity/v3/projects/8b8a3c0a84c645e1a602e78de6837cc5/users/692ba079b4f74c7c92719bd5afcdd968/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:50.233194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d19fd-7380-479e-a65f-09407a8a3198 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:50.233560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d19fd-7380-479e-a65f-09407a8a3198 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:50.233850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d19fd-7380-479e-a65f-09407a8a3198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:50.275800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ba2d19fd-7380-479e-a65f-09407a8a3198 None None] MFA Rules not processed for user `692ba079b4f74c7c92719bd5afcdd968`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:50.277074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ba2d19fd-7380-479e-a65f-09407a8a3198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:50.298812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1048/2091] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:50 2022] PUT /identity/v3/projects/0850a6583ceb4178a975fb89616c3c12/users/8f453537049340b4946a058eb49eab50/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:47:50.303288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a4b88-de76-412b-a20d-fdd88e73616f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:50.344443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:50.387896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a4b88-de76-412b-a20d-fdd88e73616f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:50.394000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af512a4f-8193-4603-9502-b34a31ecb0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:50.394708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512a4f-8193-4603-9502-b34a31ecb0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:50.395864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512a4f-8193-4603-9502-b34a31ecb0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:50.395864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512a4f-8193-4603-9502-b34a31ecb0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:50.396293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af512a4f-8193-4603-9502-b34a31ecb0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:50.398649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af512a4f-8193-4603-9502-b34a31ecb0eb admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:50.409100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1044/2092] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:50.411485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1049/2093] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:50.418065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d19fd-7380-479e-a65f-09407a8a3198 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:50.432611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af512a4f-8193-4603-9502-b34a31ecb0eb admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:50.435231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-af512a4f-8193-4603-9502-b34a31ecb0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:50.513199 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af512a4f-8193-4603-9502-b34a31ecb0eb admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:50.520856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a754b2c-66da-4120-98a5-ec8acae88aac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:50.523066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a754b2c-66da-4120-98a5-ec8acae88aac service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:50.523424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a754b2c-66da-4120-98a5-ec8acae88aac service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:50.525675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a754b2c-66da-4120-98a5-ec8acae88aac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:50.574478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d19fd-7380-479e-a65f-09407a8a3198 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:50.587117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e95d8c-ed35-4b24-aa15-37b5b3044731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:50.588069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95d8c-ed35-4b24-aa15-37b5b3044731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:50.588355 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95d8c-ed35-4b24-aa15-37b5b3044731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:50.588635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95d8c-ed35-4b24-aa15-37b5b3044731 admin admin] PATH_INFO: `/v3/projects/0850a6583ceb4178a975fb89616c3c12/users/8f453537049340b4946a058eb49eab50/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:50.591016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e95d8c-ed35-4b24-aa15-37b5b3044731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0850a6583ceb4178a975fb89616c3c12, user_id=8f453537049340b4946a058eb49eab50, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:50.593897 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e95d8c-ed35-4b24-aa15-37b5b3044731 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:50.620024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1045/2094] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:50 2022] PUT /identity/v3/projects/0850a6583ceb4178a975fb89616c3c12/users/8f453537049340b4946a058eb49eab50/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:50.651466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a754b2c-66da-4120-98a5-ec8acae88aac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:50.655649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a754b2c-66da-4120-98a5-ec8acae88aac service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:50.667807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1050/2095] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:50.861556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e95d8c-ed35-4b24-aa15-37b5b3044731 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:50.941923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e95d8c-ed35-4b24-aa15-37b5b3044731 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:50.946624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d9c06-294e-4fc1-a3cb-2000d8bda935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:50.947826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d9c06-294e-4fc1-a3cb-2000d8bda935 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:50.948170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d9c06-294e-4fc1-a3cb-2000d8bda935 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:50.948517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d9c06-294e-4fc1-a3cb-2000d8bda935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:51.083920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d9c06-294e-4fc1-a3cb-2000d8bda935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:51.085437 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d9c06-294e-4fc1-a3cb-2000d8bda935 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:51.106965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1046/2096] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:51.666172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:51.780535 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a754b2c-66da-4120-98a5-ec8acae88aac service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:51.792155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a754b2c-66da-4120-98a5-ec8acae88aac service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:51.874877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d9c06-294e-4fc1-a3cb-2000d8bda935 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:51.879056 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d56d9c06-294e-4fc1-a3cb-2000d8bda935 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:51.886667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391581b-ba6a-4540-ba97-2408abecf052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:51.889313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391581b-ba6a-4540-ba97-2408abecf052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:51.892205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391581b-ba6a-4540-ba97-2408abecf052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:51.892711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391581b-ba6a-4540-ba97-2408abecf052 admin admin] PATH_INFO: `/v3/users/551a8926e5864266948a02ea99e8758a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:51.896552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391581b-ba6a-4540-ba97-2408abecf052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=551a8926e5864266948a02ea99e8758a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:51.907194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391581b-ba6a-4540-ba97-2408abecf052 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:51.921707 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d9c06-294e-4fc1-a3cb-2000d8bda935 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:51.929156 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77767c16-998b-41e8-9d13-8d765c403e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:51.930683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767c16-998b-41e8-9d13-8d765c403e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:51.931590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767c16-998b-41e8-9d13-8d765c403e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:51.932168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767c16-998b-41e8-9d13-8d765c403e98 admin admin] PATH_INFO: `/v3/users/f14c83df07ca4e84a2323ba5948d5bf6` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:51.934791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77767c16-998b-41e8-9d13-8d765c403e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14c83df07ca4e84a2323ba5948d5bf6)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:51.936887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77767c16-998b-41e8-9d13-8d765c403e98 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:52.160173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d391581b-ba6a-4540-ba97-2408abecf052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551a8926e5864266948a02ea99e8758a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:52.160875 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d391581b-ba6a-4540-ba97-2408abecf052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551a8926e5864266948a02ea99e8758a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:52.209873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-77767c16-998b-41e8-9d13-8d765c403e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14c83df07ca4e84a2323ba5948d5bf6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:52.213262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-77767c16-998b-41e8-9d13-8d765c403e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14c83df07ca4e84a2323ba5948d5bf6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:52.228666 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-77767c16-998b-41e8-9d13-8d765c403e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14c83df07ca4e84a2323ba5948d5bf6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:52.274029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d391581b-ba6a-4540-ba97-2408abecf052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551a8926e5864266948a02ea99e8758a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:52.293963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d391581b-ba6a-4540-ba97-2408abecf052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551a8926e5864266948a02ea99e8758a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:52.303429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d391581b-ba6a-4540-ba97-2408abecf052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551a8926e5864266948a02ea99e8758a'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:52.312176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1051/2097] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:51 2022] DELETE /identity/v3/users/551a8926e5864266948a02ea99e8758a => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:52.317498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b5656-56a3-4dbf-b2e3-3437ba6b0c84 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:52.319298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b5656-56a3-4dbf-b2e3-3437ba6b0c84 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:52.324841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b5656-56a3-4dbf-b2e3-3437ba6b0c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:52.343553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:52.348179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0a8b5656-56a3-4dbf-b2e3-3437ba6b0c84 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:52.353156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0a8b5656-56a3-4dbf-b2e3-3437ba6b0c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:52.370948 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-77767c16-998b-41e8-9d13-8d765c403e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14c83df07ca4e84a2323ba5948d5bf6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:52.379835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-77767c16-998b-41e8-9d13-8d765c403e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14c83df07ca4e84a2323ba5948d5bf6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:52.403957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1047/2098] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:51 2022] DELETE /identity/v3/users/f14c83df07ca4e84a2323ba5948d5bf6 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:52.407362 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3821ae-10d7-40f1-a721-82c198a5cea6 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:52.407793 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3821ae-10d7-40f1-a721-82c198a5cea6 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:52.408179 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3821ae-10d7-40f1-a721-82c198a5cea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:52.432354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1052/2099] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:52.436112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-3a3821ae-10d7-40f1-a721-82c198a5cea6 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:52.437343 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3a3821ae-10d7-40f1-a721-82c198a5cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:52.458907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b5656-56a3-4dbf-b2e3-3437ba6b0c84 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:52.468356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0a8b5656-56a3-4dbf-b2e3-3437ba6b0c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:52.570092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b5656-56a3-4dbf-b2e3-3437ba6b0c84 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:52.594812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1048/2100] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:52.622043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3821ae-10d7-40f1-a721-82c198a5cea6 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:52.626777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3a3821ae-10d7-40f1-a721-82c198a5cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:52.692322 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecce56-ada6-46aa-be7f-0d13c8ab5f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:52.693403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecce56-ada6-46aa-be7f-0d13c8ab5f62 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:52.694115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecce56-ada6-46aa-be7f-0d13c8ab5f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:52.694115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecce56-ada6-46aa-be7f-0d13c8ab5f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:52.709630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecce56-ada6-46aa-be7f-0d13c8ab5f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:52.712075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecce56-ada6-46aa-be7f-0d13c8ab5f62 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:52.728218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1053/2101] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:52.768727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3821ae-10d7-40f1-a721-82c198a5cea6 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:52.794298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cd3b4-2f6c-4e29-804c-99f83ac9c36d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:52.801297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cd3b4-2f6c-4e29-804c-99f83ac9c36d service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:52.801994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cd3b4-2f6c-4e29-804c-99f83ac9c36d service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:52.802447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cd3b4-2f6c-4e29-804c-99f83ac9c36d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:52.822857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474cd3b4-2f6c-4e29-804c-99f83ac9c36d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:52.824325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474cd3b4-2f6c-4e29-804c-99f83ac9c36d service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:52.839720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1049/2102] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:52.959897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d60f-01a1-450c-9fb5-93e11fba06df None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:52.960405 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d60f-01a1-450c-9fb5-93e11fba06df None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:52.960481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d60f-01a1-450c-9fb5-93e11fba06df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:53.015484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-df06d60f-01a1-450c-9fb5-93e11fba06df None None] MFA Rules not processed for user `8f453537049340b4946a058eb49eab50`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:53.016897 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-df06d60f-01a1-450c-9fb5-93e11fba06df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:53.134564 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1054/2103] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:53.148523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cd3b4-2f6c-4e29-804c-99f83ac9c36d service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:53.150322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-474cd3b4-2f6c-4e29-804c-99f83ac9c36d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:53.191587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bbc1d-1d7b-4a04-aba8-b9c1101c9b1f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:53.191883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bbc1d-1d7b-4a04-aba8-b9c1101c9b1f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:53.192167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bbc1d-1d7b-4a04-aba8-b9c1101c9b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:53.231610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-166bbc1d-1d7b-4a04-aba8-b9c1101c9b1f None None] MFA Rules not processed for user `d89fede014d94157aeaeebbbceac28a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:53.233332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-166bbc1d-1d7b-4a04-aba8-b9c1101c9b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:53.260916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cd3b4-2f6c-4e29-804c-99f83ac9c36d service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:53.264660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91120531-3c84-4680-934e-30ce01680626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:53.265361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91120531-3c84-4680-934e-30ce01680626 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:53.265644 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91120531-3c84-4680-934e-30ce01680626 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:53.265918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91120531-3c84-4680-934e-30ce01680626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:53.267967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-91120531-3c84-4680-934e-30ce01680626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:53.356369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1055/2104] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:53.363898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91120531-3c84-4680-934e-30ce01680626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:53.365566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91120531-3c84-4680-934e-30ce01680626 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:53.366185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba695062-9dde-445b-a4ce-4d5d81ef22b9 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:53.366539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba695062-9dde-445b-a4ce-4d5d81ef22b9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:53.366825 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba695062-9dde-445b-a4ce-4d5d81ef22b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:53.377812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1050/2105] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:53.436799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-ba695062-9dde-445b-a4ce-4d5d81ef22b9 None None] MFA Rules not processed for user `d89fede014d94157aeaeebbbceac28a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:53.438499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ba695062-9dde-445b-a4ce-4d5d81ef22b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:53.453922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1056/2106] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:53.464433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91120531-3c84-4680-934e-30ce01680626 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:53.467878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-91120531-3c84-4680-934e-30ce01680626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:53.594520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:53.627640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91120531-3c84-4680-934e-30ce01680626 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:53.635203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3330652-dd9d-4c85-8eb8-292b48c0b745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:53.635899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330652-dd9d-4c85-8eb8-292b48c0b745 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:53.636189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330652-dd9d-4c85-8eb8-292b48c0b745 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:53.636462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330652-dd9d-4c85-8eb8-292b48c0b745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:53.646298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3330652-dd9d-4c85-8eb8-292b48c0b745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:53.648920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3330652-dd9d-4c85-8eb8-292b48c0b745 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:53.659676 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1051/2107] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:53.698920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba695062-9dde-445b-a4ce-4d5d81ef22b9 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:53.705004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3330652-dd9d-4c85-8eb8-292b48c0b745 service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:53.708084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ba695062-9dde-445b-a4ce-4d5d81ef22b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:53.708585 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e3330652-dd9d-4c85-8eb8-292b48c0b745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:53.769987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba695062-9dde-445b-a4ce-4d5d81ef22b9 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:53.770503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3330652-dd9d-4c85-8eb8-292b48c0b745 service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:53.784548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:53.785432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:53.786651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:53.788054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:53.788293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:53.788582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] PATH_INFO: `/v3/projects/2e887955a08643a2a535a385d38384f0` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:53.789245 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:53.789569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] PATH_INFO: `/v3/projects/f09bec99b2ad4b6ca59f4ffaa2417595` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:53.790822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e887955a08643a2a535a385d38384f0)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:53.792117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09bec99b2ad4b6ca59f4ffaa2417595)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:53.799539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:53.801294 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:53.966843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09bec99b2ad4b6ca59f4ffaa2417595', 'request_id': 'req-4be41a66-c0a3-4e8a-afbb-20e9baee576d'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.011713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e887955a08643a2a535a385d38384f0', 'request_id': 'req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.028448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09bec99b2ad4b6ca59f4ffaa2417595', 'request_id': 'req-4be41a66-c0a3-4e8a-afbb-20e9baee576d'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.035932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09bec99b2ad4b6ca59f4ffaa2417595', 'request_id': 'req-4be41a66-c0a3-4e8a-afbb-20e9baee576d'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.063539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] The token cache is being invalidate because project f09bec99b2ad4b6ca59f4ffaa2417595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:54.063781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.069662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:54.075517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.079071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1052/2108] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:53 2022] DELETE /identity/v3/projects/f09bec99b2ad4b6ca59f4ffaa2417595 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:54.083509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:54.086825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:54.131638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e887955a08643a2a535a385d38384f0', 'request_id': 'req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.140015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e887955a08643a2a535a385d38384f0', 'request_id': 'req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.169149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] The token cache is being invalidate because project 2e887955a08643a2a535a385d38384f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:54.169529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.170353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.171952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1057/2109] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:53 2022] DELETE /identity/v3/projects/2e887955a08643a2a535a385d38384f0 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:54.176101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:54.179236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:54.221371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be41a66-c0a3-4e8a-afbb-20e9baee576d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:54.311371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:54.312212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:54.313528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:54.314581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] PATH_INFO: `/v3/users/e10e961f4ea9444a9a00718223266320` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:54.316026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10e961f4ea9444a9a00718223266320)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:54.318750 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:54.339186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9cb08-eaa3-4179-9755-574d2a3fe7a6 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:54.350968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96b5f0-0f7c-4ed1-a834-a93a4d7b4182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:54.351876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b5f0-0f7c-4ed1-a834-a93a4d7b4182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:54.352185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b5f0-0f7c-4ed1-a834-a93a4d7b4182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:54.352446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b5f0-0f7c-4ed1-a834-a93a4d7b4182 admin admin] PATH_INFO: `/v3/users/692ba079b4f74c7c92719bd5afcdd968` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:54.354976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96b5f0-0f7c-4ed1-a834-a93a4d7b4182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=692ba079b4f74c7c92719bd5afcdd968)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:54.360179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96b5f0-0f7c-4ed1-a834-a93a4d7b4182 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:54.598396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10e961f4ea9444a9a00718223266320'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.599072 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10e961f4ea9444a9a00718223266320'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.612741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10e961f4ea9444a9a00718223266320'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.664918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1a96b5f0-0f7c-4ed1-a834-a93a4d7b4182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692ba079b4f74c7c92719bd5afcdd968'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.665577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1a96b5f0-0f7c-4ed1-a834-a93a4d7b4182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692ba079b4f74c7c92719bd5afcdd968'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.679688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10e961f4ea9444a9a00718223266320'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.687027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10e961f4ea9444a9a00718223266320'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.693358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1053/2110] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:54 2022] DELETE /identity/v3/users/e10e961f4ea9444a9a00718223266320 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:54.843902 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1a96b5f0-0f7c-4ed1-a834-a93a4d7b4182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692ba079b4f74c7c92719bd5afcdd968'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.857616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1a96b5f0-0f7c-4ed1-a834-a93a4d7b4182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692ba079b4f74c7c92719bd5afcdd968'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.864464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1a96b5f0-0f7c-4ed1-a834-a93a4d7b4182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692ba079b4f74c7c92719bd5afcdd968'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:54.872238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1058/2111] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:47:54 2022] DELETE /identity/v3/users/692ba079b4f74c7c92719bd5afcdd968 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:55.160820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:55.162324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:55.277193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2ff50-4984-4095-81b5-7655b870c5a2 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:55.371896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725a937-07cc-45b4-b99e-e3384378c7c0 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:55.372354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725a937-07cc-45b4-b99e-e3384378c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:55.372526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725a937-07cc-45b4-b99e-e3384378c7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:55.386092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:55.403840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:55.405294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:55.405734 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:55.406172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] PATH_INFO: `/v3/projects/b313fc2228174e5eb63e42c1593885a1` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:55.408478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b313fc2228174e5eb63e42c1593885a1)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:55.411165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:55.412017 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-3725a937-07cc-45b4-b99e-e3384378c7c0 None None] MFA Rules not processed for user `d89fede014d94157aeaeebbbceac28a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:55.414535 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3725a937-07cc-45b4-b99e-e3384378c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:55.455567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:55.496344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1059/2112] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:55.499170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725a937-07cc-45b4-b99e-e3384378c7c0 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:55.500630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3725a937-07cc-45b4-b99e-e3384378c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:55.569091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725a937-07cc-45b4-b99e-e3384378c7c0 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:55.573726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5062638-1e0e-4e7c-9143-358b5505bc51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:55.574611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5062638-1e0e-4e7c-9143-358b5505bc51 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:55.575196 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5062638-1e0e-4e7c-9143-358b5505bc51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:55.575625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5062638-1e0e-4e7c-9143-358b5505bc51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:55.578922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e5062638-1e0e-4e7c-9143-358b5505bc51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:55.609675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b313fc2228174e5eb63e42c1593885a1', 'request_id': 'req-97b92cbe-f87c-4989-b184-16684873562a'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:55.675529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5062638-1e0e-4e7c-9143-358b5505bc51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:55.676978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5062638-1e0e-4e7c-9143-358b5505bc51 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:55.690467 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1060/2113] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:55.693085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5062638-1e0e-4e7c-9143-358b5505bc51 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:55.695065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e5062638-1e0e-4e7c-9143-358b5505bc51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:55.709856 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b313fc2228174e5eb63e42c1593885a1', 'request_id': 'req-97b92cbe-f87c-4989-b184-16684873562a'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:55.719015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5062638-1e0e-4e7c-9143-358b5505bc51 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:55.719427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b313fc2228174e5eb63e42c1593885a1', 'request_id': 'req-97b92cbe-f87c-4989-b184-16684873562a'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:55.743937 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] The token cache is being invalidate because project b313fc2228174e5eb63e42c1593885a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:55.744249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:55.745184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-97b92cbe-f87c-4989-b184-16684873562a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:55.747200 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1054/2114] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:55 2022] DELETE /identity/v3/projects/b313fc2228174e5eb63e42c1593885a1 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:55.752423 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e749c-c459-4f81-8e06-259ee9f4010a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:55.752874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e749c-c459-4f81-8e06-259ee9f4010a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:55.753161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e749c-c459-4f81-8e06-259ee9f4010a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:55.792562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-d66e749c-c459-4f81-8e06-259ee9f4010a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:55.796021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d66e749c-c459-4f81-8e06-259ee9f4010a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:55.862289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:55.863193 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:55.864646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:55.867133 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] PATH_INFO: `/v3/projects/8b8a3c0a84c645e1a602e78de6837cc5` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:55.869447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8a3c0a84c645e1a602e78de6837cc5)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:55.871705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:55.922296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1055/2115] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:55.941901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e95742-f17e-49d2-98e5-0319788d0c59 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:55.941901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e95742-f17e-49d2-98e5-0319788d0c59 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:55.941901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e95742-f17e-49d2-98e5-0319788d0c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:55.990062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c4e95742-f17e-49d2-98e5-0319788d0c59 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:55.990062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c4e95742-f17e-49d2-98e5-0319788d0c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:56.008735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1056/2116] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:56.010165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e95742-f17e-49d2-98e5-0319788d0c59 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:56.020402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e95742-f17e-49d2-98e5-0319788d0c59 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:56.049188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8a3c0a84c645e1a602e78de6837cc5', 'request_id': 'req-dcc4136f-dc97-4c20-9f63-769e8ec845dc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:56.113641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bce170-81c7-4d41-be7e-97b610efca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:56.114596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce170-81c7-4d41-be7e-97b610efca65 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.115228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce170-81c7-4d41-be7e-97b610efca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.115571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce170-81c7-4d41-be7e-97b610efca65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.124072 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bce170-81c7-4d41-be7e-97b610efca65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:56.126776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bce170-81c7-4d41-be7e-97b610efca65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:56.131953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bce170-81c7-4d41-be7e-97b610efca65 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:56.148923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8a3c0a84c645e1a602e78de6837cc5', 'request_id': 'req-dcc4136f-dc97-4c20-9f63-769e8ec845dc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:56.165516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1057/2117] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:56.165757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8a3c0a84c645e1a602e78de6837cc5', 'request_id': 'req-dcc4136f-dc97-4c20-9f63-769e8ec845dc'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:56.166524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bce170-81c7-4d41-be7e-97b610efca65 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:56.179312 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bce170-81c7-4d41-be7e-97b610efca65 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:56.186479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] The token cache is being invalidate because project 8b8a3c0a84c645e1a602e78de6837cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:47:56.186772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:56.186881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39f817-3dbb-4beb-b456-a3c61194a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:56.187631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-dcc4136f-dc97-4c20-9f63-769e8ec845dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:47:56.187742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39f817-3dbb-4beb-b456-a3c61194a024 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.188040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39f817-3dbb-4beb-b456-a3c61194a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.188424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39f817-3dbb-4beb-b456-a3c61194a024 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.189534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39f817-3dbb-4beb-b456-a3c61194a024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:56.191645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39f817-3dbb-4beb-b456-a3c61194a024 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:56.193429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1061/2118] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:47:55 2022] DELETE /identity/v3/projects/8b8a3c0a84c645e1a602e78de6837cc5 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:56.195191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23451-08a8-42da-8f37-c41e0346510e None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.195769 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23451-08a8-42da-8f37-c41e0346510e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.196053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23451-08a8-42da-8f37-c41e0346510e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.220778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-dfd23451-08a8-42da-8f37-c41e0346510e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:56.222656 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-dfd23451-08a8-42da-8f37-c41e0346510e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:56.250867 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1062/2119] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:56.259081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a2eab-479f-4213-a051-98725fde1b1c None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.259618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a2eab-479f-4213-a051-98725fde1b1c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.260049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a2eab-479f-4213-a051-98725fde1b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.314684 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e74a2eab-479f-4213-a051-98725fde1b1c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:56.316111 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e74a2eab-479f-4213-a051-98725fde1b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:56.337348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1063/2120] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:47:56.340705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a2eab-479f-4213-a051-98725fde1b1c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:56.357064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1058/2121] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:56 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:56.358755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a2eab-479f-4213-a051-98725fde1b1c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:56.361000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39f817-3dbb-4beb-b456-a3c61194a024 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:56.363374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8c39f817-3dbb-4beb-b456-a3c61194a024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:56.449694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2751da-1f46-49d5-9bc0-4405ad5cf49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:56.450536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2751da-1f46-49d5-9bc0-4405ad5cf49c admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.450826 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2751da-1f46-49d5-9bc0-4405ad5cf49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.451100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2751da-1f46-49d5-9bc0-4405ad5cf49c admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.451836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2751da-1f46-49d5-9bc0-4405ad5cf49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:47:56.452254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2751da-1f46-49d5-9bc0-4405ad5cf49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:56.453898 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2751da-1f46-49d5-9bc0-4405ad5cf49c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:56.467595 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1064/2122] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:47:56.468252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39f817-3dbb-4beb-b456-a3c61194a024 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:56.472046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2751da-1f46-49d5-9bc0-4405ad5cf49c admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:56.473214 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc04dc-b99f-4f59-90ea-7b2ad4787ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:56.473942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc04dc-b99f-4f59-90ea-7b2ad4787ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.474332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc04dc-b99f-4f59-90ea-7b2ad4787ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.474639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc04dc-b99f-4f59-90ea-7b2ad4787ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.475420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc04dc-b99f-4f59-90ea-7b2ad4787ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:56.477320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc04dc-b99f-4f59-90ea-7b2ad4787ec1 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:56.482440 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2751da-1f46-49d5-9bc0-4405ad5cf49c admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:56.487388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f24fc-ba01-49ef-9574-e894804acc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:56.488045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f24fc-ba01-49ef-9574-e894804acc30 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.488459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f24fc-ba01-49ef-9574-e894804acc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.488753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f24fc-ba01-49ef-9574-e894804acc30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.489708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f24fc-ba01-49ef-9574-e894804acc30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:56.491503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f24fc-ba01-49ef-9574-e894804acc30 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:56.583095 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1059/2123] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:56 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:56.593161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc04dc-b99f-4f59-90ea-7b2ad4787ec1 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:56.614065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1065/2124] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:47:56 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:47:56.620187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f24fc-ba01-49ef-9574-e894804acc30 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:56.626781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc04dc-b99f-4f59-90ea-7b2ad4787ec1 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:56.752704 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f24fc-ba01-49ef-9574-e894804acc30 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:56.766363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d74ce-a925-456a-8c8c-b179d4300c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:56.767092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d74ce-a925-456a-8c8c-b179d4300c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.767388 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d74ce-a925-456a-8c8c-b179d4300c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.767667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d74ce-a925-456a-8c8c-b179d4300c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.768492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d74ce-a925-456a-8c8c-b179d4300c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:56.770580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d74ce-a925-456a-8c8c-b179d4300c59 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:56.804153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07435e09-ded5-4a64-99d5-3253567de577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:56.805578 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07435e09-ded5-4a64-99d5-3253567de577 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.806401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07435e09-ded5-4a64-99d5-3253567de577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.806964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07435e09-ded5-4a64-99d5-3253567de577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.807721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07435e09-ded5-4a64-99d5-3253567de577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:56.809691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07435e09-ded5-4a64-99d5-3253567de577 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:56.825691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1060/2125] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:56.826848 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07435e09-ded5-4a64-99d5-3253567de577 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:56.838826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07435e09-ded5-4a64-99d5-3253567de577 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:56.844195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308519d-4299-477c-94d9-bc4707484d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:56.844865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308519d-4299-477c-94d9-bc4707484d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.846934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308519d-4299-477c-94d9-bc4707484d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.846934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308519d-4299-477c-94d9-bc4707484d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.846934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308519d-4299-477c-94d9-bc4707484d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:56.848096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308519d-4299-477c-94d9-bc4707484d7a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:56.867075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1061/2126] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:47:56.868958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308519d-4299-477c-94d9-bc4707484d7a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:56.881511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308519d-4299-477c-94d9-bc4707484d7a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:56.889201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20246c16-829c-43d0-93ea-c38c015727c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:56.889201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20246c16-829c-43d0-93ea-c38c015727c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.889201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20246c16-829c-43d0-93ea-c38c015727c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.889201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20246c16-829c-43d0-93ea-c38c015727c7 admin admin] PATH_INFO: `/v3/projects/d7d0894e42ec4afba3a9d5804ffbd0f5/users/20d14f605ff24463b3389601ed83db96/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.908376 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:56.917324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20246c16-829c-43d0-93ea-c38c015727c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d0894e42ec4afba3a9d5804ffbd0f5, user_id=20d14f605ff24463b3389601ed83db96, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:56.920204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20246c16-829c-43d0-93ea-c38c015727c7 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:56.947370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1066/2127] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:47:56 2022] POST /identity/v3/users => generated 288 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:47:56.948942 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d74ce-a925-456a-8c8c-b179d4300c59 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:56.950162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:56.981842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d74ce-a925-456a-8c8c-b179d4300c59 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:56.995148 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a27b4-4e30-4b91-a454-8ee6b277ac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:56.996917 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a27b4-4e30-4b91-a454-8ee6b277ac4f admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:56.997638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a27b4-4e30-4b91-a454-8ee6b277ac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:56.997951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a27b4-4e30-4b91-a454-8ee6b277ac4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:56.999411 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a27b4-4e30-4b91-a454-8ee6b277ac4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:57.001817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a27b4-4e30-4b91-a454-8ee6b277ac4f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:57.019374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1067/2128] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:57.020473 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a27b4-4e30-4b91-a454-8ee6b277ac4f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:57.038912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1062/2129] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:56 2022] PUT /identity/v3/projects/d7d0894e42ec4afba3a9d5804ffbd0f5/users/20d14f605ff24463b3389601ed83db96/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:57.045765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d697c-ad5e-438f-9e09-b2e51a2e9b2f None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:57.046393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d697c-ad5e-438f-9e09-b2e51a2e9b2f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:57.046904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d697c-ad5e-438f-9e09-b2e51a2e9b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:57.055519 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a27b4-4e30-4b91-a454-8ee6b277ac4f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:57.110154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-301d697c-ad5e-438f-9e09-b2e51a2e9b2f None None] MFA Rules not processed for user `20d14f605ff24463b3389601ed83db96`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:57.110154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-301d697c-ad5e-438f-9e09-b2e51a2e9b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:57.154348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce85fc1-48b0-4d17-93ad-0301729666a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:57.155312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce85fc1-48b0-4d17-93ad-0301729666a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:57.155601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce85fc1-48b0-4d17-93ad-0301729666a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:57.155881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce85fc1-48b0-4d17-93ad-0301729666a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:57.156617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce85fc1-48b0-4d17-93ad-0301729666a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:57.158339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce85fc1-48b0-4d17-93ad-0301729666a0 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:57.180175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1068/2130] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:47:57.184526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce85fc1-48b0-4d17-93ad-0301729666a0 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:57.206778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce85fc1-48b0-4d17-93ad-0301729666a0 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:57.221119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1063/2131] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:57.222896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c709f-178c-43ff-8aea-1a9245f01093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:57.223818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c709f-178c-43ff-8aea-1a9245f01093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:57.224109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c709f-178c-43ff-8aea-1a9245f01093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:57.224550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c709f-178c-43ff-8aea-1a9245f01093 admin admin] PATH_INFO: `/v3/projects/73d15d1495b549ee9421f59d3ee197ec/users/26bce18f1bef4d4da086862dfd7bebe6/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:57.233150 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d697c-ad5e-438f-9e09-b2e51a2e9b2f None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:57.236449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-301d697c-ad5e-438f-9e09-b2e51a2e9b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:57.255565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c709f-178c-43ff-8aea-1a9245f01093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d15d1495b549ee9421f59d3ee197ec, user_id=26bce18f1bef4d4da086862dfd7bebe6, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:57.257442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c709f-178c-43ff-8aea-1a9245f01093 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:57.324815 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d697c-ad5e-438f-9e09-b2e51a2e9b2f None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:57.333700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e86e31-30df-4c68-9cfa-6ae1c2b1489c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5498a6912a08408d9ea30920faceee7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:57.334957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e86e31-30df-4c68-9cfa-6ae1c2b1489c service glance] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:57.335251 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e86e31-30df-4c68-9cfa-6ae1c2b1489c service glance] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:57.335530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e86e31-30df-4c68-9cfa-6ae1c2b1489c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:57.350520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e86e31-30df-4c68-9cfa-6ae1c2b1489c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:57.354722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e86e31-30df-4c68-9cfa-6ae1c2b1489c service glance] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:57.373769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1064/2132] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:47:57.399135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1069/2133] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:47:57 2022] PUT /identity/v3/projects/73d15d1495b549ee9421f59d3ee197ec/users/26bce18f1bef4d4da086862dfd7bebe6/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:47:57.399321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264efc-beac-4f3f-9b98-f0c378201ac1 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:57.399461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264efc-beac-4f3f-9b98-f0c378201ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:57.399744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264efc-beac-4f3f-9b98-f0c378201ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:57.457696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5d264efc-beac-4f3f-9b98-f0c378201ac1 None None] MFA Rules not processed for user `26bce18f1bef4d4da086862dfd7bebe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:47:57.459775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5d264efc-beac-4f3f-9b98-f0c378201ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:57.597599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1065/2134] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:47:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:47:57.956437 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c709f-178c-43ff-8aea-1a9245f01093 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:47:57.960267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-592c709f-178c-43ff-8aea-1a9245f01093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:47:58.040800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c709f-178c-43ff-8aea-1a9245f01093 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:47:58.045329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9b252-7fa8-40fc-a350-8e5761a03a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:47:58.045995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9b252-7fa8-40fc-a350-8e5761a03a2b service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:47:58.046360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9b252-7fa8-40fc-a350-8e5761a03a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:47:58.050365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9b252-7fa8-40fc-a350-8e5761a03a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:47:58.059333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9b252-7fa8-40fc-a350-8e5761a03a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:47:58.061185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9b252-7fa8-40fc-a350-8e5761a03a2b service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:47:58.081016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1070/2135] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:47:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:47:58.484174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:47:58.656909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:00.417666 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:00.988934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:02.611540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d264efc-beac-4f3f-9b98-f0c378201ac1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:02.713306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d264efc-beac-4f3f-9b98-f0c378201ac1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:02.719592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:02.726883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:02.726883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:02.726883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:02.726883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] PATH_INFO: `/v3/users/26bce18f1bef4d4da086862dfd7bebe6` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:02.728554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bce18f1bef4d4da086862dfd7bebe6)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:02.730517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:02.931207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bce18f1bef4d4da086862dfd7bebe6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:02.931862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bce18f1bef4d4da086862dfd7bebe6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:02.944562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bce18f1bef4d4da086862dfd7bebe6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:03.011454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bce18f1bef4d4da086862dfd7bebe6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:03.018873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bce18f1bef4d4da086862dfd7bebe6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:03.025034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1066/2136] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:48:02 2022] DELETE /identity/v3/users/26bce18f1bef4d4da086862dfd7bebe6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:03.029504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68740926-570c-4ebf-ab5f-182ebdcc263f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:03.030020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68740926-570c-4ebf-ab5f-182ebdcc263f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:03.030122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68740926-570c-4ebf-ab5f-182ebdcc263f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:03.047448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-68740926-570c-4ebf-ab5f-182ebdcc263f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:03.054836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-68740926-570c-4ebf-ab5f-182ebdcc263f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:03.103628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:03.109409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1071/2137] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:03.120534 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:03.122077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:03.184030 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210655e-56cd-4f6e-911e-07e467ccf25f admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:03.189053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c808ff-bd1c-479b-afb1-6cc473d10c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:03.189751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c808ff-bd1c-479b-afb1-6cc473d10c6f service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:03.190037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c808ff-bd1c-479b-afb1-6cc473d10c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:03.190342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c808ff-bd1c-479b-afb1-6cc473d10c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:03.200823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c808ff-bd1c-479b-afb1-6cc473d10c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:03.202262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c808ff-bd1c-479b-afb1-6cc473d10c6f service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:03.212075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1067/2138] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:03.236860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:03.699106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68740926-570c-4ebf-ab5f-182ebdcc263f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:03.701916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-68740926-570c-4ebf-ab5f-182ebdcc263f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:03.719890 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68740926-570c-4ebf-ab5f-182ebdcc263f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:03.733767 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:03.734751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:03.736769 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:03.737072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] PATH_INFO: `/v3/projects/73d15d1495b549ee9421f59d3ee197ec` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:03.741832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d15d1495b549ee9421f59d3ee197ec)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:03.748877 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:03.883100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d15d1495b549ee9421f59d3ee197ec', 'request_id': 'req-6ec5efc5-b42a-4fe2-aa70-777f632bc053'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:03.996171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d15d1495b549ee9421f59d3ee197ec', 'request_id': 'req-6ec5efc5-b42a-4fe2-aa70-777f632bc053'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:04.000461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d15d1495b549ee9421f59d3ee197ec', 'request_id': 'req-6ec5efc5-b42a-4fe2-aa70-777f632bc053'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:04.014287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] The token cache is being invalidate because project 73d15d1495b549ee9421f59d3ee197ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:48:04.014524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:04.015309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6ec5efc5-b42a-4fe2-aa70-777f632bc053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:04.016859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1072/2139] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:48:03 2022] DELETE /identity/v3/projects/73d15d1495b549ee9421f59d3ee197ec => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:04.021808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ec42e-ff44-421b-a312-abbf4b47336e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:04.022341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ec42e-ff44-421b-a312-abbf4b47336e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:04.022443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ec42e-ff44-421b-a312-abbf4b47336e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:04.041522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-7e4ec42e-ff44-421b-a312-abbf4b47336e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:04.042972 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7e4ec42e-ff44-421b-a312-abbf4b47336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:04.127172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1068/2140] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:48:04.135080 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8004beb-30bc-4252-a04f-4658ef2afa34 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:04.135597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8004beb-30bc-4252-a04f-4658ef2afa34 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:04.135597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8004beb-30bc-4252-a04f-4658ef2afa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:04.157472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-b8004beb-30bc-4252-a04f-4658ef2afa34 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:04.158753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b8004beb-30bc-4252-a04f-4658ef2afa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:04.169345 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1073/2141] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:04.173376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ec42e-ff44-421b-a312-abbf4b47336e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:04.184227 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ec42e-ff44-421b-a312-abbf4b47336e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:04.189489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd72fe-f841-40e2-b39b-289f6ad4c810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:04.190186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd72fe-f841-40e2-b39b-289f6ad4c810 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:04.190501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd72fe-f841-40e2-b39b-289f6ad4c810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:04.190779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd72fe-f841-40e2-b39b-289f6ad4c810 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:04.191566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd72fe-f841-40e2-b39b-289f6ad4c810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:48:04.191814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd72fe-f841-40e2-b39b-289f6ad4c810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:04.193484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd72fe-f841-40e2-b39b-289f6ad4c810 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:04.199544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:04.205885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1069/2142] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:48:04.210216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8004beb-30bc-4252-a04f-4658ef2afa34 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:04.219422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8004beb-30bc-4252-a04f-4658ef2afa34 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:04.224343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f66cf-4215-47e3-b526-63fc1c02165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:04.225519 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f66cf-4215-47e3-b526-63fc1c02165a admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:04.225988 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f66cf-4215-47e3-b526-63fc1c02165a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:04.226305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f66cf-4215-47e3-b526-63fc1c02165a admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:04.227190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f66cf-4215-47e3-b526-63fc1c02165a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:04.229152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f66cf-4215-47e3-b526-63fc1c02165a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:04.339354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1074/2143] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:48:04 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:48:04.343348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd72fe-f841-40e2-b39b-289f6ad4c810 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:04.354032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd72fe-f841-40e2-b39b-289f6ad4c810 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:04.356482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:04.411393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39366fa7-1d1a-4da0-863b-a9f1eda5791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:04.413405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39366fa7-1d1a-4da0-863b-a9f1eda5791e admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:04.413888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39366fa7-1d1a-4da0-863b-a9f1eda5791e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:04.414190 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39366fa7-1d1a-4da0-863b-a9f1eda5791e admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:04.414942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39366fa7-1d1a-4da0-863b-a9f1eda5791e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:04.417162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39366fa7-1d1a-4da0-863b-a9f1eda5791e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:04.523986 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1070/2144] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:48:04 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:48:04.528058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f66cf-4215-47e3-b526-63fc1c02165a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:04.539151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f66cf-4215-47e3-b526-63fc1c02165a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:04.544271 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9eed5-7604-422d-826a-4274d955063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:04.547676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9eed5-7604-422d-826a-4274d955063a admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:04.547676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9eed5-7604-422d-826a-4274d955063a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:04.547676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9eed5-7604-422d-826a-4274d955063a admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:04.547676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9eed5-7604-422d-826a-4274d955063a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:04.548047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9eed5-7604-422d-826a-4274d955063a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:04.558860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1075/2145] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:04.563092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39366fa7-1d1a-4da0-863b-a9f1eda5791e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:04.573417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39366fa7-1d1a-4da0-863b-a9f1eda5791e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:04.578143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48018b-9145-4b0a-88b4-70a254b8562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:04.578823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48018b-9145-4b0a-88b4-70a254b8562d admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:04.579244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48018b-9145-4b0a-88b4-70a254b8562d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:04.579528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48018b-9145-4b0a-88b4-70a254b8562d admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:04.580251 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48018b-9145-4b0a-88b4-70a254b8562d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:04.581851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48018b-9145-4b0a-88b4-70a254b8562d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:04.592337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1071/2146] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:04.596536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9eed5-7604-422d-826a-4274d955063a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:04.608481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9eed5-7604-422d-826a-4274d955063a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:04.614317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd847e-a9b1-4825-b1d0-d8fc67e775c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:04.615226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd847e-a9b1-4825-b1d0-d8fc67e775c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:04.615568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd847e-a9b1-4825-b1d0-d8fc67e775c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:04.615847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd847e-a9b1-4825-b1d0-d8fc67e775c9 admin admin] PATH_INFO: `/v3/projects/2ae80f281b2146f8b51af281226c86d9/users/6c0b5ef746b9400faeb9caf17cd8dbb0/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:04.633692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd847e-a9b1-4825-b1d0-d8fc67e775c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae80f281b2146f8b51af281226c86d9, user_id=6c0b5ef746b9400faeb9caf17cd8dbb0, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:04.636438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd847e-a9b1-4825-b1d0-d8fc67e775c9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:04.709592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1076/2147] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:48:04 2022] PUT /identity/v3/projects/2ae80f281b2146f8b51af281226c86d9/users/6c0b5ef746b9400faeb9caf17cd8dbb0/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:48:04.726329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846ebab-008c-4277-a6fe-20e239e13677 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:04.726329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846ebab-008c-4277-a6fe-20e239e13677 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:04.726329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846ebab-008c-4277-a6fe-20e239e13677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:04.755854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5846ebab-008c-4277-a6fe-20e239e13677 None None] MFA Rules not processed for user `6c0b5ef746b9400faeb9caf17cd8dbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:04.757158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5846ebab-008c-4277-a6fe-20e239e13677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:04.786375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:04.827339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1072/2148] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:04.841472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd847e-a9b1-4825-b1d0-d8fc67e775c9 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:04.843316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-66bd847e-a9b1-4825-b1d0-d8fc67e775c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:04.902873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd847e-a9b1-4825-b1d0-d8fc67e775c9 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:04.906545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a29e55-8f49-4e64-8d12-07ab1f43231c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5498a6912a08408d9ea30920faceee7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:04.907192 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a29e55-8f49-4e64-8d12-07ab1f43231c service glance] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:04.907478 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a29e55-8f49-4e64-8d12-07ab1f43231c service glance] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:04.907753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a29e55-8f49-4e64-8d12-07ab1f43231c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:04.917445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a29e55-8f49-4e64-8d12-07ab1f43231c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:04.919380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a29e55-8f49-4e64-8d12-07ab1f43231c service glance] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:04.929194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1077/2149] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:05.097007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:05.571620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:06.015005 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:06.941026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:07.279621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:07.412069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:08.016517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:08.126454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:08.890334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:09.016648 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:10.422379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:10.535198 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:11.346151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:11.405690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:11.636492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:11.674911 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:12.017857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:12.084071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:12.378629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:12.408092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c365-8b3c-407b-86af-9a7b56fa7bf0 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:12.408730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c365-8b3c-407b-86af-9a7b56fa7bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:12.409148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c365-8b3c-407b-86af-9a7b56fa7bf0 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:12.411261 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1073/2150] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:48:12.448406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2acbd-950c-4b09-847a-15ac910f14f2 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:12.448886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2acbd-950c-4b09-847a-15ac910f14f2 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:12.449317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2acbd-950c-4b09-847a-15ac910f14f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:12.476144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a5e2acbd-950c-4b09-847a-15ac910f14f2 None None] MFA Rules not processed for user `b1e0226354d14b9b9c4184063b2df9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:12.478822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a5e2acbd-950c-4b09-847a-15ac910f14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:12.560004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1078/2151] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:48:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:12.571434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c365-8b3c-407b-86af-9a7b56fa7bf0 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:12.577309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ade9c365-8b3c-407b-86af-9a7b56fa7bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:12.590838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c365-8b3c-407b-86af-9a7b56fa7bf0 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:12.596274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af216b4-487d-4bab-ae94-996feef26aad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:12.597087 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af216b4-487d-4bab-ae94-996feef26aad service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:12.598119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af216b4-487d-4bab-ae94-996feef26aad service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:12.598119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af216b4-487d-4bab-ae94-996feef26aad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:12.609288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af216b4-487d-4bab-ae94-996feef26aad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:12.611037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af216b4-487d-4bab-ae94-996feef26aad service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:12.622877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1074/2152] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:12.765116 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0d0e-b117-4667-a603-feec5bc4c44f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:12.765633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0d0e-b117-4667-a603-feec5bc4c44f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:12.765633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0d0e-b117-4667-a603-feec5bc4c44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:12.785108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-086a0d0e-b117-4667-a603-feec5bc4c44f None None] MFA Rules not processed for user `f19592c32cea4fabaa7301b099bac14b`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:12.786341 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-086a0d0e-b117-4667-a603-feec5bc4c44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:12.841104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1079/2153] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:12.919994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:13.192524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:13.359928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:13.440288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af216b4-487d-4bab-ae94-996feef26aad service placement] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:13.449798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9af216b4-487d-4bab-ae94-996feef26aad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:13.514272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af216b4-487d-4bab-ae94-996feef26aad service placement] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:13.526878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:13.528103 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:13.528488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:13.528864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] PATH_INFO: `/v3/users/3529dcdbde024997a361df6e3b253589` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:13.530488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3529dcdbde024997a361df6e3b253589)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:13.532681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:13.548388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:13.712458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3529dcdbde024997a361df6e3b253589'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:13.713100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3529dcdbde024997a361df6e3b253589'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:13.724820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3529dcdbde024997a361df6e3b253589'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:13.809471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3529dcdbde024997a361df6e3b253589'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:13.817603 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3529dcdbde024997a361df6e3b253589'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:13.825847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1075/2154] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:48:13 2022] DELETE /identity/v3/users/3529dcdbde024997a361df6e3b253589 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:13.908285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:14.128079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a0d0e-b117-4667-a603-feec5bc4c44f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:14.156705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a0d0e-b117-4667-a603-feec5bc4c44f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:14.218982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:14.221007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:14.221007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:14.221007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] PATH_INFO: `/v3/projects/205238d4cb1a41f4b081826a79083124` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:14.221569 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205238d4cb1a41f4b081826a79083124)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:14.223502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:14.336020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205238d4cb1a41f4b081826a79083124', 'request_id': 'req-0c162527-4b58-4a37-9ea8-acf83fc56f21'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:14.416670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205238d4cb1a41f4b081826a79083124', 'request_id': 'req-0c162527-4b58-4a37-9ea8-acf83fc56f21'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:14.423982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205238d4cb1a41f4b081826a79083124', 'request_id': 'req-0c162527-4b58-4a37-9ea8-acf83fc56f21'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:14.436872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] The token cache is being invalidate because project 205238d4cb1a41f4b081826a79083124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:48:14.437156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:14.437913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:14.442614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1080/2155] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:48:14 2022] DELETE /identity/v3/projects/205238d4cb1a41f4b081826a79083124 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:14.443595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:14.445076 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:14.459327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8cde3-1426-4286-8a8c-ece6b03f2391 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:14.518006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61dd89-ab0b-4669-9f1b-4a6bb1f51822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:14.518895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61dd89-ab0b-4669-9f1b-4a6bb1f51822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:14.519167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61dd89-ab0b-4669-9f1b-4a6bb1f51822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:14.519445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61dd89-ab0b-4669-9f1b-4a6bb1f51822 admin admin] PATH_INFO: `/v3/users/8f453537049340b4946a058eb49eab50` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:14.520661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61dd89-ab0b-4669-9f1b-4a6bb1f51822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f453537049340b4946a058eb49eab50)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:14.522629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61dd89-ab0b-4669-9f1b-4a6bb1f51822 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:14.705662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2c61dd89-ab0b-4669-9f1b-4a6bb1f51822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f453537049340b4946a058eb49eab50'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:14.706386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2c61dd89-ab0b-4669-9f1b-4a6bb1f51822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f453537049340b4946a058eb49eab50'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:14.714170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:14.719496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2c61dd89-ab0b-4669-9f1b-4a6bb1f51822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f453537049340b4946a058eb49eab50'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:14.822821 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2c61dd89-ab0b-4669-9f1b-4a6bb1f51822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f453537049340b4946a058eb49eab50'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:14.831841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2c61dd89-ab0b-4669-9f1b-4a6bb1f51822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f453537049340b4946a058eb49eab50'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:14.840665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1076/2156] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:48:14 2022] DELETE /identity/v3/users/8f453537049340b4946a058eb49eab50 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:15.110093 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:15.112470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:15.136114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c162527-4b58-4a37-9ea8-acf83fc56f21 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:15.191761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:15.198643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:15.199517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:15.199802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:15.200079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] PATH_INFO: `/v3/projects/0850a6583ceb4178a975fb89616c3c12` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:15.201271 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0850a6583ceb4178a975fb89616c3c12)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:15.203260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:15.389024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0850a6583ceb4178a975fb89616c3c12', 'request_id': 'req-beed9af3-00b2-4436-892e-f3fa25ae5600'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:15.445629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0850a6583ceb4178a975fb89616c3c12', 'request_id': 'req-beed9af3-00b2-4436-892e-f3fa25ae5600'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:15.452689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0850a6583ceb4178a975fb89616c3c12', 'request_id': 'req-beed9af3-00b2-4436-892e-f3fa25ae5600'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:15.466617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] The token cache is being invalidate because project 0850a6583ceb4178a975fb89616c3c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:48:15.466937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:15.467615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-beed9af3-00b2-4436-892e-f3fa25ae5600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:15.469158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1081/2157] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:48:15 2022] DELETE /identity/v3/projects/0850a6583ceb4178a975fb89616c3c12 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:15.474134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ebcc-7f9f-4c95-a8c1-6a973053a2f3 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:15.474561 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ebcc-7f9f-4c95-a8c1-6a973053a2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:15.474790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ebcc-7f9f-4c95-a8c1-6a973053a2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:15.499728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-0650ebcc-7f9f-4c95-a8c1-6a973053a2f3 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:15.501267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0650ebcc-7f9f-4c95-a8c1-6a973053a2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:15.576598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1077/2158] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:15.585324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22504e6-7693-47cb-b011-40e697d8d898 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:15.585686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22504e6-7693-47cb-b011-40e697d8d898 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:15.586043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22504e6-7693-47cb-b011-40e697d8d898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:15.604770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a22504e6-7693-47cb-b011-40e697d8d898 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:15.606216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a22504e6-7693-47cb-b011-40e697d8d898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:15.614862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1082/2159] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:15.621041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ebcc-7f9f-4c95-a8c1-6a973053a2f3 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:15.631012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ebcc-7f9f-4c95-a8c1-6a973053a2f3 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:15.650280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607988c-7534-4604-85bd-e52863c11737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:15.650866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607988c-7534-4604-85bd-e52863c11737 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:15.651154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607988c-7534-4604-85bd-e52863c11737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:15.651431 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607988c-7534-4604-85bd-e52863c11737 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:15.652181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607988c-7534-4604-85bd-e52863c11737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:48:15.652476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607988c-7534-4604-85bd-e52863c11737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:15.654273 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607988c-7534-4604-85bd-e52863c11737 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:15.667043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1078/2160] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:48:15.671668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22504e6-7693-47cb-b011-40e697d8d898 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:15.693067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22504e6-7693-47cb-b011-40e697d8d898 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:15.699385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af129885-a0ea-43f4-9fdf-e179df4c683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:15.700127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af129885-a0ea-43f4-9fdf-e179df4c683b admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:15.704114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af129885-a0ea-43f4-9fdf-e179df4c683b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:15.704114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af129885-a0ea-43f4-9fdf-e179df4c683b admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:15.704114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af129885-a0ea-43f4-9fdf-e179df4c683b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:15.704114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af129885-a0ea-43f4-9fdf-e179df4c683b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:15.821973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1083/2161] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:48:15 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:48:15.823642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607988c-7534-4604-85bd-e52863c11737 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:15.834764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607988c-7534-4604-85bd-e52863c11737 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:15.909215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820db1f-c2d8-4127-8d23-f5e88dbc53e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:15.909939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820db1f-c2d8-4127-8d23-f5e88dbc53e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:15.910276 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820db1f-c2d8-4127-8d23-f5e88dbc53e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:15.910572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820db1f-c2d8-4127-8d23-f5e88dbc53e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:15.911271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820db1f-c2d8-4127-8d23-f5e88dbc53e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:15.914050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820db1f-c2d8-4127-8d23-f5e88dbc53e7 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:16.012537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1079/2162] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:48:15 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:48:16.015443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af129885-a0ea-43f4-9fdf-e179df4c683b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:16.025833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af129885-a0ea-43f4-9fdf-e179df4c683b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:16.030489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609eec7-2e2e-484a-9d97-237276ade821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:16.032225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609eec7-2e2e-484a-9d97-237276ade821 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:16.032225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609eec7-2e2e-484a-9d97-237276ade821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:16.032225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609eec7-2e2e-484a-9d97-237276ade821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:16.032496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609eec7-2e2e-484a-9d97-237276ade821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:16.034025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609eec7-2e2e-484a-9d97-237276ade821 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:16.048367 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1084/2163] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:16.050035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820db1f-c2d8-4127-8d23-f5e88dbc53e7 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:16.062006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820db1f-c2d8-4127-8d23-f5e88dbc53e7 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:16.067505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87723a67-0a67-48cd-b4eb-5b548f8481c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:16.068250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87723a67-0a67-48cd-b4eb-5b548f8481c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:16.068539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87723a67-0a67-48cd-b4eb-5b548f8481c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:16.068821 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87723a67-0a67-48cd-b4eb-5b548f8481c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:16.069593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87723a67-0a67-48cd-b4eb-5b548f8481c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:16.071511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87723a67-0a67-48cd-b4eb-5b548f8481c5 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:16.083075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1080/2164] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:16.087641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609eec7-2e2e-484a-9d97-237276ade821 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:16.098637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609eec7-2e2e-484a-9d97-237276ade821 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:16.104218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c1e2-27bc-47f4-8ef7-02c284b3ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:16.105179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c1e2-27bc-47f4-8ef7-02c284b3ff9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:16.105472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c1e2-27bc-47f4-8ef7-02c284b3ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:16.105755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c1e2-27bc-47f4-8ef7-02c284b3ff9a admin admin] PATH_INFO: `/v3/projects/960dfbcc49564964b45fc3a13e320a70/users/4d923d4f546040b491751a691abb0b23/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:16.123001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7c1e2-27bc-47f4-8ef7-02c284b3ff9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=960dfbcc49564964b45fc3a13e320a70, user_id=4d923d4f546040b491751a691abb0b23, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:16.125889 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7c1e2-27bc-47f4-8ef7-02c284b3ff9a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:16.199910 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1085/2165] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:48:16 2022] PUT /identity/v3/projects/960dfbcc49564964b45fc3a13e320a70/users/4d923d4f546040b491751a691abb0b23/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:16.210272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423fee7-d687-4f6b-98ec-69eddb1f9076 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:16.216155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423fee7-d687-4f6b-98ec-69eddb1f9076 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:16.216155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423fee7-d687-4f6b-98ec-69eddb1f9076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:16.237604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-2423fee7-d687-4f6b-98ec-69eddb1f9076 None None] MFA Rules not processed for user `4d923d4f546040b491751a691abb0b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:16.240605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2423fee7-d687-4f6b-98ec-69eddb1f9076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:16.270078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:16.305804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1081/2166] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:16.316866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c1e2-27bc-47f4-8ef7-02c284b3ff9a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:16.321111 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b4e7c1e2-27bc-47f4-8ef7-02c284b3ff9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:16.377331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c1e2-27bc-47f4-8ef7-02c284b3ff9a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:16.381893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c7b2b-d4b9-4095-a905-0938745e3404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:16.382727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c7b2b-d4b9-4095-a905-0938745e3404 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:16.382914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c7b2b-d4b9-4095-a905-0938745e3404 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:16.383195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c7b2b-d4b9-4095-a905-0938745e3404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:16.395924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c7b2b-d4b9-4095-a905-0938745e3404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:16.397946 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c7b2b-d4b9-4095-a905-0938745e3404 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:16.407905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1086/2167] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:16.428869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423fee7-d687-4f6b-98ec-69eddb1f9076 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:16.494071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423fee7-d687-4f6b-98ec-69eddb1f9076 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:16.499211 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:16.500082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:16.500369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:16.500650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] PATH_INFO: `/v3/users/4d923d4f546040b491751a691abb0b23` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:16.501846 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d923d4f546040b491751a691abb0b23)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:16.503803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:16.642156 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d923d4f546040b491751a691abb0b23'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:16.642980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d923d4f546040b491751a691abb0b23'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:16.657205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d923d4f546040b491751a691abb0b23'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:16.729331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d923d4f546040b491751a691abb0b23'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:16.741185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d923d4f546040b491751a691abb0b23'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:16.748272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1082/2168] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:48:16 2022] DELETE /identity/v3/users/4d923d4f546040b491751a691abb0b23 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:16.753026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d264d8-3142-4c23-aca9-59f9dd7dbf46 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:16.753317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d264d8-3142-4c23-aca9-59f9dd7dbf46 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:16.753594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d264d8-3142-4c23-aca9-59f9dd7dbf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:16.801398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c6d264d8-3142-4c23-aca9-59f9dd7dbf46 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:16.802265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c6d264d8-3142-4c23-aca9-59f9dd7dbf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:16.824885 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:16.864499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1087/2169] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:16.874092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:16.875654 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:16.930904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:16.934576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a8c4-fcdb-4e0b-b765-ba8a4a9a1e11 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:16.938296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe635e-e625-430b-85fb-f57ca81bb594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:16.941388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe635e-e625-430b-85fb-f57ca81bb594 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:16.941388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe635e-e625-430b-85fb-f57ca81bb594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:16.941388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe635e-e625-430b-85fb-f57ca81bb594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:16.949234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe635e-e625-430b-85fb-f57ca81bb594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:16.950765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe635e-e625-430b-85fb-f57ca81bb594 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:16.960565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1083/2170] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:17.464143 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d264d8-3142-4c23-aca9-59f9dd7dbf46 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:17.465639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c6d264d8-3142-4c23-aca9-59f9dd7dbf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:17.478421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d264d8-3142-4c23-aca9-59f9dd7dbf46 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:17.483494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:17.484396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:17.484670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:17.484944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] PATH_INFO: `/v3/projects/960dfbcc49564964b45fc3a13e320a70` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:17.486176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] RBAC: Authorizing `identity:delete_project(project_id=960dfbcc49564964b45fc3a13e320a70)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:17.488128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:17.587248 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960dfbcc49564964b45fc3a13e320a70', 'request_id': 'req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:17.656797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960dfbcc49564964b45fc3a13e320a70', 'request_id': 'req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:17.664340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960dfbcc49564964b45fc3a13e320a70', 'request_id': 'req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:17.677053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] The token cache is being invalidate because project 960dfbcc49564964b45fc3a13e320a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:48:17.677351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:17.678023 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-108e51a4-b6c6-4889-b7d7-ee78d0e7829f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:17.680276 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1088/2171] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:48:17 2022] DELETE /identity/v3/projects/960dfbcc49564964b45fc3a13e320a70 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:17.685258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e8f43-b2ec-4316-af94-9a1c32cb3275 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:17.685766 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e8f43-b2ec-4316-af94-9a1c32cb3275 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:17.685904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e8f43-b2ec-4316-af94-9a1c32cb3275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:17.705613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-496e8f43-b2ec-4316-af94-9a1c32cb3275 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:17.707203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-496e8f43-b2ec-4316-af94-9a1c32cb3275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:17.801436 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1084/2172] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:17.803297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96770a4-464f-429f-bdf5-c4aa44c7d213 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:17.803654 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96770a4-464f-429f-bdf5-c4aa44c7d213 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:17.804041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96770a4-464f-429f-bdf5-c4aa44c7d213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:17.826678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-f96770a4-464f-429f-bdf5-c4aa44c7d213 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:17.828144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f96770a4-464f-429f-bdf5-c4aa44c7d213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:17.839311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1089/2173] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:17.843136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e8f43-b2ec-4316-af94-9a1c32cb3275 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:17.861608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e8f43-b2ec-4316-af94-9a1c32cb3275 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:17.867482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380e876-6246-4a4e-ab3c-8fc2694931ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:17.867860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380e876-6246-4a4e-ab3c-8fc2694931ba admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:17.868149 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380e876-6246-4a4e-ab3c-8fc2694931ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:17.868436 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380e876-6246-4a4e-ab3c-8fc2694931ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:17.869298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380e876-6246-4a4e-ab3c-8fc2694931ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:48:17.869609 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380e876-6246-4a4e-ab3c-8fc2694931ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:17.871353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380e876-6246-4a4e-ab3c-8fc2694931ba admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:17.894055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1085/2174] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:48:17.897932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96770a4-464f-429f-bdf5-c4aa44c7d213 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:17.911807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96770a4-464f-429f-bdf5-c4aa44c7d213 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:17.919579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea627dc9-8550-40ba-8407-ff6b61c3eb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:17.920320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea627dc9-8550-40ba-8407-ff6b61c3eb0f admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:17.920670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea627dc9-8550-40ba-8407-ff6b61c3eb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:17.921013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea627dc9-8550-40ba-8407-ff6b61c3eb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:17.921712 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea627dc9-8550-40ba-8407-ff6b61c3eb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:17.925113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea627dc9-8550-40ba-8407-ff6b61c3eb0f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:18.030277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1090/2175] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:48:17 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:48:18.032410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380e876-6246-4a4e-ab3c-8fc2694931ba admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:18.044683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380e876-6246-4a4e-ab3c-8fc2694931ba admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:18.108375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528315a-3c0a-47f2-ab9c-ec70440dd472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:18.109048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528315a-3c0a-47f2-ab9c-ec70440dd472 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:18.109333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528315a-3c0a-47f2-ab9c-ec70440dd472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:18.109610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528315a-3c0a-47f2-ab9c-ec70440dd472 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:18.110369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528315a-3c0a-47f2-ab9c-ec70440dd472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:18.112287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528315a-3c0a-47f2-ab9c-ec70440dd472 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:18.211925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1086/2176] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:48:18 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:48:18.218220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea627dc9-8550-40ba-8407-ff6b61c3eb0f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:18.230091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea627dc9-8550-40ba-8407-ff6b61c3eb0f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:18.234791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83f16e-14e4-4c90-8ca6-a3baf63fc656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:18.235455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f16e-14e4-4c90-8ca6-a3baf63fc656 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:18.235731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f16e-14e4-4c90-8ca6-a3baf63fc656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:18.236003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f16e-14e4-4c90-8ca6-a3baf63fc656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:18.236911 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83f16e-14e4-4c90-8ca6-a3baf63fc656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:18.238690 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83f16e-14e4-4c90-8ca6-a3baf63fc656 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:18.249628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1091/2177] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:18.253951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528315a-3c0a-47f2-ab9c-ec70440dd472 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:18.266151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528315a-3c0a-47f2-ab9c-ec70440dd472 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:18.271207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfa179-7da2-481b-b461-7a2ebe1a5fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:18.271869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfa179-7da2-481b-b461-7a2ebe1a5fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:18.272160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfa179-7da2-481b-b461-7a2ebe1a5fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:18.272416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfa179-7da2-481b-b461-7a2ebe1a5fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:18.273243 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfa179-7da2-481b-b461-7a2ebe1a5fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:18.275333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfa179-7da2-481b-b461-7a2ebe1a5fc1 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:18.286836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1087/2178] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:18.293167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83f16e-14e4-4c90-8ca6-a3baf63fc656 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:18.301865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83f16e-14e4-4c90-8ca6-a3baf63fc656 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:18.307213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf7e83-5d62-487c-b66d-c5c63add06ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:18.308104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf7e83-5d62-487c-b66d-c5c63add06ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:18.308387 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf7e83-5d62-487c-b66d-c5c63add06ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:18.308661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf7e83-5d62-487c-b66d-c5c63add06ff admin admin] PATH_INFO: `/v3/projects/6702bb6c8fb54289b2006a509c9c4725/users/2dcfafa952a34b649f22de701e4c88be/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:18.328814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf7e83-5d62-487c-b66d-c5c63add06ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6702bb6c8fb54289b2006a509c9c4725, user_id=2dcfafa952a34b649f22de701e4c88be, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:18.332324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf7e83-5d62-487c-b66d-c5c63add06ff admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:18.400574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1092/2179] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:48:18 2022] PUT /identity/v3/projects/6702bb6c8fb54289b2006a509c9c4725/users/2dcfafa952a34b649f22de701e4c88be/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:18.411748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8da9-70c7-465d-a593-202dc8f69f7a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:18.412038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8da9-70c7-465d-a593-202dc8f69f7a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:18.412338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8da9-70c7-465d-a593-202dc8f69f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:18.438772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-183d8da9-70c7-465d-a593-202dc8f69f7a None None] MFA Rules not processed for user `2dcfafa952a34b649f22de701e4c88be`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:18.439975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-183d8da9-70c7-465d-a593-202dc8f69f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:18.496136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:18.522638 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1088/2180] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:48:18.526842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf7e83-5d62-487c-b66d-c5c63add06ff admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:18.586461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:18.600719 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf7e83-5d62-487c-b66d-c5c63add06ff admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:18.605581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b319dd-0a86-40d9-b74f-ffe84f10a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:18.606307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b319dd-0a86-40d9-b74f-ffe84f10a638 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:18.606593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b319dd-0a86-40d9-b74f-ffe84f10a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:18.606872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b319dd-0a86-40d9-b74f-ffe84f10a638 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:18.607577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b319dd-0a86-40d9-b74f-ffe84f10a638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:18.613380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b319dd-0a86-40d9-b74f-ffe84f10a638 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:18.753055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1093/2181] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:48:18 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:48:18.756919 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8da9-70c7-465d-a593-202dc8f69f7a None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:18.769798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8da9-70c7-465d-a593-202dc8f69f7a None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:18.856519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d01f-4d4c-4893-8442-a54f20f15efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:18.860728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d01f-4d4c-4893-8442-a54f20f15efa admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:18.860728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d01f-4d4c-4893-8442-a54f20f15efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:18.860728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d01f-4d4c-4893-8442-a54f20f15efa admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:18.860728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d01f-4d4c-4893-8442-a54f20f15efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:18.860728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d01f-4d4c-4893-8442-a54f20f15efa admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:18.998976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1089/2182] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:48:18 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:48:19.003185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b319dd-0a86-40d9-b74f-ffe84f10a638 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:19.017316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b319dd-0a86-40d9-b74f-ffe84f10a638 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:19.024135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886e63d-7e28-4b9a-af03-09578e0e6076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:19.024995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e63d-7e28-4b9a-af03-09578e0e6076 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:19.025381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e63d-7e28-4b9a-af03-09578e0e6076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:19.025774 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e63d-7e28-4b9a-af03-09578e0e6076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:19.026698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886e63d-7e28-4b9a-af03-09578e0e6076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:19.029123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886e63d-7e28-4b9a-af03-09578e0e6076 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:19.042779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1094/2183] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:19.046594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d01f-4d4c-4893-8442-a54f20f15efa admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:19.059564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d01f-4d4c-4893-8442-a54f20f15efa admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:19.064551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03357b-3b1a-4430-a4ed-4515256b18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:19.065767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03357b-3b1a-4430-a4ed-4515256b18a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:19.066438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03357b-3b1a-4430-a4ed-4515256b18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:19.066567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03357b-3b1a-4430-a4ed-4515256b18a7 admin admin] PATH_INFO: `/v3/projects/e9541b24ac954e91b70aeb30c9688e1c/users/2769a44896b24c2c933a36c52877c9e9/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:19.085372 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03357b-3b1a-4430-a4ed-4515256b18a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9541b24ac954e91b70aeb30c9688e1c, user_id=2769a44896b24c2c933a36c52877c9e9, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:19.088178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03357b-3b1a-4430-a4ed-4515256b18a7 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:19.183353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1090/2184] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:48:19 2022] PUT /identity/v3/projects/e9541b24ac954e91b70aeb30c9688e1c/users/2769a44896b24c2c933a36c52877c9e9/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:19.187355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886e63d-7e28-4b9a-af03-09578e0e6076 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:19.197555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886e63d-7e28-4b9a-af03-09578e0e6076 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:19.253371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86c471-e771-49d8-885b-4768aaa7db27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:19.253923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86c471-e771-49d8-885b-4768aaa7db27 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:19.254205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86c471-e771-49d8-885b-4768aaa7db27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:19.254509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86c471-e771-49d8-885b-4768aaa7db27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:19.255238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86c471-e771-49d8-885b-4768aaa7db27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:19.256828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86c471-e771-49d8-885b-4768aaa7db27 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:19.266512 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1095/2185] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:19.270661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03357b-3b1a-4430-a4ed-4515256b18a7 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:19.281436 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03357b-3b1a-4430-a4ed-4515256b18a7 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:19.286215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9503f18-85a1-4e04-b05b-3f2d27fee1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:19.287120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9503f18-85a1-4e04-b05b-3f2d27fee1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:19.287408 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9503f18-85a1-4e04-b05b-3f2d27fee1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:19.287688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9503f18-85a1-4e04-b05b-3f2d27fee1a1 admin admin] PATH_INFO: `/v3/projects/e9541b24ac954e91b70aeb30c9688e1c/users/2769a44896b24c2c933a36c52877c9e9/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:19.290389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9503f18-85a1-4e04-b05b-3f2d27fee1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9541b24ac954e91b70aeb30c9688e1c, user_id=2769a44896b24c2c933a36c52877c9e9, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:19.293049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9503f18-85a1-4e04-b05b-3f2d27fee1a1 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:19.303249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1091/2186] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:48:19 2022] PUT /identity/v3/projects/e9541b24ac954e91b70aeb30c9688e1c/users/2769a44896b24c2c933a36c52877c9e9/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:19.313404 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef35224-a772-4dcb-997e-51e72313e015 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:19.313689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef35224-a772-4dcb-997e-51e72313e015 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:19.313973 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef35224-a772-4dcb-997e-51e72313e015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:19.340334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-5ef35224-a772-4dcb-997e-51e72313e015 None None] MFA Rules not processed for user `2769a44896b24c2c933a36c52877c9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:19.341541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5ef35224-a772-4dcb-997e-51e72313e015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:19.410969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1096/2187] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:19.422685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9503f18-85a1-4e04-b05b-3f2d27fee1a1 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:19.424484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e9503f18-85a1-4e04-b05b-3f2d27fee1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:19.481939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9503f18-85a1-4e04-b05b-3f2d27fee1a1 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:19.485872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6231f-7a06-487d-9e40-ed119fb33933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:19.486575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6231f-7a06-487d-9e40-ed119fb33933 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:19.486867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6231f-7a06-487d-9e40-ed119fb33933 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:19.487150 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6231f-7a06-487d-9e40-ed119fb33933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:19.546406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:19.550045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6231f-7a06-487d-9e40-ed119fb33933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:19.551524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6231f-7a06-487d-9e40-ed119fb33933 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:19.560613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1092/2188] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:22.778368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef35224-a772-4dcb-997e-51e72313e015 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:22.828495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:22.848300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef35224-a772-4dcb-997e-51e72313e015 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:22.861175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:22.864216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:22.864216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:22.864216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] PATH_INFO: `/v3/users/2dcfafa952a34b649f22de701e4c88be` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:22.865277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dcfafa952a34b649f22de701e4c88be)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:22.867718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:23.133101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dcfafa952a34b649f22de701e4c88be'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:23.133974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dcfafa952a34b649f22de701e4c88be'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:23.216334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dcfafa952a34b649f22de701e4c88be'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:23.237384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dcfafa952a34b649f22de701e4c88be'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:23.249240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dcfafa952a34b649f22de701e4c88be'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:23.258270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1097/2189] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:48:22 2022] DELETE /identity/v3/users/2dcfafa952a34b649f22de701e4c88be => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:23.263295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185b8b-fcc3-4b6c-8984-8a69533be096 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:23.263769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185b8b-fcc3-4b6c-8984-8a69533be096 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:23.264746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185b8b-fcc3-4b6c-8984-8a69533be096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:23.286450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-4b185b8b-fcc3-4b6c-8984-8a69533be096 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:23.287925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4b185b8b-fcc3-4b6c-8984-8a69533be096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:23.370506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1093/2190] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:48:23.380643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:23.382542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:23.447737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111f7c8-43f1-46eb-be8c-e55c22967d31 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:23.451834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f6b1e-26a7-434a-bc4e-b94407fc6ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:23.453399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f6b1e-26a7-434a-bc4e-b94407fc6ebc service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:23.453399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f6b1e-26a7-434a-bc4e-b94407fc6ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:23.453399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f6b1e-26a7-434a-bc4e-b94407fc6ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:23.463098 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f6b1e-26a7-434a-bc4e-b94407fc6ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:23.464513 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f6b1e-26a7-434a-bc4e-b94407fc6ebc service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:23.474868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1098/2191] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:48:23.963081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b185b8b-fcc3-4b6c-8984-8a69533be096 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:23.964629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4b185b8b-fcc3-4b6c-8984-8a69533be096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:23.979175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b185b8b-fcc3-4b6c-8984-8a69533be096 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:23.985199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:23.986145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:23.986594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:23.986937 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] PATH_INFO: `/v3/projects/6702bb6c8fb54289b2006a509c9c4725` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:23.988425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6702bb6c8fb54289b2006a509c9c4725)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:23.990850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:24.087346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6702bb6c8fb54289b2006a509c9c4725', 'request_id': 'req-d33f6c17-9e96-45f6-b2ab-91aea759b997'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:24.168183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6702bb6c8fb54289b2006a509c9c4725', 'request_id': 'req-d33f6c17-9e96-45f6-b2ab-91aea759b997'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:24.177173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6702bb6c8fb54289b2006a509c9c4725', 'request_id': 'req-d33f6c17-9e96-45f6-b2ab-91aea759b997'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:24.192560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] The token cache is being invalidate because project 6702bb6c8fb54289b2006a509c9c4725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:48:24.193008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:24.193879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:24.200359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1094/2192] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:48:23 2022] DELETE /identity/v3/projects/6702bb6c8fb54289b2006a509c9c4725 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:24.201576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f6b1e-26a7-434a-bc4e-b94407fc6ebc service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:24.213404 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f6b1e-26a7-434a-bc4e-b94407fc6ebc service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:24.296624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f6362-0fbe-47b5-b5f4-7e3caadf8edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:24.297504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f6362-0fbe-47b5-b5f4-7e3caadf8edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:24.297947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f6362-0fbe-47b5-b5f4-7e3caadf8edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:24.301744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f6362-0fbe-47b5-b5f4-7e3caadf8edc admin admin] PATH_INFO: `/v3/users/2769a44896b24c2c933a36c52877c9e9` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:24.301744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f6362-0fbe-47b5-b5f4-7e3caadf8edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2769a44896b24c2c933a36c52877c9e9)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:24.301744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f6362-0fbe-47b5-b5f4-7e3caadf8edc admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:24.307345 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:24.526058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b72f6362-0fbe-47b5-b5f4-7e3caadf8edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2769a44896b24c2c933a36c52877c9e9'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:24.526739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b72f6362-0fbe-47b5-b5f4-7e3caadf8edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2769a44896b24c2c933a36c52877c9e9'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:24.604878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b72f6362-0fbe-47b5-b5f4-7e3caadf8edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2769a44896b24c2c933a36c52877c9e9'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:24.623920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b72f6362-0fbe-47b5-b5f4-7e3caadf8edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2769a44896b24c2c933a36c52877c9e9'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:24.633364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b72f6362-0fbe-47b5-b5f4-7e3caadf8edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2769a44896b24c2c933a36c52877c9e9'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:24.639748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1099/2193] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:48:24 2022] DELETE /identity/v3/users/2769a44896b24c2c933a36c52877c9e9 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:25.274158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:25.275639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:25.289541 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6c17-9e96-45f6-b2ab-91aea759b997 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:25.364664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:25.365568 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:25.365881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:25.366158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] PATH_INFO: `/v3/projects/e9541b24ac954e91b70aeb30c9688e1c` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:25.367509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9541b24ac954e91b70aeb30c9688e1c)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:25.369426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:25.391362 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:25.498253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9541b24ac954e91b70aeb30c9688e1c', 'request_id': 'req-82d373cc-24a3-491d-baaa-f8e964953764'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:25.614175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9541b24ac954e91b70aeb30c9688e1c', 'request_id': 'req-82d373cc-24a3-491d-baaa-f8e964953764'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:25.622036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9541b24ac954e91b70aeb30c9688e1c', 'request_id': 'req-82d373cc-24a3-491d-baaa-f8e964953764'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:25.634840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] The token cache is being invalidate because project e9541b24ac954e91b70aeb30c9688e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:48:25.635285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:25.636171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-82d373cc-24a3-491d-baaa-f8e964953764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:25.637835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1095/2194] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:48:25 2022] DELETE /identity/v3/projects/e9541b24ac954e91b70aeb30c9688e1c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:25.642772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440de47-256e-4b38-8365-deb01416141e None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:25.643252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440de47-256e-4b38-8365-deb01416141e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:25.643343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440de47-256e-4b38-8365-deb01416141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:25.662031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-8440de47-256e-4b38-8365-deb01416141e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:25.663298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8440de47-256e-4b38-8365-deb01416141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:25.749241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1100/2195] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:25.757010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e535c3-5d91-4c06-a4d6-1fdd65213466 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:25.757935 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e535c3-5d91-4c06-a4d6-1fdd65213466 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:25.758215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e535c3-5d91-4c06-a4d6-1fdd65213466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:25.776954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c0e535c3-5d91-4c06-a4d6-1fdd65213466 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:25.778153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c0e535c3-5d91-4c06-a4d6-1fdd65213466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:25.787645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1096/2196] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:25.791788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440de47-256e-4b38-8365-deb01416141e None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:25.801423 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440de47-256e-4b38-8365-deb01416141e None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:25.806058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dbb78-f868-464a-8cff-ab225c3e37c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:25.808762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dbb78-f868-464a-8cff-ab225c3e37c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:25.808762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dbb78-f868-464a-8cff-ab225c3e37c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:25.808762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dbb78-f868-464a-8cff-ab225c3e37c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:25.808762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dbb78-f868-464a-8cff-ab225c3e37c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:48:25.808762 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dbb78-f868-464a-8cff-ab225c3e37c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:25.810188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dbb78-f868-464a-8cff-ab225c3e37c2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:25.823417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1101/2197] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:48:25.827830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e535c3-5d91-4c06-a4d6-1fdd65213466 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:25.838789 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e535c3-5d91-4c06-a4d6-1fdd65213466 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:25.844134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e49b4-728d-43dc-8f6e-4a0685ad6513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:25.844829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e49b4-728d-43dc-8f6e-4a0685ad6513 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:25.845130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e49b4-728d-43dc-8f6e-4a0685ad6513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:25.845428 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e49b4-728d-43dc-8f6e-4a0685ad6513 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:25.846150 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e49b4-728d-43dc-8f6e-4a0685ad6513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:25.848139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e49b4-728d-43dc-8f6e-4a0685ad6513 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:25.906522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dbb78-f868-464a-8cff-ab225c3e37c2 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:25.910330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8c1dbb78-f868-464a-8cff-ab225c3e37c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:25.921482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dbb78-f868-464a-8cff-ab225c3e37c2 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:25.926379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578c3c6-1358-4c63-9314-ebc3805e333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:25.927252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c3c6-1358-4c63-9314-ebc3805e333c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:25.927541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c3c6-1358-4c63-9314-ebc3805e333c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:25.927836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c3c6-1358-4c63-9314-ebc3805e333c admin admin] PATH_INFO: `/v3/users/20d14f605ff24463b3389601ed83db96` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:25.929332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578c3c6-1358-4c63-9314-ebc3805e333c admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d14f605ff24463b3389601ed83db96)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:25.931135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578c3c6-1358-4c63-9314-ebc3805e333c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:25.973711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1097/2198] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:48:25 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:48:25.977011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e49b4-728d-43dc-8f6e-4a0685ad6513 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:26.040799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e49b4-728d-43dc-8f6e-4a0685ad6513 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:26.045544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d22d7-9f3e-4d35-8e72-fd469016d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:26.046206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d22d7-9f3e-4d35-8e72-fd469016d365 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:26.046508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d22d7-9f3e-4d35-8e72-fd469016d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:26.046783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d22d7-9f3e-4d35-8e72-fd469016d365 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:26.047469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d22d7-9f3e-4d35-8e72-fd469016d365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:26.049416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d22d7-9f3e-4d35-8e72-fd469016d365 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:26.183647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1098/2199] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:48:25 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:48:26.185186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe25f-ffa6-46c3-a780-d8478955b6b8 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:26.185481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe25f-ffa6-46c3-a780-d8478955b6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:26.185760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe25f-ffa6-46c3-a780-d8478955b6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:26.195923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5578c3c6-1358-4c63-9314-ebc3805e333c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d14f605ff24463b3389601ed83db96'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:26.196678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5578c3c6-1358-4c63-9314-ebc3805e333c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d14f605ff24463b3389601ed83db96'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:26.209372 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-96bbe25f-ffa6-46c3-a780-d8478955b6b8 None None] MFA Rules not processed for user `cc861f1c354f45b09cb61fd86245a5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:26.209372 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-96bbe25f-ffa6-46c3-a780-d8478955b6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:26.269518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1099/2200] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:26.270449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbe25f-ffa6-46c3-a780-d8478955b6b8 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:26.275574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-96bbe25f-ffa6-46c3-a780-d8478955b6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:26.302580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbe25f-ffa6-46c3-a780-d8478955b6b8 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:26.307087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5578c3c6-1358-4c63-9314-ebc3805e333c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d14f605ff24463b3389601ed83db96'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:26.308512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3d739-f438-4c57-9b59-ad13c5bc21fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:26.309992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3d739-f438-4c57-9b59-ad13c5bc21fc admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:26.310523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3d739-f438-4c57-9b59-ad13c5bc21fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:26.315325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3d739-f438-4c57-9b59-ad13c5bc21fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:26.315325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3d739-f438-4c57-9b59-ad13c5bc21fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:26.315325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3d739-f438-4c57-9b59-ad13c5bc21fc admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:26.320909 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:26.331410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5578c3c6-1358-4c63-9314-ebc3805e333c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d14f605ff24463b3389601ed83db96'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:26.334418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1100/2201] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:26.336200 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3d739-f438-4c57-9b59-ad13c5bc21fc admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:26.342097 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:26.346039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5578c3c6-1358-4c63-9314-ebc3805e333c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d14f605ff24463b3389601ed83db96'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:26.348151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3d739-f438-4c57-9b59-ad13c5bc21fc admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:26.353072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1102/2202] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:48:25 2022] DELETE /identity/v3/users/20d14f605ff24463b3389601ed83db96 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:26.355135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ab495-d534-484e-99c9-235874bca2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:26.356490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab495-d534-484e-99c9-235874bca2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:26.356811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab495-d534-484e-99c9-235874bca2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:26.357108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab495-d534-484e-99c9-235874bca2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:26.357578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f513-47c9-441e-906d-dde2429310f8 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:26.357885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ab495-d534-484e-99c9-235874bca2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:26.358013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f513-47c9-441e-906d-dde2429310f8 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:26.358448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f513-47c9-441e-906d-dde2429310f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:26.360480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ab495-d534-484e-99c9-235874bca2ac admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:26.376930 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1101/2203] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:48:26.381616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c3a7f513-47c9-441e-906d-dde2429310f8 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:26.382963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c3a7f513-47c9-441e-906d-dde2429310f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:26.384406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ab495-d534-484e-99c9-235874bca2ac admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:26.405484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ab495-d534-484e-99c9-235874bca2ac admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:26.486451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ef1d6-5f4b-44c2-94c3-43ae3988b0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:26.487477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ef1d6-5f4b-44c2-94c3-43ae3988b0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:26.487791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1103/2204] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:48:26.489172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ef1d6-5f4b-44c2-94c3-43ae3988b0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:26.494464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ef1d6-5f4b-44c2-94c3-43ae3988b0b5 admin admin] PATH_INFO: `/v3/projects/f9013ffced4049b4b99969c00d8acd20/users/3217dd91a6554e40993d156aa38673df/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:26.503930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7f513-47c9-441e-906d-dde2429310f8 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:26.506276 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c3a7f513-47c9-441e-906d-dde2429310f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:26.521810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ef1d6-5f4b-44c2-94c3-43ae3988b0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9013ffced4049b4b99969c00d8acd20, user_id=3217dd91a6554e40993d156aa38673df, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:26.523129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ef1d6-5f4b-44c2-94c3-43ae3988b0b5 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:26.577937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7f513-47c9-441e-906d-dde2429310f8 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:26.581638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a2927-5e0d-4edd-a4d3-ad9b1bcf414d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:26.582379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a2927-5e0d-4edd-a4d3-ad9b1bcf414d service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:26.582674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a2927-5e0d-4edd-a4d3-ad9b1bcf414d service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:26.582955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a2927-5e0d-4edd-a4d3-ad9b1bcf414d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:26.595423 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a2927-5e0d-4edd-a4d3-ad9b1bcf414d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:26.597832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a2927-5e0d-4edd-a4d3-ad9b1bcf414d service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:26.606467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1102/2205] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:48:26 2022] PUT /identity/v3/projects/f9013ffced4049b4b99969c00d8acd20/users/3217dd91a6554e40993d156aa38673df/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:26.618742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fef24-e23c-490e-878f-ca94a738b0e1 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:26.619162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fef24-e23c-490e-878f-ca94a738b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:26.619508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fef24-e23c-490e-878f-ca94a738b0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:26.621531 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1104/2206] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:26.651730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ae4fef24-e23c-490e-878f-ca94a738b0e1 None None] MFA Rules not processed for user `3217dd91a6554e40993d156aa38673df`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:26.653089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ae4fef24-e23c-490e-878f-ca94a738b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:26.741221 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1103/2207] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:48:26.752015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a2927-5e0d-4edd-a4d3-ad9b1bcf414d service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:26.753549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-073a2927-5e0d-4edd-a4d3-ad9b1bcf414d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:26.841077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a2927-5e0d-4edd-a4d3-ad9b1bcf414d service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:26.923214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:26.938713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf24fc-84a9-445c-8e46-ff26fd907b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:26.939464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf24fc-84a9-445c-8e46-ff26fd907b3a service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:26.939753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf24fc-84a9-445c-8e46-ff26fd907b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:26.940036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf24fc-84a9-445c-8e46-ff26fd907b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:26.952454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf24fc-84a9-445c-8e46-ff26fd907b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:26.953916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf24fc-84a9-445c-8e46-ff26fd907b3a service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:26.967323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1105/2208] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:27.122553 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fef24-e23c-490e-878f-ca94a738b0e1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:27.124328 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ae4fef24-e23c-490e-878f-ca94a738b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:27.219292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fef24-e23c-490e-878f-ca94a738b0e1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:27.223972 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:27.224841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:27.225123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:27.225426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] PATH_INFO: `/v3/projects/d7d0894e42ec4afba3a9d5804ffbd0f5` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:27.226793 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d0894e42ec4afba3a9d5804ffbd0f5)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:27.228726 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:27.235924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:27.402024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d0894e42ec4afba3a9d5804ffbd0f5', 'request_id': 'req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:27.506626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d0894e42ec4afba3a9d5804ffbd0f5', 'request_id': 'req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:27.519583 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d0894e42ec4afba3a9d5804ffbd0f5', 'request_id': 'req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:27.545506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] The token cache is being invalidate because project d7d0894e42ec4afba3a9d5804ffbd0f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:48:27.545922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:27.546637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-78b53d2d-9227-44cd-9d03-6fa0cf0dbf2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:27.548502 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1104/2209] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:48:27 2022] DELETE /identity/v3/projects/d7d0894e42ec4afba3a9d5804ffbd0f5 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:27.553579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4b01-130d-49c9-a02d-3fced77dd028 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:27.553952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4b01-130d-49c9-a02d-3fced77dd028 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:27.554831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4b01-130d-49c9-a02d-3fced77dd028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:27.598811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-bc6d4b01-130d-49c9-a02d-3fced77dd028 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:27.600084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-bc6d4b01-130d-49c9-a02d-3fced77dd028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:27.707503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1106/2210] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:48:27.715631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f84d-0940-484c-bab9-f752bbf2e483 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:27.715992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f84d-0940-484c-bab9-f752bbf2e483 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:27.716333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f84d-0940-484c-bab9-f752bbf2e483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:27.740597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-41a9f84d-0940-484c-bab9-f752bbf2e483 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:27.740597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-41a9f84d-0940-484c-bab9-f752bbf2e483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:27.751353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1105/2211] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:48:27.755410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d4b01-130d-49c9-a02d-3fced77dd028 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:27.768264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d4b01-130d-49c9-a02d-3fced77dd028 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:27.774526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a31c30-3dc2-4e4d-8437-49620c5045ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:27.775249 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a31c30-3dc2-4e4d-8437-49620c5045ba admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:27.775593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a31c30-3dc2-4e4d-8437-49620c5045ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:27.775877 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a31c30-3dc2-4e4d-8437-49620c5045ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:27.776679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a31c30-3dc2-4e4d-8437-49620c5045ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:48:27.776909 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a31c30-3dc2-4e4d-8437-49620c5045ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:27.778574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a31c30-3dc2-4e4d-8437-49620c5045ba admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:27.794281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1107/2212] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:48:27.797515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f84d-0940-484c-bab9-f752bbf2e483 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:27.805350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f84d-0940-484c-bab9-f752bbf2e483 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:27.810420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3823d7-995f-47e6-bdf5-7e49bee9f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:27.811071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3823d7-995f-47e6-bdf5-7e49bee9f4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:27.811352 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3823d7-995f-47e6-bdf5-7e49bee9f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:27.811625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3823d7-995f-47e6-bdf5-7e49bee9f4e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:27.812619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3823d7-995f-47e6-bdf5-7e49bee9f4e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:27.814577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3823d7-995f-47e6-bdf5-7e49bee9f4e4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:27.938338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1106/2213] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:48:27 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:48:27.942432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a31c30-3dc2-4e4d-8437-49620c5045ba admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:27.952646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a31c30-3dc2-4e4d-8437-49620c5045ba admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:28.021511 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382784ca-f74b-4ce7-a701-517fe3039303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:28.022201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382784ca-f74b-4ce7-a701-517fe3039303 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:28.022520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382784ca-f74b-4ce7-a701-517fe3039303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:28.022798 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382784ca-f74b-4ce7-a701-517fe3039303 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:28.023528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382784ca-f74b-4ce7-a701-517fe3039303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:28.025492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382784ca-f74b-4ce7-a701-517fe3039303 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:28.142627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1108/2214] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:48:27 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:48:28.143752 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3823d7-995f-47e6-bdf5-7e49bee9f4e4 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:28.157001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3823d7-995f-47e6-bdf5-7e49bee9f4e4 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:28.162900 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046840-f09d-4892-8df9-d37286f77356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:28.170479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046840-f09d-4892-8df9-d37286f77356 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:28.170479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046840-f09d-4892-8df9-d37286f77356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:28.170479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046840-f09d-4892-8df9-d37286f77356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:28.170479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046840-f09d-4892-8df9-d37286f77356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:28.170479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046840-f09d-4892-8df9-d37286f77356 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:28.181527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1107/2215] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:28.185641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382784ca-f74b-4ce7-a701-517fe3039303 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:28.195765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382784ca-f74b-4ce7-a701-517fe3039303 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:28.200849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab834b-2d1d-46fd-a981-b68b62b4842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:28.201795 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab834b-2d1d-46fd-a981-b68b62b4842a admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:28.202088 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab834b-2d1d-46fd-a981-b68b62b4842a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:28.202407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab834b-2d1d-46fd-a981-b68b62b4842a admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:28.203181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab834b-2d1d-46fd-a981-b68b62b4842a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:28.204820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab834b-2d1d-46fd-a981-b68b62b4842a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:28.215512 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1109/2216] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:28.219791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046840-f09d-4892-8df9-d37286f77356 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:28.230277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046840-f09d-4892-8df9-d37286f77356 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:28.234775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64db6e-3795-49fd-9779-bae992d68094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:28.235642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64db6e-3795-49fd-9779-bae992d68094 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:28.235948 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64db6e-3795-49fd-9779-bae992d68094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:28.236219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64db6e-3795-49fd-9779-bae992d68094 admin admin] PATH_INFO: `/v3/projects/4208c1a371ba45bcbc8755232bfe9f32/users/a6b4603a9ecd4443b5783e229b29d5f7/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:28.251524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64db6e-3795-49fd-9779-bae992d68094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4208c1a371ba45bcbc8755232bfe9f32, user_id=a6b4603a9ecd4443b5783e229b29d5f7, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:28.254176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64db6e-3795-49fd-9779-bae992d68094 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:28.330840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1108/2217] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:48:28 2022] PUT /identity/v3/projects/4208c1a371ba45bcbc8755232bfe9f32/users/a6b4603a9ecd4443b5783e229b29d5f7/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:28.341765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13d12-d952-4fbe-a759-2146b8da6b80 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:28.342056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13d12-d952-4fbe-a759-2146b8da6b80 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:28.342420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13d12-d952-4fbe-a759-2146b8da6b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:28.371002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-20c13d12-d952-4fbe-a759-2146b8da6b80 None None] MFA Rules not processed for user `a6b4603a9ecd4443b5783e229b29d5f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:28.372223 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-20c13d12-d952-4fbe-a759-2146b8da6b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:28.415566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:28.446626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1110/2218] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:28.454706 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64db6e-3795-49fd-9779-bae992d68094 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:28.456403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2d64db6e-3795-49fd-9779-bae992d68094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:28.515894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64db6e-3795-49fd-9779-bae992d68094 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:28.519555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd369bd-8835-4ad9-ac66-ac7b3bfb3e83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:28.520203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd369bd-8835-4ad9-ac66-ac7b3bfb3e83 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:28.520485 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd369bd-8835-4ad9-ac66-ac7b3bfb3e83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:28.520761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd369bd-8835-4ad9-ac66-ac7b3bfb3e83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:28.530453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd369bd-8835-4ad9-ac66-ac7b3bfb3e83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:28.531873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd369bd-8835-4ad9-ac66-ac7b3bfb3e83 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:28.541416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1109/2219] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:28.808449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42487da-28a3-4909-be03-f55833cceb85 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:28.808926 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42487da-28a3-4909-be03-f55833cceb85 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:28.809147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42487da-28a3-4909-be03-f55833cceb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:28.827283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-f42487da-28a3-4909-be03-f55833cceb85 None None] MFA Rules not processed for user `3217dd91a6554e40993d156aa38673df`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:28.828464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f42487da-28a3-4909-be03-f55833cceb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:28.883530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1111/2220] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:38.536780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:38.875978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=34 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:47.653340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd369bd-8835-4ad9-ac66-ac7b3bfb3e83 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:47.788269 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd369bd-8835-4ad9-ac66-ac7b3bfb3e83 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:47.794010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:47.795321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:47.795772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:47.796115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] PATH_INFO: `/v3/users/a6b4603a9ecd4443b5783e229b29d5f7` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:47.797959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b4603a9ecd4443b5783e229b29d5f7)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:47.800718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:47.974042 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b4603a9ecd4443b5783e229b29d5f7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:47.974875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b4603a9ecd4443b5783e229b29d5f7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:48.000271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b4603a9ecd4443b5783e229b29d5f7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:48.062329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b4603a9ecd4443b5783e229b29d5f7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:48.069844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b4603a9ecd4443b5783e229b29d5f7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:48.076451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1110/2221] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:48:47 2022] DELETE /identity/v3/users/a6b4603a9ecd4443b5783e229b29d5f7 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:48.081035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9be3b7-9565-4bd7-970c-ce6bb0270309 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:48.081532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9be3b7-9565-4bd7-970c-ce6bb0270309 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:48.081626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9be3b7-9565-4bd7-970c-ce6bb0270309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:48.133797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-8e9be3b7-9565-4bd7-970c-ce6bb0270309 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:48.135063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8e9be3b7-9565-4bd7-970c-ce6bb0270309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:48.207318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1112/2222] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:48.216932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:48.218387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:48.267296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:48.323141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b78dfd-6e1a-4732-8c1e-bfba7fc8c97b admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:48.326828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b4502-e827-41f4-b7e5-a1c6a8362d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:48.327513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b4502-e827-41f4-b7e5-a1c6a8362d2a service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:48.327800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b4502-e827-41f4-b7e5-a1c6a8362d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:48.328070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b4502-e827-41f4-b7e5-a1c6a8362d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:48.337210 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b4502-e827-41f4-b7e5-a1c6a8362d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:48.338711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b4502-e827-41f4-b7e5-a1c6a8362d2a service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:48.348348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1111/2223] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:48.815202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9be3b7-9565-4bd7-970c-ce6bb0270309 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:48.819228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8e9be3b7-9565-4bd7-970c-ce6bb0270309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:48.834022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9be3b7-9565-4bd7-970c-ce6bb0270309 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:48.840825 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:48.841985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:48.845396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:48.845396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] PATH_INFO: `/v3/projects/4208c1a371ba45bcbc8755232bfe9f32` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:48.845396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4208c1a371ba45bcbc8755232bfe9f32)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:48.847158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:48.956490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4208c1a371ba45bcbc8755232bfe9f32', 'request_id': 'req-1c1c0c13-9742-4022-9777-691694eda5e7'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:49.049698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4208c1a371ba45bcbc8755232bfe9f32', 'request_id': 'req-1c1c0c13-9742-4022-9777-691694eda5e7'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:49.058456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4208c1a371ba45bcbc8755232bfe9f32', 'request_id': 'req-1c1c0c13-9742-4022-9777-691694eda5e7'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:49.076760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] The token cache is being invalidate because project 4208c1a371ba45bcbc8755232bfe9f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:48:49.077201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:49.078006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-1c1c0c13-9742-4022-9777-691694eda5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:49.083797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1113/2224] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:48:48 2022] DELETE /identity/v3/projects/4208c1a371ba45bcbc8755232bfe9f32 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:49.087827 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aab83-2ccd-4960-91b9-72e1cf82fb3f None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:49.088270 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aab83-2ccd-4960-91b9-72e1cf82fb3f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:49.088360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aab83-2ccd-4960-91b9-72e1cf82fb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:49.145625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-783aab83-2ccd-4960-91b9-72e1cf82fb3f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:49.147429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-783aab83-2ccd-4960-91b9-72e1cf82fb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:49.222930 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1112/2225] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:49.230308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48dd16-e3ff-4c07-8586-716c7cb95602 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:49.230617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48dd16-e3ff-4c07-8586-716c7cb95602 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:49.230883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48dd16-e3ff-4c07-8586-716c7cb95602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:49.249792 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-fe48dd16-e3ff-4c07-8586-716c7cb95602 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:49.250922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fe48dd16-e3ff-4c07-8586-716c7cb95602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:49.260630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1114/2226] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:49.264852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783aab83-2ccd-4960-91b9-72e1cf82fb3f None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:49.274910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783aab83-2ccd-4960-91b9-72e1cf82fb3f None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:49.279564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c12f18-fbce-4aa4-b3a7-f9a485457f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:49.280217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c12f18-fbce-4aa4-b3a7-f9a485457f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:49.280498 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c12f18-fbce-4aa4-b3a7-f9a485457f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:49.280769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c12f18-fbce-4aa4-b3a7-f9a485457f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:49.281492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c12f18-fbce-4aa4-b3a7-f9a485457f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:48:49.281800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c12f18-fbce-4aa4-b3a7-f9a485457f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:49.283417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c12f18-fbce-4aa4-b3a7-f9a485457f76 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:49.295244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1113/2227] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:48:49.299262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48dd16-e3ff-4c07-8586-716c7cb95602 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:49.308958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48dd16-e3ff-4c07-8586-716c7cb95602 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:49.313730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb9856-1bde-4c19-8465-c243ed642582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:49.314449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9856-1bde-4c19-8465-c243ed642582 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:49.314735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9856-1bde-4c19-8465-c243ed642582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:49.315010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9856-1bde-4c19-8465-c243ed642582 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:49.315708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb9856-1bde-4c19-8465-c243ed642582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:49.317659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb9856-1bde-4c19-8465-c243ed642582 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:49.423519 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1115/2228] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:48:49 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:48:49.427409 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c12f18-fbce-4aa4-b3a7-f9a485457f76 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:49.437859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c12f18-fbce-4aa4-b3a7-f9a485457f76 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:49.498274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f6602-cc6d-4eb1-bc62-c0f288e7a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:49.498889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f6602-cc6d-4eb1-bc62-c0f288e7a7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:49.499178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f6602-cc6d-4eb1-bc62-c0f288e7a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:49.499508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f6602-cc6d-4eb1-bc62-c0f288e7a7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:49.500150 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f6602-cc6d-4eb1-bc62-c0f288e7a7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:49.502110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f6602-cc6d-4eb1-bc62-c0f288e7a7a7 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:49.610880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:49.616732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1114/2229] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:48:49 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:48:49.621434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb9856-1bde-4c19-8465-c243ed642582 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:49.632455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb9856-1bde-4c19-8465-c243ed642582 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:49.637011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900046ef-ca3f-4701-91dc-5b5b23799643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:49.637669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900046ef-ca3f-4701-91dc-5b5b23799643 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:49.637956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900046ef-ca3f-4701-91dc-5b5b23799643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:49.638247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900046ef-ca3f-4701-91dc-5b5b23799643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:49.639026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900046ef-ca3f-4701-91dc-5b5b23799643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:49.640638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900046ef-ca3f-4701-91dc-5b5b23799643 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:49.651179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1116/2230] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:49.655430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f6602-cc6d-4eb1-bc62-c0f288e7a7a7 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:49.667406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f6602-cc6d-4eb1-bc62-c0f288e7a7a7 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:49.673737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9ecc8-7bf0-481f-aa49-b62b964c4283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:49.674575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ecc8-7bf0-481f-aa49-b62b964c4283 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:49.674923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ecc8-7bf0-481f-aa49-b62b964c4283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:49.675265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ecc8-7bf0-481f-aa49-b62b964c4283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:49.676070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9ecc8-7bf0-481f-aa49-b62b964c4283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:49.677814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9ecc8-7bf0-481f-aa49-b62b964c4283 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:49.690109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1115/2231] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:48:49.694090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900046ef-ca3f-4701-91dc-5b5b23799643 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:49.708811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900046ef-ca3f-4701-91dc-5b5b23799643 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:49.714054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50356ee-2612-4989-899c-967950a8799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:49.715008 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50356ee-2612-4989-899c-967950a8799a admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:49.715286 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50356ee-2612-4989-899c-967950a8799a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:49.715560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50356ee-2612-4989-899c-967950a8799a admin admin] PATH_INFO: `/v3/projects/40eb388cd72843fbb288020f33cd73f3/users/c8b81a82cf634d579f796edd0d637686/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:49.733091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50356ee-2612-4989-899c-967950a8799a admin admin] RBAC: Authorizing `identity:create_grant(project_id=40eb388cd72843fbb288020f33cd73f3, user_id=c8b81a82cf634d579f796edd0d637686, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:49.735806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50356ee-2612-4989-899c-967950a8799a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:49.738111 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:49.799609 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1117/2232] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:48:49 2022] PUT /identity/v3/projects/40eb388cd72843fbb288020f33cd73f3/users/c8b81a82cf634d579f796edd0d637686/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:49.805553 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a421-ef49-4a07-930a-a6daa59635c0 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:49.806052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a421-ef49-4a07-930a-a6daa59635c0 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:49.806468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a421-ef49-4a07-930a-a6daa59635c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:49.824769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-2794a421-ef49-4a07-930a-a6daa59635c0 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:49.825973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2794a421-ef49-4a07-930a-a6daa59635c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:49.902464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1116/2233] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:49.912022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50356ee-2612-4989-899c-967950a8799a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:49.914022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c50356ee-2612-4989-899c-967950a8799a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:49.985659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50356ee-2612-4989-899c-967950a8799a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:49.989444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcc97e-8122-49b7-9566-077e3518eeaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:49.990152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcc97e-8122-49b7-9566-077e3518eeaf service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:49.990992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcc97e-8122-49b7-9566-077e3518eeaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:49.990992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcc97e-8122-49b7-9566-077e3518eeaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:50.000550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcc97e-8122-49b7-9566-077e3518eeaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:50.002352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcc97e-8122-49b7-9566-077e3518eeaf service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:50.012458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1118/2234] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:53.341273 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6a01b-5e8c-4fb7-807f-eb50541292e7 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:53.341840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6a01b-5e8c-4fb7-807f-eb50541292e7 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:53.341921 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6a01b-5e8c-4fb7-807f-eb50541292e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:53.373527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-40b6a01b-5e8c-4fb7-807f-eb50541292e7 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:53.374831 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-40b6a01b-5e8c-4fb7-807f-eb50541292e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:53.444777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1117/2235] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:48:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:48:53.511676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcc97e-8122-49b7-9566-077e3518eeaf service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:53.514223 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-dedcc97e-8122-49b7-9566-077e3518eeaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:53.637058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba69e-105e-4b2a-bb37-65a8cb2ecb93 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:53.637058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba69e-105e-4b2a-bb37-65a8cb2ecb93 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:53.637381 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba69e-105e-4b2a-bb37-65a8cb2ecb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:53.639857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcc97e-8122-49b7-9566-077e3518eeaf service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:53.646589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25389a-0ef9-4c2a-a9fe-b5d1a27d7054 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:53.647374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25389a-0ef9-4c2a-a9fe-b5d1a27d7054 service swift] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:53.647864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25389a-0ef9-4c2a-a9fe-b5d1a27d7054 service swift] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:53.649477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25389a-0ef9-4c2a-a9fe-b5d1a27d7054 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:53.657826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b3eba69e-105e-4b2a-bb37-65a8cb2ecb93 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:53.659136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b3eba69e-105e-4b2a-bb37-65a8cb2ecb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:53.662001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25389a-0ef9-4c2a-a9fe-b5d1a27d7054 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:53.664961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25389a-0ef9-4c2a-a9fe-b5d1a27d7054 service swift] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:53.669333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1118/2236] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:48:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:48:53.678478 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1119/2237] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:48:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:48:53.689456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eba69e-105e-4b2a-bb37-65a8cb2ecb93 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:53.705944 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eba69e-105e-4b2a-bb37-65a8cb2ecb93 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:53.709724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa54c8-5aa7-41e1-8678-d1152499f0a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:53.710524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa54c8-5aa7-41e1-8678-d1152499f0a7 service swift] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:53.710889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa54c8-5aa7-41e1-8678-d1152499f0a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:53.711760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa54c8-5aa7-41e1-8678-d1152499f0a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:53.722268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa54c8-5aa7-41e1-8678-d1152499f0a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:53.750740 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa54c8-5aa7-41e1-8678-d1152499f0a7 service swift] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:53.785552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1119/2238] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:48:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:48:57.328591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25389a-0ef9-4c2a-a9fe-b5d1a27d7054 service swift] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:57.330679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-dc25389a-0ef9-4c2a-a9fe-b5d1a27d7054 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:57.371495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25389a-0ef9-4c2a-a9fe-b5d1a27d7054 service swift] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:57.395933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:57.397129 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:57.397567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:57.398010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] PATH_INFO: `/v3/users/6c0b5ef746b9400faeb9caf17cd8dbb0` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:57.400024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0b5ef746b9400faeb9caf17cd8dbb0)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:57.402147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:57.650443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0b5ef746b9400faeb9caf17cd8dbb0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:57.654353 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0b5ef746b9400faeb9caf17cd8dbb0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:57.726386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0b5ef746b9400faeb9caf17cd8dbb0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:57.768751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0b5ef746b9400faeb9caf17cd8dbb0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:57.802864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0b5ef746b9400faeb9caf17cd8dbb0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:48:57.804640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:57.824419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1120/2239] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:48:57 2022] DELETE /identity/v3/users/6c0b5ef746b9400faeb9caf17cd8dbb0 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:48:57.830577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2eea-64f4-484d-93fe-2eeefba6df40 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:57.833557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2eea-64f4-484d-93fe-2eeefba6df40 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:57.833557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2eea-64f4-484d-93fe-2eeefba6df40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:57.919314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-830c2eea-64f4-484d-93fe-2eeefba6df40 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:57.928802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-830c2eea-64f4-484d-93fe-2eeefba6df40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:58.092992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1120/2240] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:48:58.158041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:48:58.160170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:48:58.469986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b522-06da-448f-bd51-a669ddd54a3a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:48:58.492888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9c32-bac3-467c-bf1d-4e4940c82a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:48:58.494113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9c32-bac3-467c-bf1d-4e4940c82a34 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:58.494633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9c32-bac3-467c-bf1d-4e4940c82a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:58.495147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9c32-bac3-467c-bf1d-4e4940c82a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:58.561576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b9c32-bac3-467c-bf1d-4e4940c82a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:48:58.566961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b9c32-bac3-467c-bf1d-4e4940c82a34 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:48:58.614657 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1121/2241] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:48:59.891713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92d09-a06e-4ecb-91e6-ffd7aa76a572 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:48:59.892519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92d09-a06e-4ecb-91e6-ffd7aa76a572 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:48:59.892519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92d09-a06e-4ecb-91e6-ffd7aa76a572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:48:59.902867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:48:59.963495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9ea92d09-a06e-4ecb-91e6-ffd7aa76a572 None None] MFA Rules not processed for user `c8b81a82cf634d579f796edd0d637686`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:48:59.965316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9ea92d09-a06e-4ecb-91e6-ffd7aa76a572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:00.152093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1121/2242] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:48:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:00.153281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9c32-bac3-467c-bf1d-4e4940c82a34 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:00.155928 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e80b9c32-bac3-467c-bf1d-4e4940c82a34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:00.186531 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9c32-bac3-467c-bf1d-4e4940c82a34 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:00.209900 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbfd76-545a-474c-842b-822ad4e0162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:00.211027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbfd76-545a-474c-842b-822ad4e0162f admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:00.211561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbfd76-545a-474c-842b-822ad4e0162f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:00.212063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbfd76-545a-474c-842b-822ad4e0162f admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:00.216814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbfd76-545a-474c-842b-822ad4e0162f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:00.243844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbfd76-545a-474c-842b-822ad4e0162f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:00.420187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1122/2243] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:49:00 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:49:00.425082 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea92d09-a06e-4ecb-91e6-ffd7aa76a572 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:00.445801 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea92d09-a06e-4ecb-91e6-ffd7aa76a572 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:00.569281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d800a0-0c65-417f-84cd-d4f3bf36b930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:00.569998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d800a0-0c65-417f-84cd-d4f3bf36b930 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:00.570353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d800a0-0c65-417f-84cd-d4f3bf36b930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:00.570731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d800a0-0c65-417f-84cd-d4f3bf36b930 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:00.571350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d800a0-0c65-417f-84cd-d4f3bf36b930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:00.577081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d800a0-0c65-417f-84cd-d4f3bf36b930 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:00.621418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbfd76-545a-474c-842b-822ad4e0162f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:00.629502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c3dbfd76-545a-474c-842b-822ad4e0162f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:00.663765 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbfd76-545a-474c-842b-822ad4e0162f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:00.693290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:00.694362 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:00.694651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:00.694928 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] PATH_INFO: `/v3/projects/2ae80f281b2146f8b51af281226c86d9` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:00.697073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae80f281b2146f8b51af281226c86d9)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:00.699318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:00.734030 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1122/2244] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:49:00 2022] POST /identity/v3/users => generated 292 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:49:00.749314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d800a0-0c65-417f-84cd-d4f3bf36b930 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:00.764708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d800a0-0c65-417f-84cd-d4f3bf36b930 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:00.776679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e0bb9-f5f6-4891-a5f2-272d200161e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:00.777393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e0bb9-f5f6-4891-a5f2-272d200161e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:00.777799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e0bb9-f5f6-4891-a5f2-272d200161e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:00.778008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e0bb9-f5f6-4891-a5f2-272d200161e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:00.780547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e0bb9-f5f6-4891-a5f2-272d200161e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:00.780813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e0bb9-f5f6-4891-a5f2-272d200161e6 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:00.795158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1123/2245] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:49:00.798306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e0bb9-f5f6-4891-a5f2-272d200161e6 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:00.820941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e0bb9-f5f6-4891-a5f2-272d200161e6 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:00.827041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b85ffb-612d-46ac-b8b3-5288dd182035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:00.828036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b85ffb-612d-46ac-b8b3-5288dd182035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:00.828405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b85ffb-612d-46ac-b8b3-5288dd182035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:00.828761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b85ffb-612d-46ac-b8b3-5288dd182035 admin admin] PATH_INFO: `/v3/projects/5f77ee5abf974fc0a334c5d12127694b/users/9633327de3db4d5092bc65d03b5c8901/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:00.845705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b85ffb-612d-46ac-b8b3-5288dd182035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f77ee5abf974fc0a334c5d12127694b, user_id=9633327de3db4d5092bc65d03b5c8901, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:00.848898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b85ffb-612d-46ac-b8b3-5288dd182035 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:00.963355 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1124/2246] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:49:00 2022] PUT /identity/v3/projects/5f77ee5abf974fc0a334c5d12127694b/users/9633327de3db4d5092bc65d03b5c8901/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:49:00.965552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b85ffb-612d-46ac-b8b3-5288dd182035 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:00.972995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae80f281b2146f8b51af281226c86d9', 'request_id': 'req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:01.067932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae80f281b2146f8b51af281226c86d9', 'request_id': 'req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:01.080236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae80f281b2146f8b51af281226c86d9', 'request_id': 'req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:01.104214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] The token cache is being invalidate because project 2ae80f281b2146f8b51af281226c86d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:49:01.104515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:01.108177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:01.136152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1123/2247] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:49:00 2022] DELETE /identity/v3/projects/2ae80f281b2146f8b51af281226c86d9 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:01.243949 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:01.309959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b85ffb-612d-46ac-b8b3-5288dd182035 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:01.455393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71093ce-aca4-40a5-8948-5c33495e53f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:01.456847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71093ce-aca4-40a5-8948-5c33495e53f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:01.457136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71093ce-aca4-40a5-8948-5c33495e53f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:01.457416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71093ce-aca4-40a5-8948-5c33495e53f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:01.458611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71093ce-aca4-40a5-8948-5c33495e53f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:01.461897 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71093ce-aca4-40a5-8948-5c33495e53f2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:01.489425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1125/2248] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:49:01.494393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:01.496385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:01.534085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa14e68-b7fd-4a10-aa47-b036f52a7e97 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:01.547163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb16a3c-ed5c-4fac-ae7f-01d5e7f94a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:01.548368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb16a3c-ed5c-4fac-ae7f-01d5e7f94a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:01.553392 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb16a3c-ed5c-4fac-ae7f-01d5e7f94a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:01.553910 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb16a3c-ed5c-4fac-ae7f-01d5e7f94a8a admin admin] PATH_INFO: `/v3/projects/5f77ee5abf974fc0a334c5d12127694b/users/9633327de3db4d5092bc65d03b5c8901/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:01.559274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb16a3c-ed5c-4fac-ae7f-01d5e7f94a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f77ee5abf974fc0a334c5d12127694b, user_id=9633327de3db4d5092bc65d03b5c8901, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:01.562794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb16a3c-ed5c-4fac-ae7f-01d5e7f94a8a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:01.577403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1124/2249] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:49:01 2022] PUT /identity/v3/projects/5f77ee5abf974fc0a334c5d12127694b/users/9633327de3db4d5092bc65d03b5c8901/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:11.571994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=68,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:11.588532 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=31 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:13.936612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607969e-c0cc-4319-b212-80037fc88ad9 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:13.937272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607969e-c0cc-4319-b212-80037fc88ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:13.937272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607969e-c0cc-4319-b212-80037fc88ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:13.988860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5607969e-c0cc-4319-b212-80037fc88ad9 None None] MFA Rules not processed for user `9633327de3db4d5092bc65d03b5c8901`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:13.990980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5607969e-c0cc-4319-b212-80037fc88ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:14.130030 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1126/2250] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:14.149494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb16a3c-ed5c-4fac-ae7f-01d5e7f94a8a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:14.151791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ccb16a3c-ed5c-4fac-ae7f-01d5e7f94a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:14.397888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb16a3c-ed5c-4fac-ae7f-01d5e7f94a8a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:14.430096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f780c71-33cd-47e7-9b31-1f86d103c91a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:14.431008 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780c71-33cd-47e7-9b31-1f86d103c91a service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:14.431403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780c71-33cd-47e7-9b31-1f86d103c91a service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:14.435066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780c71-33cd-47e7-9b31-1f86d103c91a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:14.441341 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-1f780c71-33cd-47e7-9b31-1f86d103c91a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:14.594966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f780c71-33cd-47e7-9b31-1f86d103c91a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:14.596804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f780c71-33cd-47e7-9b31-1f86d103c91a service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:14.627151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1125/2251] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:49:15.408796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc42848-d940-457c-af01-0be4fbdc3fb8 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:15.409776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc42848-d940-457c-af01-0be4fbdc3fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:15.410203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc42848-d940-457c-af01-0be4fbdc3fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:15.430716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ecc42848-d940-457c-af01-0be4fbdc3fb8 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:15.432302 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ecc42848-d940-457c-af01-0be4fbdc3fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:15.515416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1127/2252] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:49:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:15.570832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f780c71-33cd-47e7-9b31-1f86d103c91a service nova] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:15.573531 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-1f780c71-33cd-47e7-9b31-1f86d103c91a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:15.717551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f780c71-33cd-47e7-9b31-1f86d103c91a service nova] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:15.731555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3bdac-89c8-480f-aadf-1143eb7fd037 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:15.732967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3bdac-89c8-480f-aadf-1143eb7fd037 service swift] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:15.733580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3bdac-89c8-480f-aadf-1143eb7fd037 service swift] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:15.734177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3bdac-89c8-480f-aadf-1143eb7fd037 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:15.748385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3bdac-89c8-480f-aadf-1143eb7fd037 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:15.750320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3bdac-89c8-480f-aadf-1143eb7fd037 service swift] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:15.765034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:15.775034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1126/2253] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:49:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:49:17.359589 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3b24b-2158-4d3b-b400-729fe10c0837 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:17.360161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3b24b-2158-4d3b-b400-729fe10c0837 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:17.360161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3b24b-2158-4d3b-b400-729fe10c0837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:17.379582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-13d3b24b-2158-4d3b-b400-729fe10c0837 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:17.381078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-13d3b24b-2158-4d3b-b400-729fe10c0837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:17.391131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1128/2254] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jun 8 06:49:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:17.414592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3bdac-89c8-480f-aadf-1143eb7fd037 service swift] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:17.430187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3bdac-89c8-480f-aadf-1143eb7fd037 service swift] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:17.435681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703fd25-593e-443d-838e-cd6da6b5266c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:17.437405 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703fd25-593e-443d-838e-cd6da6b5266c service swift] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:17.437916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703fd25-593e-443d-838e-cd6da6b5266c service swift] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:17.438507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703fd25-593e-443d-838e-cd6da6b5266c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:17.449479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703fd25-593e-443d-838e-cd6da6b5266c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:17.451895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703fd25-593e-443d-838e-cd6da6b5266c service swift] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:17.463745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1127/2255] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:49:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:49:18.410220 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a75bc-2a88-4df8-a13b-3c40554cb6d7 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:18.410792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a75bc-2a88-4df8-a13b-3c40554cb6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:18.410792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a75bc-2a88-4df8-a13b-3c40554cb6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:18.439690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b85a75bc-2a88-4df8-a13b-3c40554cb6d7 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:18.450372 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b85a75bc-2a88-4df8-a13b-3c40554cb6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:18.461188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1129/2256] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:49:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:18.475794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703fd25-593e-443d-838e-cd6da6b5266c service swift] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:18.504775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703fd25-593e-443d-838e-cd6da6b5266c service swift] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:18.522213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4615b-7b97-4a08-aa07-7efb4a91da97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:18.522960 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4615b-7b97-4a08-aa07-7efb4a91da97 service swift] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:18.523254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4615b-7b97-4a08-aa07-7efb4a91da97 service swift] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:18.523538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4615b-7b97-4a08-aa07-7efb4a91da97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:18.553091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4615b-7b97-4a08-aa07-7efb4a91da97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:18.557579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4615b-7b97-4a08-aa07-7efb4a91da97 service swift] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:18.576234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1128/2257] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:49:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:49:18.667688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8b96f-6b79-4045-bd6e-16b83fc42feb None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:18.669085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8b96f-6b79-4045-bd6e-16b83fc42feb None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:18.669790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8b96f-6b79-4045-bd6e-16b83fc42feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:18.690380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-2eb8b96f-6b79-4045-bd6e-16b83fc42feb None None] MFA Rules not processed for user `c8b81a82cf634d579f796edd0d637686`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:18.691981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2eb8b96f-6b79-4045-bd6e-16b83fc42feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:18.710499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1130/2258] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:19.452933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220660c3-c69e-4210-b114-d96f2dfde556 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:19.458012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220660c3-c69e-4210-b114-d96f2dfde556 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:19.458514 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220660c3-c69e-4210-b114-d96f2dfde556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:19.497340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-220660c3-c69e-4210-b114-d96f2dfde556 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:19.500440 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-220660c3-c69e-4210-b114-d96f2dfde556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:19.513507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1129/2259] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jun 8 06:49:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:19.542449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8b96f-6b79-4045-bd6e-16b83fc42feb None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:19.564813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8b96f-6b79-4045-bd6e-16b83fc42feb None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:19.580265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691164b-28ed-47e3-95fe-9b706a4a8972 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:19.581197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691164b-28ed-47e3-95fe-9b706a4a8972 service swift] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:19.581720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691164b-28ed-47e3-95fe-9b706a4a8972 service swift] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:19.582154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691164b-28ed-47e3-95fe-9b706a4a8972 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:19.593104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691164b-28ed-47e3-95fe-9b706a4a8972 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:19.595091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691164b-28ed-47e3-95fe-9b706a4a8972 service swift] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:19.605186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1131/2260] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:49:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:49:23.151980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220660c3-c69e-4210-b114-d96f2dfde556 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:23.153489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-220660c3-c69e-4210-b114-d96f2dfde556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:23.231810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220660c3-c69e-4210-b114-d96f2dfde556 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:23.236386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:23.237306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:23.237592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:23.237869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] PATH_INFO: `/v3/users/3217dd91a6554e40993d156aa38673df` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:23.239119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3217dd91a6554e40993d156aa38673df)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:23.241055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:23.506417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3217dd91a6554e40993d156aa38673df'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:23.507587 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3217dd91a6554e40993d156aa38673df'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:23.576000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3217dd91a6554e40993d156aa38673df'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:23.592158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3217dd91a6554e40993d156aa38673df'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:23.601707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3217dd91a6554e40993d156aa38673df'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:23.608936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1130/2261] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:49:23 2022] DELETE /identity/v3/users/3217dd91a6554e40993d156aa38673df => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:23.614476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed283e7-8550-4b77-a2d9-4e65c5d3b5f5 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:23.614476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed283e7-8550-4b77-a2d9-4e65c5d3b5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:23.614476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed283e7-8550-4b77-a2d9-4e65c5d3b5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:23.635579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9ed283e7-8550-4b77-a2d9-4e65c5d3b5f5 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:23.636784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9ed283e7-8550-4b77-a2d9-4e65c5d3b5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:23.690128 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:23.700857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1132/2262] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:23.710731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:23.712146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:23.765740 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:23.771661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9857085-7f89-4e0b-ba19-99b870ef600f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:23.775295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b10094-feb2-466a-a23b-dad4553a8f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:23.775957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b10094-feb2-466a-a23b-dad4553a8f81 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:23.776236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b10094-feb2-466a-a23b-dad4553a8f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:23.776529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b10094-feb2-466a-a23b-dad4553a8f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:23.785394 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b10094-feb2-466a-a23b-dad4553a8f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:23.786864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b10094-feb2-466a-a23b-dad4553a8f81 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:23.796344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1131/2263] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:49:24.062445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed283e7-8550-4b77-a2d9-4e65c5d3b5f5 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:24.064296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9ed283e7-8550-4b77-a2d9-4e65c5d3b5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:24.080387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed283e7-8550-4b77-a2d9-4e65c5d3b5f5 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:24.082631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:24.083502 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.083787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.084061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] PATH_INFO: `/v3/projects/f9013ffced4049b4b99969c00d8acd20` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.085294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9013ffced4049b4b99969c00d8acd20)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:24.087920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:24.214872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9013ffced4049b4b99969c00d8acd20', 'request_id': 'req-55432bc4-ec34-43d9-b1de-487b063d3d77'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:24.294650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9013ffced4049b4b99969c00d8acd20', 'request_id': 'req-55432bc4-ec34-43d9-b1de-487b063d3d77'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:24.303494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9013ffced4049b4b99969c00d8acd20', 'request_id': 'req-55432bc4-ec34-43d9-b1de-487b063d3d77'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:24.318452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] The token cache is being invalidate because project f9013ffced4049b4b99969c00d8acd20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:49:24.319061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:24.320569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-55432bc4-ec34-43d9-b1de-487b063d3d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:24.322722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1133/2264] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:49:24 2022] DELETE /identity/v3/projects/f9013ffced4049b4b99969c00d8acd20 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:24.327627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510c570-2631-4f99-a8f0-b97808f22e4a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.328108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510c570-2631-4f99-a8f0-b97808f22e4a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.328215 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510c570-2631-4f99-a8f0-b97808f22e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.349504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-2510c570-2631-4f99-a8f0-b97808f22e4a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:24.350747 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2510c570-2631-4f99-a8f0-b97808f22e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:24.366845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939bdb5-095b-4fb2-a97e-d3bcb8210868 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.367137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939bdb5-095b-4fb2-a97e-d3bcb8210868 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.367420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939bdb5-095b-4fb2-a97e-d3bcb8210868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.420635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c939bdb5-095b-4fb2-a97e-d3bcb8210868 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:24.421887 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c939bdb5-095b-4fb2-a97e-d3bcb8210868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:24.426110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1132/2265] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:24.434558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea55c7e-82b4-4555-b97b-011f94b68737 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.435094 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea55c7e-82b4-4555-b97b-011f94b68737 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.435445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea55c7e-82b4-4555-b97b-011f94b68737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.455508 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-3ea55c7e-82b4-4555-b97b-011f94b68737 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:24.456783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3ea55c7e-82b4-4555-b97b-011f94b68737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:24.465409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1133/2266] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:49:24.469791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea55c7e-82b4-4555-b97b-011f94b68737 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:24.479709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea55c7e-82b4-4555-b97b-011f94b68737 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:24.484350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8ec7b-bcf6-4dac-a917-885dab529cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:24.485003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8ec7b-bcf6-4dac-a917-885dab529cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.485285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8ec7b-bcf6-4dac-a917-885dab529cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.485562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8ec7b-bcf6-4dac-a917-885dab529cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.486321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8ec7b-bcf6-4dac-a917-885dab529cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:49:24.486632 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8ec7b-bcf6-4dac-a917-885dab529cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:24.488241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8ec7b-bcf6-4dac-a917-885dab529cc4 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:24.489431 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1134/2267] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jun 8 06:49:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:49:24.500984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1134/2268] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:49:24.503816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939bdb5-095b-4fb2-a97e-d3bcb8210868 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:24.505501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c939bdb5-095b-4fb2-a97e-d3bcb8210868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:24.505641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8ec7b-bcf6-4dac-a917-885dab529cc4 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:24.521386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8ec7b-bcf6-4dac-a917-885dab529cc4 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:24.527457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02162c43-7cd0-4217-a687-f8026ef106c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:24.528121 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02162c43-7cd0-4217-a687-f8026ef106c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.528407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02162c43-7cd0-4217-a687-f8026ef106c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.528694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02162c43-7cd0-4217-a687-f8026ef106c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.529414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02162c43-7cd0-4217-a687-f8026ef106c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:24.531496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02162c43-7cd0-4217-a687-f8026ef106c2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:24.569136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:24.591563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1135/2269] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:49:24 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:49:24.595617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02162c43-7cd0-4217-a687-f8026ef106c2 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:24.623264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939bdb5-095b-4fb2-a97e-d3bcb8210868 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:24.708053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587488f-fc88-4726-8412-71be366a2e4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:24.708974 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587488f-fc88-4726-8412-71be366a2e4f service swift] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.709422 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587488f-fc88-4726-8412-71be366a2e4f service swift] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.709880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587488f-fc88-4726-8412-71be366a2e4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.723742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02162c43-7cd0-4217-a687-f8026ef106c2 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:24.740529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e12110-8694-4eee-92bc-207fba6ddc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:24.741228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e12110-8694-4eee-92bc-207fba6ddc8a admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.742031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e12110-8694-4eee-92bc-207fba6ddc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.742346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e12110-8694-4eee-92bc-207fba6ddc8a admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.743189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e12110-8694-4eee-92bc-207fba6ddc8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:24.745240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e12110-8694-4eee-92bc-207fba6ddc8a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:24.777539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587488f-fc88-4726-8412-71be366a2e4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:24.779334 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587488f-fc88-4726-8412-71be366a2e4f service swift] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:24.789515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1135/2270] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:49:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 06:49:24.791881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495462bb-c405-4e7e-805c-c55de7d43b77 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.797593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495462bb-c405-4e7e-805c-c55de7d43b77 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.797593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495462bb-c405-4e7e-805c-c55de7d43b77 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.797593 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1136/2271] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:49:24.800879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364869b8-4c42-4d9b-b4bb-98307c75091e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.801250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364869b8-4c42-4d9b-b4bb-98307c75091e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.801571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364869b8-4c42-4d9b-b4bb-98307c75091e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.848853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-364869b8-4c42-4d9b-b4bb-98307c75091e None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:24.850183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-364869b8-4c42-4d9b-b4bb-98307c75091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:24.853736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1136/2272] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:49:24 2022] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:49:24.857668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e12110-8694-4eee-92bc-207fba6ddc8a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:24.868321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e12110-8694-4eee-92bc-207fba6ddc8a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:24.882545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dde44-7f95-45e1-8145-d42a4b9aa9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:24.882545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dde44-7f95-45e1-8145-d42a4b9aa9ac admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.882545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dde44-7f95-45e1-8145-d42a4b9aa9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.882545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dde44-7f95-45e1-8145-d42a4b9aa9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.882955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dde44-7f95-45e1-8145-d42a4b9aa9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:24.882955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dde44-7f95-45e1-8145-d42a4b9aa9ac admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:24.891256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1137/2273] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:49:24.896577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dde44-7f95-45e1-8145-d42a4b9aa9ac admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:24.907456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dde44-7f95-45e1-8145-d42a4b9aa9ac admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:24.912034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445bea-43e9-4014-8a72-ae127773d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:24.912691 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445bea-43e9-4014-8a72-ae127773d937 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.912972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445bea-43e9-4014-8a72-ae127773d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.913245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445bea-43e9-4014-8a72-ae127773d937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.914711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445bea-43e9-4014-8a72-ae127773d937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:24.916293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445bea-43e9-4014-8a72-ae127773d937 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:24.919316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:24.933420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1138/2274] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:49:24.936302 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1137/2275] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:49:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:49:24.939456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445bea-43e9-4014-8a72-ae127773d937 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:24.951348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445bea-43e9-4014-8a72-ae127773d937 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:24.955236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adc1f4-c1a8-421b-8218-68e8f65a75a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:24.956119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc1f4-c1a8-421b-8218-68e8f65a75a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:24.956407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc1f4-c1a8-421b-8218-68e8f65a75a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:24.956688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc1f4-c1a8-421b-8218-68e8f65a75a4 admin admin] PATH_INFO: `/v3/projects/8ec3068b348e4118b2331d4731e9d69a/users/3574d4eb86234460889a586a4a6acbd0/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:24.970912 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:24.973646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adc1f4-c1a8-421b-8218-68e8f65a75a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec3068b348e4118b2331d4731e9d69a, user_id=3574d4eb86234460889a586a4a6acbd0, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:24.977338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adc1f4-c1a8-421b-8218-68e8f65a75a4 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:25.064642 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1139/2276] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:49:24 2022] PUT /identity/v3/projects/8ec3068b348e4118b2331d4731e9d69a/users/3574d4eb86234460889a586a4a6acbd0/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:25.069112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ae1ed-50c3-4d94-a524-b8e4fbefb85d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:25.069405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ae1ed-50c3-4d94-a524-b8e4fbefb85d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:25.069724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ae1ed-50c3-4d94-a524-b8e4fbefb85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:25.087843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c82ae1ed-50c3-4d94-a524-b8e4fbefb85d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:25.089401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c82ae1ed-50c3-4d94-a524-b8e4fbefb85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:25.150290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1138/2277] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:49:25.160397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adc1f4-c1a8-421b-8218-68e8f65a75a4 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:25.162121 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f0adc1f4-c1a8-421b-8218-68e8f65a75a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:25.222918 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adc1f4-c1a8-421b-8218-68e8f65a75a4 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:25.227202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ba216-a45a-4b4b-a067-9417df260aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:25.227843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ba216-a45a-4b4b-a067-9417df260aca service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:25.228122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ba216-a45a-4b4b-a067-9417df260aca service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:25.228396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ba216-a45a-4b4b-a067-9417df260aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:25.237303 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ba216-a45a-4b4b-a067-9417df260aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:25.238771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ba216-a45a-4b4b-a067-9417df260aca service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:25.248091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1140/2278] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:49:25.913788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ae1ed-50c3-4d94-a524-b8e4fbefb85d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:25.915307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c82ae1ed-50c3-4d94-a524-b8e4fbefb85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:26.012222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ae1ed-50c3-4d94-a524-b8e4fbefb85d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:26.016032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55bfd0-f2ec-4ac4-8fda-e49a336cf32a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5498a6912a08408d9ea30920faceee7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:26.016562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55bfd0-f2ec-4ac4-8fda-e49a336cf32a service glance] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:26.016847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55bfd0-f2ec-4ac4-8fda-e49a336cf32a service glance] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:26.017125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55bfd0-f2ec-4ac4-8fda-e49a336cf32a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:26.115157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55bfd0-f2ec-4ac4-8fda-e49a336cf32a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:26.119562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55bfd0-f2ec-4ac4-8fda-e49a336cf32a service glance] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:26.140979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1139/2279] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:49:26.416265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf543ff-caeb-4662-9bf5-ba5c71cb7029 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:26.416812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf543ff-caeb-4662-9bf5-ba5c71cb7029 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:26.416812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf543ff-caeb-4662-9bf5-ba5c71cb7029 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:26.418125 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1141/2280] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:49:26.423048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041745a3-c4a1-460b-96eb-66bdfac06332 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:26.423355 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041745a3-c4a1-460b-96eb-66bdfac06332 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:26.423621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041745a3-c4a1-460b-96eb-66bdfac06332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:26.441590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-041745a3-c4a1-460b-96eb-66bdfac06332 None None] MFA Rules not processed for user `11838a2908884cc79df912b3b2199564`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:26.442829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-041745a3-c4a1-460b-96eb-66bdfac06332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:26.449628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1140/2281] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:49:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:26.461726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf543ff-caeb-4662-9bf5-ba5c71cb7029 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:26.472560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf543ff-caeb-4662-9bf5-ba5c71cb7029 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:26.476661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1834da-4e4e-413a-ac9a-c148da7ccf3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:26.477283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1834da-4e4e-413a-ac9a-c148da7ccf3e service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:26.477561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1834da-4e4e-413a-ac9a-c148da7ccf3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:26.477833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1834da-4e4e-413a-ac9a-c148da7ccf3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:26.484927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1834da-4e4e-413a-ac9a-c148da7ccf3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:26.486356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1834da-4e4e-413a-ac9a-c148da7ccf3e service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:26.494811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1142/2282] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:49:26.589573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428beab9-9c22-471c-98de-587e5744aeb9 None None] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:26.589864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428beab9-9c22-471c-98de-587e5744aeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:26.590326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428beab9-9c22-471c-98de-587e5744aeb9 None None] PATH_INFO: `/` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:26.591897 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1141/2283] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:49:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:49:26.598822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15f4f-fba4-4499-9b56-9e5102082354 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:26.599316 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15f4f-fba4-4499-9b56-9e5102082354 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:26.599698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15f4f-fba4-4499-9b56-9e5102082354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:26.627090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-dbe15f4f-fba4-4499-9b56-9e5102082354 None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:26.628415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-dbe15f4f-fba4-4499-9b56-9e5102082354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:26.638366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1143/2284] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:49:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:26.648952 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428beab9-9c22-471c-98de-587e5744aeb9 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:26.660010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428beab9-9c22-471c-98de-587e5744aeb9 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:26.664285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4551c2-0a40-4427-8b42-7ed2bc73f5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:26.664911 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4551c2-0a40-4427-8b42-7ed2bc73f5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:26.668153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4551c2-0a40-4427-8b42-7ed2bc73f5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:26.668153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4551c2-0a40-4427-8b42-7ed2bc73f5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:26.676191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4551c2-0a40-4427-8b42-7ed2bc73f5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:26.677681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4551c2-0a40-4427-8b42-7ed2bc73f5c0 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:26.683281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:26.689676 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1142/2285] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:49:28.401783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe15f4f-fba4-4499-9b56-9e5102082354 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:28.403418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-dbe15f4f-fba4-4499-9b56-9e5102082354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:28.434305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe15f4f-fba4-4499-9b56-9e5102082354 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:28.446102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4533eb-3838-4061-978c-7fef737c71f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:28.450703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4533eb-3838-4061-978c-7fef737c71f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:28.450703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4533eb-3838-4061-978c-7fef737c71f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:28.450703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4533eb-3838-4061-978c-7fef737c71f1 admin admin] PATH_INFO: `/v3/users/f19592c32cea4fabaa7301b099bac14b` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:28.455797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4533eb-3838-4061-978c-7fef737c71f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19592c32cea4fabaa7301b099bac14b)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:28.461713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4533eb-3838-4061-978c-7fef737c71f1 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:28.672219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ee4533eb-3838-4061-978c-7fef737c71f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19592c32cea4fabaa7301b099bac14b'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:28.673447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ee4533eb-3838-4061-978c-7fef737c71f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19592c32cea4fabaa7301b099bac14b'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:28.742093 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ee4533eb-3838-4061-978c-7fef737c71f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19592c32cea4fabaa7301b099bac14b'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:28.769095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ee4533eb-3838-4061-978c-7fef737c71f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19592c32cea4fabaa7301b099bac14b'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:28.778660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ee4533eb-3838-4061-978c-7fef737c71f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19592c32cea4fabaa7301b099bac14b'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:28.792082 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1144/2286] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:49:28 2022] DELETE /identity/v3/users/f19592c32cea4fabaa7301b099bac14b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:29.343200 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4551c2-0a40-4427-8b42-7ed2bc73f5c0 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:29.367426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4551c2-0a40-4427-8b42-7ed2bc73f5c0 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:29.464186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:29.465071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:29.465570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:29.465982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] PATH_INFO: `/v3/projects/608554a1f9d04b55888eb9168dab3b32` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:29.467259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608554a1f9d04b55888eb9168dab3b32)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:29.469205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:29.582779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608554a1f9d04b55888eb9168dab3b32', 'request_id': 'req-185c84ff-3458-4bab-8cab-4303870f9c19'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:29.667523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608554a1f9d04b55888eb9168dab3b32', 'request_id': 'req-185c84ff-3458-4bab-8cab-4303870f9c19'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:29.684232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608554a1f9d04b55888eb9168dab3b32', 'request_id': 'req-185c84ff-3458-4bab-8cab-4303870f9c19'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:29.699843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] The token cache is being invalidate because project 608554a1f9d04b55888eb9168dab3b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:49:29.700424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:29.701080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-185c84ff-3458-4bab-8cab-4303870f9c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:29.702986 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1143/2287] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:49:29 2022] DELETE /identity/v3/projects/608554a1f9d04b55888eb9168dab3b32 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:29.708730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed7636-f943-4dde-a7d9-0cb0f15e231c None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:29.709298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed7636-f943-4dde-a7d9-0cb0f15e231c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:29.709404 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed7636-f943-4dde-a7d9-0cb0f15e231c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:29.736898 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-86ed7636-f943-4dde-a7d9-0cb0f15e231c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:29.738381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-86ed7636-f943-4dde-a7d9-0cb0f15e231c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:29.787750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:29.807807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1145/2288] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:29.816527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37c654-cfb7-4cfd-9ce4-5b22c1ec6106 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:29.817105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37c654-cfb7-4cfd-9ce4-5b22c1ec6106 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:29.817624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37c654-cfb7-4cfd-9ce4-5b22c1ec6106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:29.839208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-cb37c654-cfb7-4cfd-9ce4-5b22c1ec6106 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:29.840866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-cb37c654-cfb7-4cfd-9ce4-5b22c1ec6106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:29.853121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1144/2289] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:29.857254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed7636-f943-4dde-a7d9-0cb0f15e231c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:29.867336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed7636-f943-4dde-a7d9-0cb0f15e231c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:29.876545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cebe0-d71f-4ef0-8200-6540e310267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:29.876545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cebe0-d71f-4ef0-8200-6540e310267c admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:29.876545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cebe0-d71f-4ef0-8200-6540e310267c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:29.876545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cebe0-d71f-4ef0-8200-6540e310267c admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:29.876991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cebe0-d71f-4ef0-8200-6540e310267c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:49:29.877330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cebe0-d71f-4ef0-8200-6540e310267c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:29.878993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cebe0-d71f-4ef0-8200-6540e310267c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:29.895495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1146/2290] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:49:29.895733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37c654-cfb7-4cfd-9ce4-5b22c1ec6106 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:29.905912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37c654-cfb7-4cfd-9ce4-5b22c1ec6106 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:29.911607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f45727-7d67-46f7-8f66-7c0def03cbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:29.912286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f45727-7d67-46f7-8f66-7c0def03cbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:29.912684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f45727-7d67-46f7-8f66-7c0def03cbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:29.912981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f45727-7d67-46f7-8f66-7c0def03cbf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:29.914379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f45727-7d67-46f7-8f66-7c0def03cbf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:29.916324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f45727-7d67-46f7-8f66-7c0def03cbf9 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:30.032763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1145/2291] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:49:29 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:49:30.037356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cebe0-d71f-4ef0-8200-6540e310267c admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:30.056023 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cebe0-d71f-4ef0-8200-6540e310267c admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:30.199831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5168a9-d83c-474d-8486-e5746a5a79a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:30.201208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5168a9-d83c-474d-8486-e5746a5a79a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:30.201574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5168a9-d83c-474d-8486-e5746a5a79a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:30.202020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5168a9-d83c-474d-8486-e5746a5a79a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:30.202824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5168a9-d83c-474d-8486-e5746a5a79a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:30.205309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5168a9-d83c-474d-8486-e5746a5a79a1 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:30.338450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1147/2292] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:49:30 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:49:30.342547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f45727-7d67-46f7-8f66-7c0def03cbf9 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:30.356750 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f45727-7d67-46f7-8f66-7c0def03cbf9 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:30.368989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dfdc9-8daa-444d-b0de-53cc9d3a0f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:30.369698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dfdc9-8daa-444d-b0de-53cc9d3a0f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:30.370315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dfdc9-8daa-444d-b0de-53cc9d3a0f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:30.370445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dfdc9-8daa-444d-b0de-53cc9d3a0f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:30.371485 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dfdc9-8daa-444d-b0de-53cc9d3a0f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:30.373337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dfdc9-8daa-444d-b0de-53cc9d3a0f30 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:30.393282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5168a9-d83c-474d-8486-e5746a5a79a1 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:30.401529 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1146/2293] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:49:30.406210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5168a9-d83c-474d-8486-e5746a5a79a1 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:30.412519 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfd03a-2b52-477f-944a-a44e5ebd484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:30.413625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd03a-2b52-477f-944a-a44e5ebd484a admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:30.413625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd03a-2b52-477f-944a-a44e5ebd484a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:30.413872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd03a-2b52-477f-944a-a44e5ebd484a admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:30.414625 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfd03a-2b52-477f-944a-a44e5ebd484a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:30.416354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfd03a-2b52-477f-944a-a44e5ebd484a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:30.433333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1148/2294] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:49:30.440283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dfdc9-8daa-444d-b0de-53cc9d3a0f30 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:30.452777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dfdc9-8daa-444d-b0de-53cc9d3a0f30 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:30.458142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b41fa6-9dfd-4166-a2d1-5da41b94721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:30.459114 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b41fa6-9dfd-4166-a2d1-5da41b94721a admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:30.459396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b41fa6-9dfd-4166-a2d1-5da41b94721a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:30.459679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b41fa6-9dfd-4166-a2d1-5da41b94721a admin admin] PATH_INFO: `/v3/projects/1a519abcec1d43548e2e7998fa33ba3b/users/d5b3e22adee542e9821a2d8f42e01bff/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:30.476468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b41fa6-9dfd-4166-a2d1-5da41b94721a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a519abcec1d43548e2e7998fa33ba3b, user_id=d5b3e22adee542e9821a2d8f42e01bff, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:30.479200 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b41fa6-9dfd-4166-a2d1-5da41b94721a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:30.586989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1147/2295] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:49:30 2022] PUT /identity/v3/projects/1a519abcec1d43548e2e7998fa33ba3b/users/d5b3e22adee542e9821a2d8f42e01bff/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:30.589288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e0827-ccd1-4f93-810a-ce270cfe15af None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:30.589585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e0827-ccd1-4f93-810a-ce270cfe15af None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:30.589876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e0827-ccd1-4f93-810a-ce270cfe15af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:30.633337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-353e0827-ccd1-4f93-810a-ce270cfe15af None None] MFA Rules not processed for user `d5b3e22adee542e9821a2d8f42e01bff`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:30.641949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-353e0827-ccd1-4f93-810a-ce270cfe15af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:30.732599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1149/2296] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:30.740170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b41fa6-9dfd-4166-a2d1-5da41b94721a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:30.742819 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-88b41fa6-9dfd-4166-a2d1-5da41b94721a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:30.788672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:30.868304 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b41fa6-9dfd-4166-a2d1-5da41b94721a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:30.872432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dfc04-607b-47e4-aa82-96464c5b6cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:30.873029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dfc04-607b-47e4-aa82-96464c5b6cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:30.873309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dfc04-607b-47e4-aa82-96464c5b6cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:30.873581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dfc04-607b-47e4-aa82-96464c5b6cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:30.884707 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dfc04-607b-47e4-aa82-96464c5b6cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:30.885665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dfc04-607b-47e4-aa82-96464c5b6cf2 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:30.895765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1148/2297] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:49:31.870984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790542-9f5e-41db-9aaf-c3db3272b972 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:31.873323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790542-9f5e-41db-9aaf-c3db3272b972 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:31.873323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790542-9f5e-41db-9aaf-c3db3272b972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:31.891998 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-12790542-9f5e-41db-9aaf-c3db3272b972 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:31.893209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-12790542-9f5e-41db-9aaf-c3db3272b972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:31.950929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:31.969679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1150/2298] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:49:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:31.984879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dfc04-607b-47e4-aa82-96464c5b6cf2 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:31.986404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-728dfc04-607b-47e4-aa82-96464c5b6cf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:32.068273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca748-e88e-4b53-b7b9-e09797020f4e None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:32.068570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca748-e88e-4b53-b7b9-e09797020f4e None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:32.068847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca748-e88e-4b53-b7b9-e09797020f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:32.070540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dfc04-607b-47e4-aa82-96464c5b6cf2 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:32.075974 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537af49-61e1-4999-9b71-2383116d4f21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:32.076629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537af49-61e1-4999-9b71-2383116d4f21 service swift] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:32.076912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537af49-61e1-4999-9b71-2383116d4f21 service swift] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:32.077183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537af49-61e1-4999-9b71-2383116d4f21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:32.086758 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537af49-61e1-4999-9b71-2383116d4f21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:32.088555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537af49-61e1-4999-9b71-2383116d4f21 service swift] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:32.096604 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-48fca748-e88e-4b53-b7b9-e09797020f4e None None] MFA Rules not processed for user `3574d4eb86234460889a586a4a6acbd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:32.097974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-48fca748-e88e-4b53-b7b9-e09797020f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:32.098655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1149/2299] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:49:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 06:49:32.178445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1151/2300] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:49:32.183020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537af49-61e1-4999-9b71-2383116d4f21 service swift] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:32.187123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7537af49-61e1-4999-9b71-2383116d4f21 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:32.330000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537af49-61e1-4999-9b71-2383116d4f21 service swift] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:32.347040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5754e-7bbf-43e6-93d7-afac4b2c9f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:32.347810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5754e-7bbf-43e6-93d7-afac4b2c9f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:32.348043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5754e-7bbf-43e6-93d7-afac4b2c9f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:32.348447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5754e-7bbf-43e6-93d7-afac4b2c9f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:32.349345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5754e-7bbf-43e6-93d7-afac4b2c9f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:32.354693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5754e-7bbf-43e6-93d7-afac4b2c9f8f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:32.507919 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1150/2301] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:49:32 2022] POST /identity/v3/projects => generated 379 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:49:32.512597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fca748-e88e-4b53-b7b9-e09797020f4e None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:32.528419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fca748-e88e-4b53-b7b9-e09797020f4e None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:32.696063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07097681-807c-4237-bd05-e02aa1284b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:32.696772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07097681-807c-4237-bd05-e02aa1284b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:32.696955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07097681-807c-4237-bd05-e02aa1284b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:32.697231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07097681-807c-4237-bd05-e02aa1284b0f admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:32.697936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07097681-807c-4237-bd05-e02aa1284b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:32.704079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07097681-807c-4237-bd05-e02aa1284b0f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:32.789507 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5754e-7bbf-43e6-93d7-afac4b2c9f8f admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:32.794366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1152/2302] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:49:32 2022] POST /identity/v3/users => generated 296 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:49:32.805032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5754e-7bbf-43e6-93d7-afac4b2c9f8f admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:32.826464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f500f-f253-4bc9-b395-c965f9fbb8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:32.827214 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f500f-f253-4bc9-b395-c965f9fbb8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:32.827509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f500f-f253-4bc9-b395-c965f9fbb8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:32.827791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f500f-f253-4bc9-b395-c965f9fbb8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:32.838435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f500f-f253-4bc9-b395-c965f9fbb8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:32.840252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f500f-f253-4bc9-b395-c965f9fbb8e4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:32.856972 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1151/2303] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:49:32.860535 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07097681-807c-4237-bd05-e02aa1284b0f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:32.915135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07097681-807c-4237-bd05-e02aa1284b0f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:32.922554 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a1f89-ed07-478d-8a15-75daa5e15c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:32.924228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a1f89-ed07-478d-8a15-75daa5e15c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:32.924344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a1f89-ed07-478d-8a15-75daa5e15c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:32.924641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a1f89-ed07-478d-8a15-75daa5e15c4f admin admin] PATH_INFO: `/v3/projects/830ee72c5d1f4259b01fbcab29555100/users/c211e9f5498949ae93c328d478530101/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:32.977019 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a1f89-ed07-478d-8a15-75daa5e15c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=830ee72c5d1f4259b01fbcab29555100, user_id=c211e9f5498949ae93c328d478530101, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:32.980312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a1f89-ed07-478d-8a15-75daa5e15c4f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:33.104268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1153/2304] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:49:32 2022] PUT /identity/v3/projects/830ee72c5d1f4259b01fbcab29555100/users/c211e9f5498949ae93c328d478530101/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:33.105273 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f500f-f253-4bc9-b395-c965f9fbb8e4 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:33.118621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f500f-f253-4bc9-b395-c965f9fbb8e4 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:33.142647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:33.218511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7156b2b-12b1-4fdc-bf2a-dcbb060327ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:33.219380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7156b2b-12b1-4fdc-bf2a-dcbb060327ff admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:33.219714 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7156b2b-12b1-4fdc-bf2a-dcbb060327ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:33.220092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7156b2b-12b1-4fdc-bf2a-dcbb060327ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:33.221036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7156b2b-12b1-4fdc-bf2a-dcbb060327ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:33.222775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7156b2b-12b1-4fdc-bf2a-dcbb060327ff admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:33.234731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1152/2305] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:49:33.238553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a1f89-ed07-478d-8a15-75daa5e15c4f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:33.251203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a1f89-ed07-478d-8a15-75daa5e15c4f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:33.258270 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb0b08-b6ec-4938-b9af-d0c898ab34fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:33.259201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb0b08-b6ec-4938-b9af-d0c898ab34fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:33.259481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb0b08-b6ec-4938-b9af-d0c898ab34fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:33.259759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb0b08-b6ec-4938-b9af-d0c898ab34fc admin admin] PATH_INFO: `/v3/projects/830ee72c5d1f4259b01fbcab29555100/users/c211e9f5498949ae93c328d478530101/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:33.261994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb0b08-b6ec-4938-b9af-d0c898ab34fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=830ee72c5d1f4259b01fbcab29555100, user_id=c211e9f5498949ae93c328d478530101, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:33.265219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb0b08-b6ec-4938-b9af-d0c898ab34fc admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:33.308057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1154/2306] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:49:33 2022] PUT /identity/v3/projects/830ee72c5d1f4259b01fbcab29555100/users/c211e9f5498949ae93c328d478530101/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:35.507934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7156b2b-12b1-4fdc-bf2a-dcbb060327ff admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:35.525226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7156b2b-12b1-4fdc-bf2a-dcbb060327ff admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:35.651132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:35.652131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:35.652795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:35.653133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] PATH_INFO: `/v3/users/d5b3e22adee542e9821a2d8f42e01bff` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:35.656031 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b3e22adee542e9821a2d8f42e01bff)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:35.659199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:35.917976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b3e22adee542e9821a2d8f42e01bff'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:35.919882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b3e22adee542e9821a2d8f42e01bff'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:35.954323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b3e22adee542e9821a2d8f42e01bff'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:36.060345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b3e22adee542e9821a2d8f42e01bff'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:36.082271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b3e22adee542e9821a2d8f42e01bff'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:36.089721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1153/2307] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:49:35 2022] DELETE /identity/v3/users/d5b3e22adee542e9821a2d8f42e01bff => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:36.096381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b5b7-ddb9-45d5-9b7f-1957d11e81a7 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:36.097080 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b5b7-ddb9-45d5-9b7f-1957d11e81a7 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:36.097080 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b5b7-ddb9-45d5-9b7f-1957d11e81a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:36.148959 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-10d5b5b7-ddb9-45d5-9b7f-1957d11e81a7 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:36.150198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-10d5b5b7-ddb9-45d5-9b7f-1957d11e81a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:36.223101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:36.327188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1155/2308] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:36.338693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:36.340133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:36.416020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:36.464490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec4130-3c7b-4865-97ce-23001520f72c admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:36.469449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f37846-d29e-4e14-8d8a-b1f0a6e009f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:36.470108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f37846-d29e-4e14-8d8a-b1f0a6e009f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:36.470490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f37846-d29e-4e14-8d8a-b1f0a6e009f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:36.470838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f37846-d29e-4e14-8d8a-b1f0a6e009f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:36.508977 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f37846-d29e-4e14-8d8a-b1f0a6e009f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:36.511697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f37846-d29e-4e14-8d8a-b1f0a6e009f5 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:36.525769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1154/2309] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:49:37.220835 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5b5b7-ddb9-45d5-9b7f-1957d11e81a7 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:37.222350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-10d5b5b7-ddb9-45d5-9b7f-1957d11e81a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:37.252127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5b5b7-ddb9-45d5-9b7f-1957d11e81a7 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:37.266451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:37.270425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:37.270425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:37.270425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] PATH_INFO: `/v3/projects/1a519abcec1d43548e2e7998fa33ba3b` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:37.270425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a519abcec1d43548e2e7998fa33ba3b)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:37.274970 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:37.444319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a519abcec1d43548e2e7998fa33ba3b', 'request_id': 'req-e922f3c5-14d9-4a6f-9170-ad92a1b12813'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:37.503579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a519abcec1d43548e2e7998fa33ba3b', 'request_id': 'req-e922f3c5-14d9-4a6f-9170-ad92a1b12813'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:37.533783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a519abcec1d43548e2e7998fa33ba3b', 'request_id': 'req-e922f3c5-14d9-4a6f-9170-ad92a1b12813'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:37.573612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] The token cache is being invalidate because project 1a519abcec1d43548e2e7998fa33ba3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:49:37.573910 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:37.578523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e922f3c5-14d9-4a6f-9170-ad92a1b12813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:37.584714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1156/2310] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:49:37 2022] DELETE /identity/v3/projects/1a519abcec1d43548e2e7998fa33ba3b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:37.592790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341d8f-556b-45f8-8dcb-89a7eeeebc8d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:37.593398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341d8f-556b-45f8-8dcb-89a7eeeebc8d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:37.593817 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341d8f-556b-45f8-8dcb-89a7eeeebc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:37.622204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b1341d8f-556b-45f8-8dcb-89a7eeeebc8d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:37.623492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b1341d8f-556b-45f8-8dcb-89a7eeeebc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:37.711624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6b49-88cb-4e1e-9016-4ba58e74078f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:37.714525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6b49-88cb-4e1e-9016-4ba58e74078f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:37.714525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6b49-88cb-4e1e-9016-4ba58e74078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:37.714726 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1155/2311] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:37.734544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-aa0c6b49-88cb-4e1e-9016-4ba58e74078f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:37.735913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-aa0c6b49-88cb-4e1e-9016-4ba58e74078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:37.762475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1157/2312] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:49:37.766304 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1341d8f-556b-45f8-8dcb-89a7eeeebc8d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:37.787365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1341d8f-556b-45f8-8dcb-89a7eeeebc8d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:37.791934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e749280-7f4b-4cc1-9ee2-0389bdd73c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:37.792920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e749280-7f4b-4cc1-9ee2-0389bdd73c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:37.796637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e749280-7f4b-4cc1-9ee2-0389bdd73c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:37.797036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e749280-7f4b-4cc1-9ee2-0389bdd73c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:37.797979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e749280-7f4b-4cc1-9ee2-0389bdd73c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:49:37.798545 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e749280-7f4b-4cc1-9ee2-0389bdd73c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:37.811459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e749280-7f4b-4cc1-9ee2-0389bdd73c8e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:37.834673 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1156/2313] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:49:37.841851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c6b49-88cb-4e1e-9016-4ba58e74078f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:37.862944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c6b49-88cb-4e1e-9016-4ba58e74078f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:37.876832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c404-401b-4f54-9190-25e4aca3ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:37.876832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c404-401b-4f54-9190-25e4aca3ba27 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:37.876832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c404-401b-4f54-9190-25e4aca3ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:37.876832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c404-401b-4f54-9190-25e4aca3ba27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:37.877220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065c404-401b-4f54-9190-25e4aca3ba27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:37.879830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065c404-401b-4f54-9190-25e4aca3ba27 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:37.990972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1158/2314] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:49:37 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:49:37.995169 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e749280-7f4b-4cc1-9ee2-0389bdd73c8e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:38.023265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e749280-7f4b-4cc1-9ee2-0389bdd73c8e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:38.119461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ee9e1-5845-4abb-ab2b-a5e74e51fba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:38.120135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ee9e1-5845-4abb-ab2b-a5e74e51fba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:38.120413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ee9e1-5845-4abb-ab2b-a5e74e51fba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:38.126438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ee9e1-5845-4abb-ab2b-a5e74e51fba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:38.127222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ee9e1-5845-4abb-ab2b-a5e74e51fba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:38.129429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ee9e1-5845-4abb-ab2b-a5e74e51fba6 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:38.229675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1157/2315] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:49:37 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:49:38.236676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c404-401b-4f54-9190-25e4aca3ba27 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:38.249323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c404-401b-4f54-9190-25e4aca3ba27 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:38.254476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5025980-e0b8-4224-a577-ba5aa6b980f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:38.257735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5025980-e0b8-4224-a577-ba5aa6b980f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:38.257735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5025980-e0b8-4224-a577-ba5aa6b980f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:38.258018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5025980-e0b8-4224-a577-ba5aa6b980f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:38.260195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5025980-e0b8-4224-a577-ba5aa6b980f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:38.262065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5025980-e0b8-4224-a577-ba5aa6b980f6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:38.297033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1159/2316] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:49:38.301440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ee9e1-5845-4abb-ab2b-a5e74e51fba6 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:38.319297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ee9e1-5845-4abb-ab2b-a5e74e51fba6 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:38.328572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c585dd3-662e-448e-ad10-6cb8f3888644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:38.329268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c585dd3-662e-448e-ad10-6cb8f3888644 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:38.329556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c585dd3-662e-448e-ad10-6cb8f3888644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:38.329838 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c585dd3-662e-448e-ad10-6cb8f3888644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:38.330943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c585dd3-662e-448e-ad10-6cb8f3888644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:38.338816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c585dd3-662e-448e-ad10-6cb8f3888644 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:38.364938 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5025980-e0b8-4224-a577-ba5aa6b980f6 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:38.367405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1158/2317] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:49:38.387591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5025980-e0b8-4224-a577-ba5aa6b980f6 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:38.409874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f597712-4410-4985-b9c2-ecec734897c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:38.411121 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f597712-4410-4985-b9c2-ecec734897c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:38.411121 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f597712-4410-4985-b9c2-ecec734897c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:38.411356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f597712-4410-4985-b9c2-ecec734897c6 admin admin] PATH_INFO: `/v3/projects/9b23213249b74da194883e831c21f684/users/35f359b774c044be93ad2d3c592a845b/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:38.451121 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f597712-4410-4985-b9c2-ecec734897c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b23213249b74da194883e831c21f684, user_id=35f359b774c044be93ad2d3c592a845b, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:38.453971 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f597712-4410-4985-b9c2-ecec734897c6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:38.559060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1160/2318] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:49:38 2022] PUT /identity/v3/projects/9b23213249b74da194883e831c21f684/users/35f359b774c044be93ad2d3c592a845b/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:49:38.570286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e38d3f-0ebb-432d-976f-6548d4b6d9c1 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:38.570939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e38d3f-0ebb-432d-976f-6548d4b6d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:38.571426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e38d3f-0ebb-432d-976f-6548d4b6d9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:38.646835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-71e38d3f-0ebb-432d-976f-6548d4b6d9c1 None None] MFA Rules not processed for user `35f359b774c044be93ad2d3c592a845b`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:38.664600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-71e38d3f-0ebb-432d-976f-6548d4b6d9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:38.719406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:38.804173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1159/2319] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:38.821805 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f597712-4410-4985-b9c2-ecec734897c6 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:38.824075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0f597712-4410-4985-b9c2-ecec734897c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:38.936578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:38.953586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f597712-4410-4985-b9c2-ecec734897c6 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:38.957480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3631f5f-f6b9-4b08-881a-e1340b907dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:38.958096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3631f5f-f6b9-4b08-881a-e1340b907dca service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:38.958627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3631f5f-f6b9-4b08-881a-e1340b907dca service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:38.958908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3631f5f-f6b9-4b08-881a-e1340b907dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:38.969177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3631f5f-f6b9-4b08-881a-e1340b907dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:38.970597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3631f5f-f6b9-4b08-881a-e1340b907dca service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:38.990331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1161/2320] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:49:39.029355 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e38d3f-0ebb-432d-976f-6548d4b6d9c1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:39.156274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e38d3f-0ebb-432d-976f-6548d4b6d9c1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:39.162555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:39.163135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:39.163418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:39.163694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] PATH_INFO: `/v3/users/35f359b774c044be93ad2d3c592a845b` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:39.164916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f359b774c044be93ad2d3c592a845b)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:39.187677 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:39.446606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f359b774c044be93ad2d3c592a845b'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:39.447273 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f359b774c044be93ad2d3c592a845b'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:39.469081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f359b774c044be93ad2d3c592a845b'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:39.519621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f359b774c044be93ad2d3c592a845b'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:39.529218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f359b774c044be93ad2d3c592a845b'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:39.541479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1160/2321] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:49:39 2022] DELETE /identity/v3/users/35f359b774c044be93ad2d3c592a845b => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:39.545799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d2c0-f585-45d6-81ff-be4c9311433c None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:39.546690 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d2c0-f585-45d6-81ff-be4c9311433c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:39.546975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d2c0-f585-45d6-81ff-be4c9311433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:39.565988 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-b460d2c0-f585-45d6-81ff-be4c9311433c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:39.568061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b460d2c0-f585-45d6-81ff-be4c9311433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:39.682188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1162/2322] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:39.693128 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:39.696367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:39.770253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:39.784601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7547a5-8450-4264-b3fc-bd4e26aba4ae admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:39.790572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf50f91-1b20-42cb-8137-71164d7528df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:39.791242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf50f91-1b20-42cb-8137-71164d7528df service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:39.791527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf50f91-1b20-42cb-8137-71164d7528df service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:39.791886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf50f91-1b20-42cb-8137-71164d7528df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:39.811569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf50f91-1b20-42cb-8137-71164d7528df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:39.813285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf50f91-1b20-42cb-8137-71164d7528df service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:39.840706 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1161/2323] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:49:40.671630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d2c0-f585-45d6-81ff-be4c9311433c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:40.707734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b460d2c0-f585-45d6-81ff-be4c9311433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:40.707734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d2c0-f585-45d6-81ff-be4c9311433c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:40.707734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:40.708985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:40.708985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:40.708985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] PATH_INFO: `/v3/projects/9b23213249b74da194883e831c21f684` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:40.708985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b23213249b74da194883e831c21f684)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:40.708985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:41.274815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b23213249b74da194883e831c21f684', 'request_id': 'req-5cc0bf7f-53e9-4c90-9cf5-104898436172'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:41.382357 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b23213249b74da194883e831c21f684', 'request_id': 'req-5cc0bf7f-53e9-4c90-9cf5-104898436172'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:41.391713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b23213249b74da194883e831c21f684', 'request_id': 'req-5cc0bf7f-53e9-4c90-9cf5-104898436172'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:41.431753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] The token cache is being invalidate because project 9b23213249b74da194883e831c21f684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:49:41.431753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:41.431753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:49:41.433310 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1163/2324] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:49:40 2022] DELETE /identity/v3/projects/9b23213249b74da194883e831c21f684 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:49:43.353935 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eaca9-71f9-4e6e-8230-f6d102e35089 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:43.355097 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eaca9-71f9-4e6e-8230-f6d102e35089 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:43.355382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eaca9-71f9-4e6e-8230-f6d102e35089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:43.390591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-332eaca9-71f9-4e6e-8230-f6d102e35089 None None] MFA Rules not processed for user `c211e9f5498949ae93c328d478530101`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:43.391847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-332eaca9-71f9-4e6e-8230-f6d102e35089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:43.470522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1162/2325] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:49:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:43.483119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:43.484552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:43.556709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0bf7f-53e9-4c90-9cf5-104898436172 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:43.562263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d209a9-4c74-4e41-8f58-bcd779faf950 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:43.562927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d209a9-4c74-4e41-8f58-bcd779faf950 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:43.563212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d209a9-4c74-4e41-8f58-bcd779faf950 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:43.563492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d209a9-4c74-4e41-8f58-bcd779faf950 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:43.565246 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-09d209a9-4c74-4e41-8f58-bcd779faf950 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:43.576915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:43.625063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d209a9-4c74-4e41-8f58-bcd779faf950 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:43.631485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d209a9-4c74-4e41-8f58-bcd779faf950 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:43.644552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1164/2326] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:49:53.465347 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=40 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:53.774663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=22 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:49:53.842523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332eaca9-71f9-4e6e-8230-f6d102e35089 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:53.848504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-332eaca9-71f9-4e6e-8230-f6d102e35089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:54.016682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332eaca9-71f9-4e6e-8230-f6d102e35089 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:54.024211 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383598b5-4be9-4412-ac68-e2bb77fa8f3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:54.024884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383598b5-4be9-4412-ac68-e2bb77fa8f3a service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:54.025171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383598b5-4be9-4412-ac68-e2bb77fa8f3a service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:54.025498 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383598b5-4be9-4412-ac68-e2bb77fa8f3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:54.027552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-383598b5-4be9-4412-ac68-e2bb77fa8f3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:54.058570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383598b5-4be9-4412-ac68-e2bb77fa8f3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:54.060360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383598b5-4be9-4412-ac68-e2bb77fa8f3a service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:54.075152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1163/2327] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:49:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:49:58.193450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a7111-338b-47e5-a71f-5d2ab8c7b290 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:58.193964 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a7111-338b-47e5-a71f-5d2ab8c7b290 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:58.194071 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a7111-338b-47e5-a71f-5d2ab8c7b290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:58.214059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-336a7111-338b-47e5-a71f-5d2ab8c7b290 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:49:58.215513 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-336a7111-338b-47e5-a71f-5d2ab8c7b290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:58.299298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1165/2328] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jun 8 06:49:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:49:58.325062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383598b5-4be9-4412-ac68-e2bb77fa8f3a service placement] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:49:58.327756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-383598b5-4be9-4412-ac68-e2bb77fa8f3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:49:58.406380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383598b5-4be9-4412-ac68-e2bb77fa8f3a service placement] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:49:58.411433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b20a4-a879-42ed-85f7-093b850e802d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:49:58.412091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b20a4-a879-42ed-85f7-093b850e802d service swift] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:49:58.412378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b20a4-a879-42ed-85f7-093b850e802d service swift] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:49:58.412680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b20a4-a879-42ed-85f7-093b850e802d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:49:58.421428 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b20a4-a879-42ed-85f7-093b850e802d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:49:58.424753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b20a4-a879-42ed-85f7-093b850e802d service swift] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:49:58.433467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1164/2329] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:49:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:50:00.062816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbfc50-96eb-43a2-9638-7d1ff800ac57 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:50:00.063292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbfc50-96eb-43a2-9638-7d1ff800ac57 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:50:00.063493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbfc50-96eb-43a2-9638-7d1ff800ac57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:50:00.082621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-abbbfc50-96eb-43a2-9638-7d1ff800ac57 None None] MFA Rules not processed for user `d89fede014d94157aeaeebbbceac28a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:50:00.083876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-abbbfc50-96eb-43a2-9638-7d1ff800ac57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:50:00.152104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1166/2330] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:50:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:50:05.713220 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee619-e56e-429a-a43a-4374e3667b11 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:50:05.714742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee619-e56e-429a-a43a-4374e3667b11 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:50:05.715229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee619-e56e-429a-a43a-4374e3667b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:50:05.734459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-efbee619-e56e-429a-a43a-4374e3667b11 None None] MFA Rules not processed for user `3574d4eb86234460889a586a4a6acbd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:50:05.742075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-efbee619-e56e-429a-a43a-4374e3667b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:50:05.742746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1165/2331] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:50:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:50:10.141122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=50 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:50:13.046311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c50ce-37bb-4c3f-9b3d-e97ca7b8845b None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:50:13.046900 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c50ce-37bb-4c3f-9b3d-e97ca7b8845b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:50:13.047029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c50ce-37bb-4c3f-9b3d-e97ca7b8845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:50:13.067234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-9a5c50ce-37bb-4c3f-9b3d-e97ca7b8845b None None] MFA Rules not processed for user `cc861f1c354f45b09cb61fd86245a5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:50:13.068440 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9a5c50ce-37bb-4c3f-9b3d-e97ca7b8845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:50:13.141394 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1167/2332] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:50:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:50:14.466555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee619-e56e-429a-a43a-4374e3667b11 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:50:14.468139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-efbee619-e56e-429a-a43a-4374e3667b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:50:14.530495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee619-e56e-429a-a43a-4374e3667b11 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:50:14.534133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c2e96-e80f-42ab-a3a0-781181049ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:50:14.534823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c2e96-e80f-42ab-a3a0-781181049ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:50:14.535112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c2e96-e80f-42ab-a3a0-781181049ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:50:14.535387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c2e96-e80f-42ab-a3a0-781181049ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:50:14.537211 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b56c2e96-e80f-42ab-a3a0-781181049ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:50:14.543994 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:50:14.610739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c2e96-e80f-42ab-a3a0-781181049ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:50:14.612330 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c2e96-e80f-42ab-a3a0-781181049ca7 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:50:14.624277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1166/2333] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:50:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:50:23.134073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=25 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:50:24.940530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=26 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:50:30.820272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c50ce-37bb-4c3f-9b3d-e97ca7b8845b None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:50:30.821678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9a5c50ce-37bb-4c3f-9b3d-e97ca7b8845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:50:30.834681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c50ce-37bb-4c3f-9b3d-e97ca7b8845b None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:50:30.840250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139e98-c77c-40ef-b390-f1252844ae1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:50:30.840250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139e98-c77c-40ef-b390-f1252844ae1a service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:50:30.840250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139e98-c77c-40ef-b390-f1252844ae1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:50:30.840250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139e98-c77c-40ef-b390-f1252844ae1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:50:30.849286 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80139e98-c77c-40ef-b390-f1252844ae1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:50:30.850746 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80139e98-c77c-40ef-b390-f1252844ae1a service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:50:30.860222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1168/2334] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:50:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:50:40.855990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:51:00.054468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b43a47-aa3d-4cd3-81db-32f20e42e694 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:51:00.061715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b43a47-aa3d-4cd3-81db-32f20e42e694 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:51:00.061715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b43a47-aa3d-4cd3-81db-32f20e42e694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:51:00.071835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-01b43a47-aa3d-4cd3-81db-32f20e42e694 None None] MFA Rules not processed for user `7f7bf346718b4c61bab0fdc198af8818`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:51:00.073037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-01b43a47-aa3d-4cd3-81db-32f20e42e694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:51:00.129320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1167/2335] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:51:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:51:10.122425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=25 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:51:17.374908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9535-9243-4297-a778-fba5fcd74050 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:51:17.375417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9535-9243-4297-a778-fba5fcd74050 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:51:17.375514 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9535-9243-4297-a778-fba5fcd74050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:51:17.392972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-665c9535-9243-4297-a778-fba5fcd74050 None None] MFA Rules not processed for user `c6523f0f4dc249659c4e63fc5ee5e783`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:51:17.394081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-665c9535-9243-4297-a778-fba5fcd74050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:51:17.450974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1169/2336] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:51:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:51:27.443596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=25 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:51:33.727037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be43a17-b030-41bf-8821-708a22a21fdb None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:51:33.727560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be43a17-b030-41bf-8821-708a22a21fdb None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:51:33.727560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be43a17-b030-41bf-8821-708a22a21fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:51:33.772940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-4be43a17-b030-41bf-8821-708a22a21fdb None None] MFA Rules not processed for user `d89fede014d94157aeaeebbbceac28a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:51:33.774196 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4be43a17-b030-41bf-8821-708a22a21fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:51:33.782723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1168/2337] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:51:42.394305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c9535-9243-4297-a778-fba5fcd74050 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:51:42.404269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c9535-9243-4297-a778-fba5fcd74050 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:51:42.407791 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e18e0a-5d0d-46e8-98fa-e2e4f3c76744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:51:42.408549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e18e0a-5d0d-46e8-98fa-e2e4f3c76744 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:51:42.408837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e18e0a-5d0d-46e8-98fa-e2e4f3c76744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:51:42.409108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e18e0a-5d0d-46e8-98fa-e2e4f3c76744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:51:42.410882 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-22e18e0a-5d0d-46e8-98fa-e2e4f3c76744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:51:42.424637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e18e0a-5d0d-46e8-98fa-e2e4f3c76744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:51:42.426175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e18e0a-5d0d-46e8-98fa-e2e4f3c76744 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:51:42.438042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1170/2338] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:51:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:51:43.751320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:51:47.850456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49931900-1b11-4355-b9fb-28978a7e6075 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:51:47.855908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49931900-1b11-4355-b9fb-28978a7e6075 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:51:47.855908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49931900-1b11-4355-b9fb-28978a7e6075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:51:47.868693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-49931900-1b11-4355-b9fb-28978a7e6075 None None] MFA Rules not processed for user `cc861f1c354f45b09cb61fd86245a5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:51:47.869908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-49931900-1b11-4355-b9fb-28978a7e6075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:51:47.877002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1169/2339] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:51:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:51:47.888910 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e18e0a-5d0d-46e8-98fa-e2e4f3c76744 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:51:47.890371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-22e18e0a-5d0d-46e8-98fa-e2e4f3c76744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:51:47.903696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e18e0a-5d0d-46e8-98fa-e2e4f3c76744 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:51:47.909738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70893bae-b65a-4ec2-9009-3c8d65c1a8af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:51:47.910379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70893bae-b65a-4ec2-9009-3c8d65c1a8af service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:51:47.910660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70893bae-b65a-4ec2-9009-3c8d65c1a8af service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:51:47.910933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70893bae-b65a-4ec2-9009-3c8d65c1a8af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:51:47.912632 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-70893bae-b65a-4ec2-9009-3c8d65c1a8af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:51:47.922517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70893bae-b65a-4ec2-9009-3c8d65c1a8af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:51:47.924076 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70893bae-b65a-4ec2-9009-3c8d65c1a8af service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:51:47.932859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1171/2340] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:51:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:51:48.639830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49931900-1b11-4355-b9fb-28978a7e6075 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:51:48.641279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-49931900-1b11-4355-b9fb-28978a7e6075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:51:48.648859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70893bae-b65a-4ec2-9009-3c8d65c1a8af service nova] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:51:48.656704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49931900-1b11-4355-b9fb-28978a7e6075 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:51:48.657959 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70893bae-b65a-4ec2-9009-3c8d65c1a8af service nova] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:51:48.661571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca2be3-9000-41b5-8056-ab9c8f8c60f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:51:48.661962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f5445-c81a-4c7e-b4b4-3d23d5fa65b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:51:48.662207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2be3-9000-41b5-8056-ab9c8f8c60f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:51:48.662525 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2be3-9000-41b5-8056-ab9c8f8c60f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:51:48.662802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2be3-9000-41b5-8056-ab9c8f8c60f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:51:48.662952 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5445-c81a-4c7e-b4b4-3d23d5fa65b8 service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:51:48.663311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5445-c81a-4c7e-b4b4-3d23d5fa65b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:51:48.663650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5445-c81a-4c7e-b4b4-3d23d5fa65b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:51:48.664643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-60ca2be3-9000-41b5-8056-ab9c8f8c60f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:51:48.665548 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-cb2f5445-c81a-4c7e-b4b4-3d23d5fa65b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:51:48.677673 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f5445-c81a-4c7e-b4b4-3d23d5fa65b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:51:48.678950 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca2be3-9000-41b5-8056-ab9c8f8c60f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:51:48.679302 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f5445-c81a-4c7e-b4b4-3d23d5fa65b8 service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:51:48.680366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca2be3-9000-41b5-8056-ab9c8f8c60f9 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:51:48.690484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1170/2341] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:51:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:51:48.691830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1172/2342] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:51:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:51:57.083111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f5445-c81a-4c7e-b4b4-3d23d5fa65b8 service placement] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:51:57.092472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f5445-c81a-4c7e-b4b4-3d23d5fa65b8 service placement] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:51:57.096105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0b459-f891-4715-bb74-4daa488e3fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:51:57.096738 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b459-f891-4715-bb74-4daa488e3fdc service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:51:57.097025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b459-f891-4715-bb74-4daa488e3fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:51:57.097317 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b459-f891-4715-bb74-4daa488e3fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:51:57.099118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d3f0b459-f891-4715-bb74-4daa488e3fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:51:57.109037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b459-f891-4715-bb74-4daa488e3fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:51:57.110475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b459-f891-4715-bb74-4daa488e3fdc service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:51:57.118357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1171/2343] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:51:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:51:58.687128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=18 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:52:01.758624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca2be3-9000-41b5-8056-ab9c8f8c60f9 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:01.767782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca2be3-9000-41b5-8056-ab9c8f8c60f9 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:01.771682 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e922e1d-bb2f-42dc-ac64-0399e5a0e660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:01.772382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922e1d-bb2f-42dc-ac64-0399e5a0e660 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:01.772735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922e1d-bb2f-42dc-ac64-0399e5a0e660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:01.773092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922e1d-bb2f-42dc-ac64-0399e5a0e660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:01.775031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-7e922e1d-bb2f-42dc-ac64-0399e5a0e660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:01.787518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e922e1d-bb2f-42dc-ac64-0399e5a0e660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:01.788955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e922e1d-bb2f-42dc-ac64-0399e5a0e660 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:01.798490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1173/2344] 10.222.0.40 () {60 vars in 1396 bytes} [Wed Jun 8 06:52:01 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:52:07.114800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=15 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:52:11.794057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:52:14.039483 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31a298-5fd7-4d4d-b48d-ae6b2690aa8a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:14.040028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31a298-5fd7-4d4d-b48d-ae6b2690aa8a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:14.040028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31a298-5fd7-4d4d-b48d-ae6b2690aa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:14.058623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ba31a298-5fd7-4d4d-b48d-ae6b2690aa8a None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:52:14.059822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ba31a298-5fd7-4d4d-b48d-ae6b2690aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:14.067609 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1172/2345] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:52:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:52:14.204282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e922e1d-bb2f-42dc-ac64-0399e5a0e660 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:14.215788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e922e1d-bb2f-42dc-ac64-0399e5a0e660 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:14.220855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3b5e1-0de3-47a4-b113-4d81c1627733 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:14.221488 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3b5e1-0de3-47a4-b113-4d81c1627733 service swift] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:14.221770 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3b5e1-0de3-47a4-b113-4d81c1627733 service swift] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:14.222067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3b5e1-0de3-47a4-b113-4d81c1627733 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:14.230061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3b5e1-0de3-47a4-b113-4d81c1627733 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:14.231694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3b5e1-0de3-47a4-b113-4d81c1627733 service swift] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:14.240219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1174/2346] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:52:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:52:14.764613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31a298-5fd7-4d4d-b48d-ae6b2690aa8a None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:14.786886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31a298-5fd7-4d4d-b48d-ae6b2690aa8a None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:14.793886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b044244-cb0f-4821-9547-20f977f616ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:14.794877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044244-cb0f-4821-9547-20f977f616ec service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:14.796181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044244-cb0f-4821-9547-20f977f616ec service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:14.796679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044244-cb0f-4821-9547-20f977f616ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:14.799812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0b044244-cb0f-4821-9547-20f977f616ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:14.817118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b044244-cb0f-4821-9547-20f977f616ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:14.820268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b044244-cb0f-4821-9547-20f977f616ec service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:14.849018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1173/2347] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:52:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:52:17.488014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3b5e1-0de3-47a4-b113-4d81c1627733 service swift] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:17.507568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3b5e1-0de3-47a4-b113-4d81c1627733 service swift] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:17.514997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd897f9f-dc50-424f-b228-393e35ad884e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:17.516333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897f9f-dc50-424f-b228-393e35ad884e service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:17.516834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897f9f-dc50-424f-b228-393e35ad884e service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:17.517421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897f9f-dc50-424f-b228-393e35ad884e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:17.520156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-cd897f9f-dc50-424f-b228-393e35ad884e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:17.537439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd897f9f-dc50-424f-b228-393e35ad884e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:17.540287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd897f9f-dc50-424f-b228-393e35ad884e service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:17.568452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1175/2348] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:52:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:52:24.775766 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b044244-cb0f-4821-9547-20f977f616ec service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:24.787959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b044244-cb0f-4821-9547-20f977f616ec service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:24.794101 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64605db-2bf1-4557-9908-d87311b758a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:24.794801 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64605db-2bf1-4557-9908-d87311b758a1 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:24.795090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64605db-2bf1-4557-9908-d87311b758a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:24.795371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64605db-2bf1-4557-9908-d87311b758a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:24.797237 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f64605db-2bf1-4557-9908-d87311b758a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:24.809990 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64605db-2bf1-4557-9908-d87311b758a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:24.815410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64605db-2bf1-4557-9908-d87311b758a1 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:24.828911 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1174/2349] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:52:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:52:27.552068 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=12 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:52:34.823690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=15 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:52:34.993291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b346502-99bb-4fd5-850e-f3388f33fc9a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:34.993774 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b346502-99bb-4fd5-850e-f3388f33fc9a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:34.993884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b346502-99bb-4fd5-850e-f3388f33fc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:35.011243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-3b346502-99bb-4fd5-850e-f3388f33fc9a None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:52:35.012463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3b346502-99bb-4fd5-850e-f3388f33fc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:35.020051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1176/2350] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:52:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:52:35.032348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64605db-2bf1-4557-9908-d87311b758a1 service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:35.043779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64605db-2bf1-4557-9908-d87311b758a1 service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:35.048947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1807e0a-3b26-48b0-b17f-f6583bba5bdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:35.049587 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1807e0a-3b26-48b0-b17f-f6583bba5bdf service swift] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:35.049874 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1807e0a-3b26-48b0-b17f-f6583bba5bdf service swift] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:35.050152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1807e0a-3b26-48b0-b17f-f6583bba5bdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:35.058206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1807e0a-3b26-48b0-b17f-f6583bba5bdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:35.059807 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1807e0a-3b26-48b0-b17f-f6583bba5bdf service swift] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:35.067820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1175/2351] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:52:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 06:52:45.006399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:52:45.064535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=6 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:52:50.576536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b346502-99bb-4fd5-850e-f3388f33fc9a None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:50.589379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b346502-99bb-4fd5-850e-f3388f33fc9a None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:50.595292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551c95c-54f2-446c-b374-9e04d3209023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:50.596028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c95c-54f2-446c-b374-9e04d3209023 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:50.596312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c95c-54f2-446c-b374-9e04d3209023 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:50.596588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c95c-54f2-446c-b374-9e04d3209023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:50.598429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8551c95c-54f2-446c-b374-9e04d3209023 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:50.611418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551c95c-54f2-446c-b374-9e04d3209023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:50.613027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551c95c-54f2-446c-b374-9e04d3209023 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:50.624045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1177/2352] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:52:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:52:52.053662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1807e0a-3b26-48b0-b17f-f6583bba5bdf service swift] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:52.066113 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1807e0a-3b26-48b0-b17f-f6583bba5bdf service swift] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:52.071791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce650-d0db-44c9-b4e9-106bcf0956ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:52.072461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce650-d0db-44c9-b4e9-106bcf0956ff service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:52.072746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce650-d0db-44c9-b4e9-106bcf0956ff service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:52.073025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce650-d0db-44c9-b4e9-106bcf0956ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:52.075080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-592ce650-d0db-44c9-b4e9-106bcf0956ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:52.089215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce650-d0db-44c9-b4e9-106bcf0956ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:52.090871 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce650-d0db-44c9-b4e9-106bcf0956ff service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:52.100587 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1176/2353] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:52:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:52:53.261325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551c95c-54f2-446c-b374-9e04d3209023 service nova] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:53.270606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551c95c-54f2-446c-b374-9e04d3209023 service nova] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:53.274195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b562f-e466-47d5-a66d-9fad2179edde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:53.274888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b562f-e466-47d5-a66d-9fad2179edde service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:53.281153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b562f-e466-47d5-a66d-9fad2179edde service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:53.281153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b562f-e466-47d5-a66d-9fad2179edde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:53.281153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e42b562f-e466-47d5-a66d-9fad2179edde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:53.342217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b562f-e466-47d5-a66d-9fad2179edde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:53.343665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b562f-e466-47d5-a66d-9fad2179edde service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:53.353495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1178/2354] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:52:53.712222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213ae95-c38d-48d4-8576-ac2c8dd2ff62 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:53.712741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213ae95-c38d-48d4-8576-ac2c8dd2ff62 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:53.712835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213ae95-c38d-48d4-8576-ac2c8dd2ff62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:53.730667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-2213ae95-c38d-48d4-8576-ac2c8dd2ff62 None None] MFA Rules not processed for user `3574d4eb86234460889a586a4a6acbd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:52:53.735527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2213ae95-c38d-48d4-8576-ac2c8dd2ff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:53.739800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1177/2355] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:52:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:52:54.590090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b562f-e466-47d5-a66d-9fad2179edde service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:54.598633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b562f-e466-47d5-a66d-9fad2179edde service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:54.602170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e00591-4b0c-46d1-b4fe-d7f4478a22dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:54.602842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00591-4b0c-46d1-b4fe-d7f4478a22dc service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:54.603126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00591-4b0c-46d1-b4fe-d7f4478a22dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:54.603403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00591-4b0c-46d1-b4fe-d7f4478a22dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:54.605205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-00e00591-4b0c-46d1-b4fe-d7f4478a22dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:54.615574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e00591-4b0c-46d1-b4fe-d7f4478a22dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:54.616996 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e00591-4b0c-46d1-b4fe-d7f4478a22dc service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:54.625643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1179/2356] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:52:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:52:54.652264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213ae95-c38d-48d4-8576-ac2c8dd2ff62 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:54.663143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213ae95-c38d-48d4-8576-ac2c8dd2ff62 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:54.668157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e67a9-a90f-43ca-adb1-c9339f9523c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:54.669229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e67a9-a90f-43ca-adb1-c9339f9523c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:54.670583 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e67a9-a90f-43ca-adb1-c9339f9523c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:54.671161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e67a9-a90f-43ca-adb1-c9339f9523c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:54.673431 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f91e67a9-a90f-43ca-adb1-c9339f9523c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:54.684132 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e67a9-a90f-43ca-adb1-c9339f9523c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:54.685560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e67a9-a90f-43ca-adb1-c9339f9523c2 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:54.694584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1178/2357] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:52:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:52:54.836377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e619cdf-177a-4aee-8a2f-1a47ecc2e27b None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:54.836981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e619cdf-177a-4aee-8a2f-1a47ecc2e27b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:54.837456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e619cdf-177a-4aee-8a2f-1a47ecc2e27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:54.856728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-3e619cdf-177a-4aee-8a2f-1a47ecc2e27b None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:52:54.860109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3e619cdf-177a-4aee-8a2f-1a47ecc2e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:54.879734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1180/2358] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jun 8 06:52:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:52:54.890715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e67a9-a90f-43ca-adb1-c9339f9523c2 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:54.921749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e67a9-a90f-43ca-adb1-c9339f9523c2 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:54.926911 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ec080-33fc-4fd1-a705-23a20cc0005a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:54.927649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ec080-33fc-4fd1-a705-23a20cc0005a service swift] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:54.927937 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ec080-33fc-4fd1-a705-23a20cc0005a service swift] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:54.928472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ec080-33fc-4fd1-a705-23a20cc0005a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:54.937754 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ec080-33fc-4fd1-a705-23a20cc0005a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:54.944704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ec080-33fc-4fd1-a705-23a20cc0005a service swift] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:54.945023 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6422cad-9064-4f40-8052-e379fe775b2c None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:54.945147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6422cad-9064-4f40-8052-e379fe775b2c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:54.945361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6422cad-9064-4f40-8052-e379fe775b2c None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:54.947169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1181/2359] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 06:52:54.950467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1179/2360] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:52:54.958376 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35ec98-1625-4beb-9d0f-b8db6da5bfa0 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:54.958622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35ec98-1625-4beb-9d0f-b8db6da5bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:54.959002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35ec98-1625-4beb-9d0f-b8db6da5bfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:54.979045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-3f35ec98-1625-4beb-9d0f-b8db6da5bfa0 None None] MFA Rules not processed for user `11838a2908884cc79df912b3b2199564`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:52:54.980254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3f35ec98-1625-4beb-9d0f-b8db6da5bfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:54.988130 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1182/2361] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:52:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:52:55.003244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ec080-33fc-4fd1-a705-23a20cc0005a service swift] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:55.014705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ec080-33fc-4fd1-a705-23a20cc0005a service swift] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:55.021239 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6438fc-e9ca-45de-9d75-2abb203e2372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:55.022075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6438fc-e9ca-45de-9d75-2abb203e2372 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:55.022739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6438fc-e9ca-45de-9d75-2abb203e2372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:55.023224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6438fc-e9ca-45de-9d75-2abb203e2372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:55.042036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6438fc-e9ca-45de-9d75-2abb203e2372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:55.043721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6438fc-e9ca-45de-9d75-2abb203e2372 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:55.066539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1180/2362] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:52:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:52:55.145365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b849b-c348-457f-9e03-e5eab20a6843 None None] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:55.145652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b849b-c348-457f-9e03-e5eab20a6843 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:55.145947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b849b-c348-457f-9e03-e5eab20a6843 None None] PATH_INFO: `/` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:55.147354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1183/2363] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jun 8 06:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 06:52:55.156300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285e88-ced0-4369-8d6f-4fe8d77bc04c None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:55.156300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285e88-ced0-4369-8d6f-4fe8d77bc04c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:55.156300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285e88-ced0-4369-8d6f-4fe8d77bc04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:55.183322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-0d285e88-ced0-4369-8d6f-4fe8d77bc04c None None] MFA Rules not processed for user `b8661ef27af34bbea11e215831d50843`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:52:55.185297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0d285e88-ced0-4369-8d6f-4fe8d77bc04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:55.200494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1181/2364] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jun 8 06:52:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:52:55.206961 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b849b-c348-457f-9e03-e5eab20a6843 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:55.222121 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b849b-c348-457f-9e03-e5eab20a6843 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:55.226056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ec026-31c8-4819-b08e-b358532c2724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:55.226777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ec026-31c8-4819-b08e-b358532c2724 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:55.227141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ec026-31c8-4819-b08e-b358532c2724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:55.227334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ec026-31c8-4819-b08e-b358532c2724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:55.242346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ec026-31c8-4819-b08e-b358532c2724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:55.243933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ec026-31c8-4819-b08e-b358532c2724 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:55.259406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1184/2365] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:52:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:52:58.797792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285e88-ced0-4369-8d6f-4fe8d77bc04c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:58.799322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0d285e88-ced0-4369-8d6f-4fe8d77bc04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:58.813939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285e88-ced0-4369-8d6f-4fe8d77bc04c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:58.818571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5af60-e4d1-47c9-9d07-2d30bd271900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:58.819978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5af60-e4d1-47c9-9d07-2d30bd271900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:58.824641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5af60-e4d1-47c9-9d07-2d30bd271900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:58.824641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5af60-e4d1-47c9-9d07-2d30bd271900 admin admin] PATH_INFO: `/v3/users/d89fede014d94157aeaeebbbceac28a7` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:58.824641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5af60-e4d1-47c9-9d07-2d30bd271900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89fede014d94157aeaeebbbceac28a7)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:58.824641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5af60-e4d1-47c9-9d07-2d30bd271900 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:59.029287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b9c5af60-e4d1-47c9-9d07-2d30bd271900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89fede014d94157aeaeebbbceac28a7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:52:59.029951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b9c5af60-e4d1-47c9-9d07-2d30bd271900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89fede014d94157aeaeebbbceac28a7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:52:59.042326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b9c5af60-e4d1-47c9-9d07-2d30bd271900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89fede014d94157aeaeebbbceac28a7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:52:59.099863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b9c5af60-e4d1-47c9-9d07-2d30bd271900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89fede014d94157aeaeebbbceac28a7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:52:59.108414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b9c5af60-e4d1-47c9-9d07-2d30bd271900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89fede014d94157aeaeebbbceac28a7'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:52:59.115116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1182/2366] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:52:58 2022] DELETE /identity/v3/users/d89fede014d94157aeaeebbbceac28a7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:52:59.387139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ec026-31c8-4819-b08e-b358532c2724 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:59.397433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ec026-31c8-4819-b08e-b358532c2724 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:59.459865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:59.460729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:59.461123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:59.461402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] PATH_INFO: `/v3/projects/2c2a51a4ac7e425ea0e4dc0067024520` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:59.462624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2a51a4ac7e425ea0e4dc0067024520)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:59.464557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:59.598955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:52:59.604269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2a51a4ac7e425ea0e4dc0067024520', 'request_id': 'req-19a5134f-92f2-4251-ac33-9e08669bad27'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:52:59.714594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2a51a4ac7e425ea0e4dc0067024520', 'request_id': 'req-19a5134f-92f2-4251-ac33-9e08669bad27'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:52:59.721517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2a51a4ac7e425ea0e4dc0067024520', 'request_id': 'req-19a5134f-92f2-4251-ac33-9e08669bad27'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:52:59.733777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] The token cache is being invalidate because project 2c2a51a4ac7e425ea0e4dc0067024520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:52:59.734066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:52:59.734820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-19a5134f-92f2-4251-ac33-9e08669bad27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:52:59.736350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1185/2367] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:52:59 2022] DELETE /identity/v3/projects/2c2a51a4ac7e425ea0e4dc0067024520 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:52:59.741282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248972f-4718-4be5-97d2-c84c552d4718 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:59.741575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248972f-4718-4be5-97d2-c84c552d4718 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:59.746180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248972f-4718-4be5-97d2-c84c552d4718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:59.760421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-e248972f-4718-4be5-97d2-c84c552d4718 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:52:59.761616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e248972f-4718-4be5-97d2-c84c552d4718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:59.836820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1183/2368] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:52:59.847234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece81e-424d-42e7-b677-729b28c06cd0 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:59.847660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece81e-424d-42e7-b677-729b28c06cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:59.848142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece81e-424d-42e7-b677-729b28c06cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:59.868575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c9ece81e-424d-42e7-b677-729b28c06cd0 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:52:59.869774 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c9ece81e-424d-42e7-b677-729b28c06cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:52:59.878369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1186/2369] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:52:59.882316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248972f-4718-4be5-97d2-c84c552d4718 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:59.892629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248972f-4718-4be5-97d2-c84c552d4718 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:59.897404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb71dd-64f9-49a7-8e4e-1e66381c22be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:59.898065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb71dd-64f9-49a7-8e4e-1e66381c22be admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:59.898384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb71dd-64f9-49a7-8e4e-1e66381c22be admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:59.898660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb71dd-64f9-49a7-8e4e-1e66381c22be admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:59.899386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb71dd-64f9-49a7-8e4e-1e66381c22be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:52:59.899691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb71dd-64f9-49a7-8e4e-1e66381c22be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:59.901313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb71dd-64f9-49a7-8e4e-1e66381c22be admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:52:59.902857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:52:59.914162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1184/2370] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:52:59.918551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ece81e-424d-42e7-b677-729b28c06cd0 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:52:59.928068 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ece81e-424d-42e7-b677-729b28c06cd0 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:52:59.932982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52fa8a-5d70-49c8-a48e-08f5dc252d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:52:59.933650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52fa8a-5d70-49c8-a48e-08f5dc252d6d admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:52:59.933934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52fa8a-5d70-49c8-a48e-08f5dc252d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:52:59.934224 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52fa8a-5d70-49c8-a48e-08f5dc252d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:52:59.934949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52fa8a-5d70-49c8-a48e-08f5dc252d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:52:59.936881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52fa8a-5d70-49c8-a48e-08f5dc252d6d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:00.022365 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1187/2371] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:52:59 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:00.023657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb71dd-64f9-49a7-8e4e-1e66381c22be admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:00.034693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb71dd-64f9-49a7-8e4e-1e66381c22be admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:00.093528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ced07-2467-4b36-ad58-587f38d2a38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:00.094204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ced07-2467-4b36-ad58-587f38d2a38f admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:00.094530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ced07-2467-4b36-ad58-587f38d2a38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:00.094810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ced07-2467-4b36-ad58-587f38d2a38f admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:00.095505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ced07-2467-4b36-ad58-587f38d2a38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:00.097437 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ced07-2467-4b36-ad58-587f38d2a38f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:00.196788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1185/2372] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:00 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:00.202100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52fa8a-5d70-49c8-a48e-08f5dc252d6d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:00.212454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52fa8a-5d70-49c8-a48e-08f5dc252d6d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:00.217349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf7091-d3ba-423b-92ed-245f50dc7442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:00.220426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf7091-d3ba-423b-92ed-245f50dc7442 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:00.220735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf7091-d3ba-423b-92ed-245f50dc7442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:00.221022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf7091-d3ba-423b-92ed-245f50dc7442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:00.221821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf7091-d3ba-423b-92ed-245f50dc7442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:00.223548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf7091-d3ba-423b-92ed-245f50dc7442 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:00.234551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1188/2373] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:00.238805 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ced07-2467-4b36-ad58-587f38d2a38f admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:00.251072 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ced07-2467-4b36-ad58-587f38d2a38f admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:00.256991 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a00b85-5374-4475-b5ce-6e17b6492822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:00.257736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a00b85-5374-4475-b5ce-6e17b6492822 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:00.258163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a00b85-5374-4475-b5ce-6e17b6492822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:00.258665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a00b85-5374-4475-b5ce-6e17b6492822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:00.259585 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a00b85-5374-4475-b5ce-6e17b6492822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:00.261309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a00b85-5374-4475-b5ce-6e17b6492822 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:00.275030 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1186/2374] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:00.279463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf7091-d3ba-423b-92ed-245f50dc7442 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:00.290517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf7091-d3ba-423b-92ed-245f50dc7442 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:00.295887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e7bfc-fa27-45b2-82db-5a19b1324779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:00.296927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7bfc-fa27-45b2-82db-5a19b1324779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:00.297441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7bfc-fa27-45b2-82db-5a19b1324779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:00.297818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7bfc-fa27-45b2-82db-5a19b1324779 admin admin] PATH_INFO: `/v3/projects/24375a75f27440f59177b10a1d4229ed/users/be85a2cb169a4d13aaad149c8613ee55/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:00.317521 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e7bfc-fa27-45b2-82db-5a19b1324779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24375a75f27440f59177b10a1d4229ed, user_id=be85a2cb169a4d13aaad149c8613ee55, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:00.318395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e7bfc-fa27-45b2-82db-5a19b1324779 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:00.403584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1189/2375] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:00 2022] PUT /identity/v3/projects/24375a75f27440f59177b10a1d4229ed/users/be85a2cb169a4d13aaad149c8613ee55/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:00.414901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58c9d-d4e2-4c95-b57d-b05aa76d5255 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:00.415398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58c9d-d4e2-4c95-b57d-b05aa76d5255 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:00.415687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58c9d-d4e2-4c95-b57d-b05aa76d5255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:00.452747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a1f58c9d-d4e2-4c95-b57d-b05aa76d5255 None None] MFA Rules not processed for user `be85a2cb169a4d13aaad149c8613ee55`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:00.454439 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a1f58c9d-d4e2-4c95-b57d-b05aa76d5255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:00.540822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1187/2376] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:00.544574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e7bfc-fa27-45b2-82db-5a19b1324779 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:00.624597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e7bfc-fa27-45b2-82db-5a19b1324779 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:00.629576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652ae81-adc4-4953-ad7f-f2343ec11c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:00.630268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652ae81-adc4-4953-ad7f-f2343ec11c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:00.630552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652ae81-adc4-4953-ad7f-f2343ec11c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:00.630830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652ae81-adc4-4953-ad7f-f2343ec11c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:00.631524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652ae81-adc4-4953-ad7f-f2343ec11c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:00.633509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652ae81-adc4-4953-ad7f-f2343ec11c09 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:00.736471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1190/2377] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:00 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:00.740659 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f58c9d-d4e2-4c95-b57d-b05aa76d5255 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:00.753017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f58c9d-d4e2-4c95-b57d-b05aa76d5255 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:00.823575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180eb0a8-74df-4108-a4b5-aa94741e1174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:00.824429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180eb0a8-74df-4108-a4b5-aa94741e1174 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:00.825041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180eb0a8-74df-4108-a4b5-aa94741e1174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:00.825387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180eb0a8-74df-4108-a4b5-aa94741e1174 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:00.826117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180eb0a8-74df-4108-a4b5-aa94741e1174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:00.828111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180eb0a8-74df-4108-a4b5-aa94741e1174 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:00.836234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:00.932154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1188/2378] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:00 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:00.934162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652ae81-adc4-4953-ad7f-f2343ec11c09 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:00.944336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652ae81-adc4-4953-ad7f-f2343ec11c09 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:00.948940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d570901-410b-4298-a939-85af65cb2b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:00.949640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d570901-410b-4298-a939-85af65cb2b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:00.950174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d570901-410b-4298-a939-85af65cb2b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:00.950487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d570901-410b-4298-a939-85af65cb2b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:00.951282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d570901-410b-4298-a939-85af65cb2b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:00.952877 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d570901-410b-4298-a939-85af65cb2b98 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:00.964738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1191/2379] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:00.969585 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180eb0a8-74df-4108-a4b5-aa94741e1174 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:00.979664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180eb0a8-74df-4108-a4b5-aa94741e1174 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:00.984854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beb8e1-0bbb-45c2-b327-d747e823674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:00.985738 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb8e1-0bbb-45c2-b327-d747e823674e admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:00.986018 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb8e1-0bbb-45c2-b327-d747e823674e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:00.986327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb8e1-0bbb-45c2-b327-d747e823674e admin admin] PATH_INFO: `/v3/projects/a4b19f4ab9844a489058119ed7fd55dd/users/d51f40bb807149b0b77570644b29653a/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:01.001284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beb8e1-0bbb-45c2-b327-d747e823674e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b19f4ab9844a489058119ed7fd55dd, user_id=d51f40bb807149b0b77570644b29653a, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:01.003960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beb8e1-0bbb-45c2-b327-d747e823674e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:01.100442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1189/2380] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:00 2022] PUT /identity/v3/projects/a4b19f4ab9844a489058119ed7fd55dd/users/d51f40bb807149b0b77570644b29653a/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:01.104558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d570901-410b-4298-a939-85af65cb2b98 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:01.115992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d570901-410b-4298-a939-85af65cb2b98 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:01.165951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:01.183108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dea6b7-628c-419e-b19c-b64ef2dcc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:01.183798 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea6b7-628c-419e-b19c-b64ef2dcc2df admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:01.184064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea6b7-628c-419e-b19c-b64ef2dcc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:01.184340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dea6b7-628c-419e-b19c-b64ef2dcc2df admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:01.185079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dea6b7-628c-419e-b19c-b64ef2dcc2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:01.186752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dea6b7-628c-419e-b19c-b64ef2dcc2df admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:01.200262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1192/2381] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:01.201535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beb8e1-0bbb-45c2-b327-d747e823674e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:01.212223 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beb8e1-0bbb-45c2-b327-d747e823674e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:01.217732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c20c-0bf4-455a-816d-386d02f4b402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:01.218718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c20c-0bf4-455a-816d-386d02f4b402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:01.218998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c20c-0bf4-455a-816d-386d02f4b402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:01.219272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c20c-0bf4-455a-816d-386d02f4b402 admin admin] PATH_INFO: `/v3/projects/a4b19f4ab9844a489058119ed7fd55dd/users/d51f40bb807149b0b77570644b29653a/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:01.221300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33c20c-0bf4-455a-816d-386d02f4b402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b19f4ab9844a489058119ed7fd55dd, user_id=d51f40bb807149b0b77570644b29653a, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:01.224049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33c20c-0bf4-455a-816d-386d02f4b402 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:01.236125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1190/2382] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:01 2022] PUT /identity/v3/projects/a4b19f4ab9844a489058119ed7fd55dd/users/d51f40bb807149b0b77570644b29653a/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:01.246428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397815c-df3a-44c0-ae8b-d98333c79b29 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:01.246797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397815c-df3a-44c0-ae8b-d98333c79b29 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:01.247166 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397815c-df3a-44c0-ae8b-d98333c79b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:01.275666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a397815c-df3a-44c0-ae8b-d98333c79b29 None None] MFA Rules not processed for user `d51f40bb807149b0b77570644b29653a`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:01.276865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a397815c-df3a-44c0-ae8b-d98333c79b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:01.345596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1193/2383] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:01.356800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c20c-0bf4-455a-816d-386d02f4b402 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:01.358550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1f33c20c-0bf4-455a-816d-386d02f4b402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:01.417441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c20c-0bf4-455a-816d-386d02f4b402 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:01.421086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12c188-03ca-4eb3-a942-57fc634817a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:01.421733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12c188-03ca-4eb3-a942-57fc634817a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:01.422019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12c188-03ca-4eb3-a942-57fc634817a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:01.422338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12c188-03ca-4eb3-a942-57fc634817a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:01.431322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12c188-03ca-4eb3-a942-57fc634817a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:01.432747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12c188-03ca-4eb3-a942-57fc634817a2 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:01.442771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1191/2384] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:01.691077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397815c-df3a-44c0-ae8b-d98333c79b29 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:01.702397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397815c-df3a-44c0-ae8b-d98333c79b29 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:01.706553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5b78a-cbac-432b-8be8-7a1f9af8eb7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:01.707207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b78a-cbac-432b-8be8-7a1f9af8eb7a service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:01.707498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b78a-cbac-432b-8be8-7a1f9af8eb7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:01.707773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b78a-cbac-432b-8be8-7a1f9af8eb7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:01.768949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5b78a-cbac-432b-8be8-7a1f9af8eb7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:01.770465 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5b78a-cbac-432b-8be8-7a1f9af8eb7a service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:01.779668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1194/2385] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:11.438313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:11.775908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=72 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:25.863374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12c188-03ca-4eb3-a942-57fc634817a2 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:25.864886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ae12c188-03ca-4eb3-a942-57fc634817a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:25.924869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12c188-03ca-4eb3-a942-57fc634817a2 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:25.928735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73449b10-e004-4fa3-b0c7-469cc7e57311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:25.929496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73449b10-e004-4fa3-b0c7-469cc7e57311 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:25.929781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73449b10-e004-4fa3-b0c7-469cc7e57311 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:25.930356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73449b10-e004-4fa3-b0c7-469cc7e57311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:25.931877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-73449b10-e004-4fa3-b0c7-469cc7e57311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:26.002519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73449b10-e004-4fa3-b0c7-469cc7e57311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:26.003973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73449b10-e004-4fa3-b0c7-469cc7e57311 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:26.014662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1192/2386] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:28.194327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5b78a-cbac-432b-8be8-7a1f9af8eb7a service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:28.205824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5b78a-cbac-432b-8be8-7a1f9af8eb7a service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:28.211010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f325d5a-dd7e-4eee-9c0a-7fe06a19c874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:28.211863 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f325d5a-dd7e-4eee-9c0a-7fe06a19c874 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:28.212411 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f325d5a-dd7e-4eee-9c0a-7fe06a19c874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:28.212947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f325d5a-dd7e-4eee-9c0a-7fe06a19c874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:28.215147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-4f325d5a-dd7e-4eee-9c0a-7fe06a19c874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:28.234439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f325d5a-dd7e-4eee-9c0a-7fe06a19c874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:28.236843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f325d5a-dd7e-4eee-9c0a-7fe06a19c874 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:28.252743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1195/2387] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:30.429664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73449b10-e004-4fa3-b0c7-469cc7e57311 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:30.431104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-73449b10-e004-4fa3-b0c7-469cc7e57311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:30.555700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73449b10-e004-4fa3-b0c7-469cc7e57311 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:30.565095 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dd68e-d0c5-4728-b3ea-c5885878a68e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:30.565777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dd68e-d0c5-4728-b3ea-c5885878a68e service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:30.566154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dd68e-d0c5-4728-b3ea-c5885878a68e service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:30.566757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dd68e-d0c5-4728-b3ea-c5885878a68e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:30.568298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-bf4dd68e-d0c5-4728-b3ea-c5885878a68e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:30.582608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dd68e-d0c5-4728-b3ea-c5885878a68e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:30.584380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dd68e-d0c5-4728-b3ea-c5885878a68e service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:30.600467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1193/2388] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:30.603304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f325d5a-dd7e-4eee-9c0a-7fe06a19c874 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:30.605446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-4f325d5a-dd7e-4eee-9c0a-7fe06a19c874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:30.623941 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f325d5a-dd7e-4eee-9c0a-7fe06a19c874 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:30.634780 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd73cf-a322-462c-a777-0bbcd4b6a477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:30.636092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd73cf-a322-462c-a777-0bbcd4b6a477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:30.636568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd73cf-a322-462c-a777-0bbcd4b6a477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:30.637091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd73cf-a322-462c-a777-0bbcd4b6a477 admin admin] PATH_INFO: `/v3/users/cc861f1c354f45b09cb61fd86245a5cf` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:30.638731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd73cf-a322-462c-a777-0bbcd4b6a477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc861f1c354f45b09cb61fd86245a5cf)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:30.642738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd73cf-a322-462c-a777-0bbcd4b6a477 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:30.847529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7fdd73cf-a322-462c-a777-0bbcd4b6a477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc861f1c354f45b09cb61fd86245a5cf'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:30.848574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7fdd73cf-a322-462c-a777-0bbcd4b6a477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc861f1c354f45b09cb61fd86245a5cf'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:30.956428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7fdd73cf-a322-462c-a777-0bbcd4b6a477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc861f1c354f45b09cb61fd86245a5cf'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:30.972372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7fdd73cf-a322-462c-a777-0bbcd4b6a477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc861f1c354f45b09cb61fd86245a5cf'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:30.979250 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7fdd73cf-a322-462c-a777-0bbcd4b6a477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc861f1c354f45b09cb61fd86245a5cf'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:30.986045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1196/2389] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:30 2022] DELETE /identity/v3/users/cc861f1c354f45b09cb61fd86245a5cf => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:31.252907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dd68e-d0c5-4728-b3ea-c5885878a68e service placement] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:31.264721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dd68e-d0c5-4728-b3ea-c5885878a68e service placement] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:31.324431 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:31.349476 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:31.350473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:31.350925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:31.351283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] PATH_INFO: `/v3/projects/7f796b1b89134bd4b26da60df1bb5353` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:31.362192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f796b1b89134bd4b26da60df1bb5353)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:31.364880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:31.472154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f796b1b89134bd4b26da60df1bb5353', 'request_id': 'req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:31.519965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f796b1b89134bd4b26da60df1bb5353', 'request_id': 'req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:31.526721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f796b1b89134bd4b26da60df1bb5353', 'request_id': 'req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:31.537915 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] The token cache is being invalidate because project 7f796b1b89134bd4b26da60df1bb5353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:31.538325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:31.539007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-db6eb30d-f5e9-4947-91ce-02ecb65c8b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:31.540872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1194/2390] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:31 2022] DELETE /identity/v3/projects/7f796b1b89134bd4b26da60df1bb5353 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:31.545491 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab7a5-896a-4c06-aeba-f5bfb559a71a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:31.545826 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab7a5-896a-4c06-aeba-f5bfb559a71a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:31.546083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab7a5-896a-4c06-aeba-f5bfb559a71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:31.564106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-959ab7a5-896a-4c06-aeba-f5bfb559a71a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:31.565473 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-959ab7a5-896a-4c06-aeba-f5bfb559a71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:31.627183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1197/2391] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:31.634844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8487fa-b910-447f-9bc8-d2775e473dae None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:31.635208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8487fa-b910-447f-9bc8-d2775e473dae None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:31.635602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8487fa-b910-447f-9bc8-d2775e473dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:31.656584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-2a8487fa-b910-447f-9bc8-d2775e473dae None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:31.657922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2a8487fa-b910-447f-9bc8-d2775e473dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:31.670998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1195/2392] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:31.675051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ab7a5-896a-4c06-aeba-f5bfb559a71a None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:31.691056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ab7a5-896a-4c06-aeba-f5bfb559a71a None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:31.695849 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cf66c-aa4e-4534-9fb6-563262fdcf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:31.697017 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf66c-aa4e-4534-9fb6-563262fdcf04 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:31.704393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf66c-aa4e-4534-9fb6-563262fdcf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:31.704393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf66c-aa4e-4534-9fb6-563262fdcf04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:31.704393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cf66c-aa4e-4534-9fb6-563262fdcf04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:53:31.704393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cf66c-aa4e-4534-9fb6-563262fdcf04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:31.704393 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cf66c-aa4e-4534-9fb6-563262fdcf04 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:31.728610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1198/2393] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:53:31.729369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8487fa-b910-447f-9bc8-d2775e473dae None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:31.740358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8487fa-b910-447f-9bc8-d2775e473dae None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:31.746829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9abce9-c4ee-439e-9aa7-f1ed4881fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:31.747513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9abce9-c4ee-439e-9aa7-f1ed4881fa53 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:31.748359 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9abce9-c4ee-439e-9aa7-f1ed4881fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:31.748664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9abce9-c4ee-439e-9aa7-f1ed4881fa53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:31.749361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9abce9-c4ee-439e-9aa7-f1ed4881fa53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:31.761393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9abce9-c4ee-439e-9aa7-f1ed4881fa53 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:31.910288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1196/2394] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:31 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:31.911962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cf66c-aa4e-4534-9fb6-563262fdcf04 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:31.923242 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cf66c-aa4e-4534-9fb6-563262fdcf04 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:32.015134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:32.034143 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef0a50-a94c-4726-9b82-02d1aef8f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:32.036751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef0a50-a94c-4726-9b82-02d1aef8f51b admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:32.036751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef0a50-a94c-4726-9b82-02d1aef8f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:32.036751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef0a50-a94c-4726-9b82-02d1aef8f51b admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:32.036751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef0a50-a94c-4726-9b82-02d1aef8f51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:32.038025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef0a50-a94c-4726-9b82-02d1aef8f51b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:32.148548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1199/2395] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:31 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:32.152326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9abce9-c4ee-439e-9aa7-f1ed4881fa53 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:32.162705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9abce9-c4ee-439e-9aa7-f1ed4881fa53 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:32.167723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2ab44-07f6-477a-8bf2-ff0610138f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:32.168683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2ab44-07f6-477a-8bf2-ff0610138f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:32.168683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2ab44-07f6-477a-8bf2-ff0610138f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:32.169029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2ab44-07f6-477a-8bf2-ff0610138f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:32.170353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2ab44-07f6-477a-8bf2-ff0610138f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:32.172027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2ab44-07f6-477a-8bf2-ff0610138f41 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:32.182753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1197/2396] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:32.187106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef0a50-a94c-4726-9b82-02d1aef8f51b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:32.197263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef0a50-a94c-4726-9b82-02d1aef8f51b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:32.203171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d118a6-9cb4-424d-8766-7e5c4de8aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:32.203828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d118a6-9cb4-424d-8766-7e5c4de8aa9c admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:32.204108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d118a6-9cb4-424d-8766-7e5c4de8aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:32.204379 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d118a6-9cb4-424d-8766-7e5c4de8aa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:32.205099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d118a6-9cb4-424d-8766-7e5c4de8aa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:32.206733 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d118a6-9cb4-424d-8766-7e5c4de8aa9c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:32.219440 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1200/2397] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:32.223870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2ab44-07f6-477a-8bf2-ff0610138f41 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:32.236785 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2ab44-07f6-477a-8bf2-ff0610138f41 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:32.241667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4897b-3fb6-4e96-a7ec-1a1ff2364619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:32.242595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4897b-3fb6-4e96-a7ec-1a1ff2364619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:32.242878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4897b-3fb6-4e96-a7ec-1a1ff2364619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:32.243157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4897b-3fb6-4e96-a7ec-1a1ff2364619 admin admin] PATH_INFO: `/v3/projects/f4fe73625fb341c594c7e7cf2144d977/users/f052cf5d72114e6e8ca9f8a604d6a6a3/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:32.258377 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4897b-3fb6-4e96-a7ec-1a1ff2364619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fe73625fb341c594c7e7cf2144d977, user_id=f052cf5d72114e6e8ca9f8a604d6a6a3, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:32.261092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4897b-3fb6-4e96-a7ec-1a1ff2364619 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:32.309173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d118a6-9cb4-424d-8766-7e5c4de8aa9c admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:32.311676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-59d118a6-9cb4-424d-8766-7e5c4de8aa9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:32.324821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d118a6-9cb4-424d-8766-7e5c4de8aa9c admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:32.329842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:32.330745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:32.331029 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:32.331307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] PATH_INFO: `/v3/users/c6523f0f4dc249659c4e63fc5ee5e783` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:32.332533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6523f0f4dc249659c4e63fc5ee5e783)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:32.334493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:32.349691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1198/2398] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:32 2022] PUT /identity/v3/projects/f4fe73625fb341c594c7e7cf2144d977/users/f052cf5d72114e6e8ca9f8a604d6a6a3/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:32.359895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191294a-3d75-4a0c-8dba-b6250924ad06 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:32.360192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191294a-3d75-4a0c-8dba-b6250924ad06 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:32.360472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191294a-3d75-4a0c-8dba-b6250924ad06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:32.390816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-1191294a-3d75-4a0c-8dba-b6250924ad06 None None] MFA Rules not processed for user `f052cf5d72114e6e8ca9f8a604d6a6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:32.392025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1191294a-3d75-4a0c-8dba-b6250924ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:32.442066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:32.462297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1199/2399] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:32.474336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191294a-3d75-4a0c-8dba-b6250924ad06 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:32.477058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1191294a-3d75-4a0c-8dba-b6250924ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:32.546336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6523f0f4dc249659c4e63fc5ee5e783'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:32.547001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6523f0f4dc249659c4e63fc5ee5e783'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:32.555775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191294a-3d75-4a0c-8dba-b6250924ad06 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:32.561464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5375eff-8dec-431f-b28f-29ad8ea43ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:32.562119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5375eff-8dec-431f-b28f-29ad8ea43ee7 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:32.562437 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5375eff-8dec-431f-b28f-29ad8ea43ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:32.567847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5375eff-8dec-431f-b28f-29ad8ea43ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:32.567847 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c5375eff-8dec-431f-b28f-29ad8ea43ee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:32.575381 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5375eff-8dec-431f-b28f-29ad8ea43ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:32.577015 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5375eff-8dec-431f-b28f-29ad8ea43ee7 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:32.590410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1200/2400] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:32.622459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6523f0f4dc249659c4e63fc5ee5e783'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:32.639100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6523f0f4dc249659c4e63fc5ee5e783'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:32.652074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6523f0f4dc249659c4e63fc5ee5e783'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:32.659326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1201/2401] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:32 2022] DELETE /identity/v3/users/c6523f0f4dc249659c4e63fc5ee5e783 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:53:32.807569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5375eff-8dec-431f-b28f-29ad8ea43ee7 service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:32.809038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c5375eff-8dec-431f-b28f-29ad8ea43ee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:32.878205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5375eff-8dec-431f-b28f-29ad8ea43ee7 service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:32.932984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:32.934577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:32.936657 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e5f2-61a7-4a0a-a60e-044cf56dcf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:32.937547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e5f2-61a7-4a0a-a60e-044cf56dcf6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:32.937834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e5f2-61a7-4a0a-a60e-044cf56dcf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:32.938197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e5f2-61a7-4a0a-a60e-044cf56dcf6d admin admin] PATH_INFO: `/v3/users/f052cf5d72114e6e8ca9f8a604d6a6a3` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:32.939360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70e5f2-61a7-4a0a-a60e-044cf56dcf6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f052cf5d72114e6e8ca9f8a604d6a6a3)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:32.941480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70e5f2-61a7-4a0a-a60e-044cf56dcf6d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:32.954097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78be03-20db-4d3a-93e9-4f223bf4707e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:32.961534 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:32.962418 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:32.962800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:32.963110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] PATH_INFO: `/v3/projects/a2dec42b35d44d54ae9b45371d8eb4ab` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:32.964406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2dec42b35d44d54ae9b45371d8eb4ab)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:32.966408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:32.969171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:33.179014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-8f70e5f2-61a7-4a0a-a60e-044cf56dcf6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f052cf5d72114e6e8ca9f8a604d6a6a3'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:33.179680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-8f70e5f2-61a7-4a0a-a60e-044cf56dcf6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f052cf5d72114e6e8ca9f8a604d6a6a3'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:33.179802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2dec42b35d44d54ae9b45371d8eb4ab', 'request_id': 'req-d45bf0ac-6ad7-459a-a0a7-cc299def5333'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:33.192556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-8f70e5f2-61a7-4a0a-a60e-044cf56dcf6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f052cf5d72114e6e8ca9f8a604d6a6a3'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:33.256296 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2dec42b35d44d54ae9b45371d8eb4ab', 'request_id': 'req-d45bf0ac-6ad7-459a-a0a7-cc299def5333'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:33.262424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2dec42b35d44d54ae9b45371d8eb4ab', 'request_id': 'req-d45bf0ac-6ad7-459a-a0a7-cc299def5333'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:33.274199 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] The token cache is being invalidate because project a2dec42b35d44d54ae9b45371d8eb4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:33.274512 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:33.275137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d45bf0ac-6ad7-459a-a0a7-cc299def5333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:33.276845 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1202/2402] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:32 2022] DELETE /identity/v3/projects/a2dec42b35d44d54ae9b45371d8eb4ab => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:53:33.282287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb9003-f157-42dd-8104-cdd9e14f2b59 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:33.282601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb9003-f157-42dd-8104-cdd9e14f2b59 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:33.282880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb9003-f157-42dd-8104-cdd9e14f2b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:33.301083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-48bb9003-f157-42dd-8104-cdd9e14f2b59 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:33.302283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-48bb9003-f157-42dd-8104-cdd9e14f2b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:33.310819 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-8f70e5f2-61a7-4a0a-a60e-044cf56dcf6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f052cf5d72114e6e8ca9f8a604d6a6a3'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:33.315327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:33.319045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-8f70e5f2-61a7-4a0a-a60e-044cf56dcf6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f052cf5d72114e6e8ca9f8a604d6a6a3'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:33.325300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1201/2403] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:32 2022] DELETE /identity/v3/users/f052cf5d72114e6e8ca9f8a604d6a6a3 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:33.330144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4919a-7c2f-4dbc-afba-a3c1aaafa353 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:33.330462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4919a-7c2f-4dbc-afba-a3c1aaafa353 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:33.330744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4919a-7c2f-4dbc-afba-a3c1aaafa353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:33.347569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-8dd4919a-7c2f-4dbc-afba-a3c1aaafa353 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:33.348908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8dd4919a-7c2f-4dbc-afba-a3c1aaafa353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:33.363511 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1203/2404] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:33.371033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b96f-fe9c-4a10-8c77-1f3ccd2f83de None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:33.371321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b96f-fe9c-4a10-8c77-1f3ccd2f83de None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:33.371616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b96f-fe9c-4a10-8c77-1f3ccd2f83de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:33.390261 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e605b96f-fe9c-4a10-8c77-1f3ccd2f83de None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:33.391860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e605b96f-fe9c-4a10-8c77-1f3ccd2f83de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:33.410857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1202/2405] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:33.420611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4919a-7c2f-4dbc-afba-a3c1aaafa353 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:33.421956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8dd4919a-7c2f-4dbc-afba-a3c1aaafa353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:33.451994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1204/2406] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:33.456563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605b96f-fe9c-4a10-8c77-1f3ccd2f83de None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:33.465206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605b96f-fe9c-4a10-8c77-1f3ccd2f83de None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:33.469975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c2bcd-a241-4759-ae81-55db22f68d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:33.470650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2bcd-a241-4759-ae81-55db22f68d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:33.471054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2bcd-a241-4759-ae81-55db22f68d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:33.471331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2bcd-a241-4759-ae81-55db22f68d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:33.472056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c2bcd-a241-4759-ae81-55db22f68d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:53:33.472363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c2bcd-a241-4759-ae81-55db22f68d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:33.473982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c2bcd-a241-4759-ae81-55db22f68d97 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:33.480219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4919a-7c2f-4dbc-afba-a3c1aaafa353 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:33.484479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49577b-f710-4457-b12f-7dcc588cc9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:33.485134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49577b-f710-4457-b12f-7dcc588cc9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:33.485414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49577b-f710-4457-b12f-7dcc588cc9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:33.485689 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49577b-f710-4457-b12f-7dcc588cc9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:33.486896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1205/2407] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:53:33.491086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c2bcd-a241-4759-ae81-55db22f68d97 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:33.495045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49577b-f710-4457-b12f-7dcc588cc9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:33.496466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49577b-f710-4457-b12f-7dcc588cc9f8 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:33.501366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c2bcd-a241-4759-ae81-55db22f68d97 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:33.506001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad0d7-5339-4862-9fb1-82cf59ed3cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:33.506714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad0d7-5339-4862-9fb1-82cf59ed3cca admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:33.506951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad0d7-5339-4862-9fb1-82cf59ed3cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:33.507084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1203/2408] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:33.507209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad0d7-5339-4862-9fb1-82cf59ed3cca admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:33.507886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ad0d7-5339-4862-9fb1-82cf59ed3cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:33.509872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ad0d7-5339-4862-9fb1-82cf59ed3cca admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:33.589620 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1206/2409] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:33 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:33.593651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49577b-f710-4457-b12f-7dcc588cc9f8 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:33.603853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49577b-f710-4457-b12f-7dcc588cc9f8 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:33.646107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:33.662469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e42a4-13d9-4e8e-a286-3b9c9ae3f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:33.663154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e42a4-13d9-4e8e-a286-3b9c9ae3f662 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:33.663519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e42a4-13d9-4e8e-a286-3b9c9ae3f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:33.663730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e42a4-13d9-4e8e-a286-3b9c9ae3f662 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:33.664620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e42a4-13d9-4e8e-a286-3b9c9ae3f662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:33.666592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e42a4-13d9-4e8e-a286-3b9c9ae3f662 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:33.771826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1204/2410] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:33 2022] POST /identity/v3/users => generated 284 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:33.774738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad0d7-5339-4862-9fb1-82cf59ed3cca admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:33.785705 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad0d7-5339-4862-9fb1-82cf59ed3cca admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:33.790687 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67543eb-66c6-4c39-9431-1bacdcaf015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:33.791375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67543eb-66c6-4c39-9431-1bacdcaf015c admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:33.791693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67543eb-66c6-4c39-9431-1bacdcaf015c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:33.791975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67543eb-66c6-4c39-9431-1bacdcaf015c admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:33.792710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67543eb-66c6-4c39-9431-1bacdcaf015c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:33.794336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67543eb-66c6-4c39-9431-1bacdcaf015c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:33.805405 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1207/2411] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:33.809349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e42a4-13d9-4e8e-a286-3b9c9ae3f662 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:33.820574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e42a4-13d9-4e8e-a286-3b9c9ae3f662 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:33.825562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9a15-69a8-429c-9ff6-c3c21698c647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:33.826260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9a15-69a8-429c-9ff6-c3c21698c647 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:33.826566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9a15-69a8-429c-9ff6-c3c21698c647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:33.826841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9a15-69a8-429c-9ff6-c3c21698c647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:33.827571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e9a15-69a8-429c-9ff6-c3c21698c647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:33.829320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e9a15-69a8-429c-9ff6-c3c21698c647 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:33.839207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1205/2412] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:33.843651 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67543eb-66c6-4c39-9431-1bacdcaf015c admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:33.853983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67543eb-66c6-4c39-9431-1bacdcaf015c admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:33.859536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa168e36-06f1-407d-be20-80f9fb447c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:33.860431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa168e36-06f1-407d-be20-80f9fb447c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:33.860716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa168e36-06f1-407d-be20-80f9fb447c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:33.860992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa168e36-06f1-407d-be20-80f9fb447c99 admin admin] PATH_INFO: `/v3/projects/bc9c0171ea2149a9a0a44f87c74cf23b/users/de3593a3287445579c5508162ac6781f/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:33.877455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa168e36-06f1-407d-be20-80f9fb447c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9c0171ea2149a9a0a44f87c74cf23b, user_id=de3593a3287445579c5508162ac6781f, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:33.880181 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa168e36-06f1-407d-be20-80f9fb447c99 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:33.969144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9a15-69a8-429c-9ff6-c3c21698c647 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:33.970593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1208/2413] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:33 2022] PUT /identity/v3/projects/bc9c0171ea2149a9a0a44f87c74cf23b/users/de3593a3287445579c5508162ac6781f/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:33.971445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0a7e9a15-69a8-429c-9ff6-c3c21698c647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:33.988750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b720-d928-43dc-b4d4-602bab9c67bf None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:33.989041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b720-d928-43dc-b4d4-602bab9c67bf None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:33.989313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b720-d928-43dc-b4d4-602bab9c67bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:33.992771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9a15-69a8-429c-9ff6-c3c21698c647 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.025963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e2e1b720-d928-43dc-b4d4-602bab9c67bf None None] MFA Rules not processed for user `de3593a3287445579c5508162ac6781f`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:34.027197 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e2e1b720-d928-43dc-b4d4-602bab9c67bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:34.051618 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.054389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.054389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.054389 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] PATH_INFO: `/v3/projects/f4fe73625fb341c594c7e7cf2144d977` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.054756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4fe73625fb341c594c7e7cf2144d977)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.056585 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.067985 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:34.093319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1209/2414] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:34.097827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1b720-d928-43dc-b4d4-602bab9c67bf None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.108660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1b720-d928-43dc-b4d4-602bab9c67bf None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.113243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4fd25-c267-4f24-8968-e9488f591d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.113879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4fd25-c267-4f24-8968-e9488f591d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.114167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4fd25-c267-4f24-8968-e9488f591d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.114510 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4fd25-c267-4f24-8968-e9488f591d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.115197 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4fd25-c267-4f24-8968-e9488f591d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.117121 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4fd25-c267-4f24-8968-e9488f591d92 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.165485 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4fe73625fb341c594c7e7cf2144d977', 'request_id': 'req-d941822e-c0c6-4fbb-8064-110f8103a4a2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:34.242675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1210/2415] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:34 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:34.245197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4fe73625fb341c594c7e7cf2144d977', 'request_id': 'req-d941822e-c0c6-4fbb-8064-110f8103a4a2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:34.246880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4fd25-c267-4f24-8968-e9488f591d92 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.253233 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4fe73625fb341c594c7e7cf2144d977', 'request_id': 'req-d941822e-c0c6-4fbb-8064-110f8103a4a2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:34.264233 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] The token cache is being invalidate because project f4fe73625fb341c594c7e7cf2144d977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:34.264560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:34.265213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d941822e-c0c6-4fbb-8064-110f8103a4a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:34.266867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1206/2416] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:33 2022] DELETE /identity/v3/projects/f4fe73625fb341c594c7e7cf2144d977 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:53:34.271616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f19e-c023-47c5-9cbb-0f3d636c731a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.272104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f19e-c023-47c5-9cbb-0f3d636c731a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.272382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f19e-c023-47c5-9cbb-0f3d636c731a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.293119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-af63f19e-c023-47c5-9cbb-0f3d636c731a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:34.294386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-af63f19e-c023-47c5-9cbb-0f3d636c731a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:34.310865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4fd25-c267-4f24-8968-e9488f591d92 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.315541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4984e-fd9e-433d-b0c9-4ae36f07f939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.316203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4984e-fd9e-433d-b0c9-4ae36f07f939 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.316487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4984e-fd9e-433d-b0c9-4ae36f07f939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.316760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4984e-fd9e-433d-b0c9-4ae36f07f939 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.317439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4984e-fd9e-433d-b0c9-4ae36f07f939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.319382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4984e-fd9e-433d-b0c9-4ae36f07f939 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.340264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:34.354792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1207/2417] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:34.362616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fddba9-dc84-445b-938f-a9219977dee6 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.362907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fddba9-dc84-445b-938f-a9219977dee6 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.363189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fddba9-dc84-445b-938f-a9219977dee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.380674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a6fddba9-dc84-445b-938f-a9219977dee6 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:34.381875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a6fddba9-dc84-445b-938f-a9219977dee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:34.390387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1208/2418] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:34.394286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fddba9-dc84-445b-938f-a9219977dee6 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.402886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fddba9-dc84-445b-938f-a9219977dee6 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.408392 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b7a22-9d64-418c-a882-64df0a5c6334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.409015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1211/2419] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:34 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:34.409137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b7a22-9d64-418c-a882-64df0a5c6334 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.409296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b7a22-9d64-418c-a882-64df0a5c6334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.409572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b7a22-9d64-418c-a882-64df0a5c6334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.410322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b7a22-9d64-418c-a882-64df0a5c6334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:53:34.410637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b7a22-9d64-418c-a882-64df0a5c6334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.412240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b7a22-9d64-418c-a882-64df0a5c6334 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.412684 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4984e-fd9e-433d-b0c9-4ae36f07f939 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.414318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f5e4984e-fd9e-433d-b0c9-4ae36f07f939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:34.427354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1209/2420] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:53:34.429605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4984e-fd9e-433d-b0c9-4ae36f07f939 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.432480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b7a22-9d64-418c-a882-64df0a5c6334 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.433086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0927d1-30ee-4b15-8d0d-f3638c4a11d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.433876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0927d1-30ee-4b15-8d0d-f3638c4a11d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.434308 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0927d1-30ee-4b15-8d0d-f3638c4a11d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.434612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0927d1-30ee-4b15-8d0d-f3638c4a11d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.435481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0927d1-30ee-4b15-8d0d-f3638c4a11d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.437097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0927d1-30ee-4b15-8d0d-f3638c4a11d0 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.441930 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b7a22-9d64-418c-a882-64df0a5c6334 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.446627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01b97-a311-4681-9b64-2abe93656bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.447259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01b97-a311-4681-9b64-2abe93656bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.451482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1212/2421] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:34.451652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01b97-a311-4681-9b64-2abe93656bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.451652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01b97-a311-4681-9b64-2abe93656bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.451652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba01b97-a311-4681-9b64-2abe93656bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.451652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba01b97-a311-4681-9b64-2abe93656bd9 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.453103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0927d1-30ee-4b15-8d0d-f3638c4a11d0 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.462912 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0927d1-30ee-4b15-8d0d-f3638c4a11d0 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.468313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150fbdc-1fce-45ff-99c2-0e974a22a66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.469801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150fbdc-1fce-45ff-99c2-0e974a22a66e admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.469801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150fbdc-1fce-45ff-99c2-0e974a22a66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.469801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150fbdc-1fce-45ff-99c2-0e974a22a66e admin admin] PATH_INFO: `/v3/projects/e560c3bc49264ba1b37acb3b3e9b3651/users/1267879f4e484a3a9cda3384d73affb2/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.484372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150fbdc-1fce-45ff-99c2-0e974a22a66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e560c3bc49264ba1b37acb3b3e9b3651, user_id=1267879f4e484a3a9cda3384d73affb2, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.487072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150fbdc-1fce-45ff-99c2-0e974a22a66e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.528723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1210/2422] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:34 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:34.533443 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01b97-a311-4681-9b64-2abe93656bd9 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.550176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1213/2423] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:34 2022] PUT /identity/v3/projects/e560c3bc49264ba1b37acb3b3e9b3651/users/1267879f4e484a3a9cda3384d73affb2/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:34.553960 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150fbdc-1fce-45ff-99c2-0e974a22a66e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.594790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01b97-a311-4681-9b64-2abe93656bd9 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.616284 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150fbdc-1fce-45ff-99c2-0e974a22a66e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.620978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3287-a43a-4367-b7ab-f2aeef1ea89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.621649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3287-a43a-4367-b7ab-f2aeef1ea89b admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.621937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3287-a43a-4367-b7ab-f2aeef1ea89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.622216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3287-a43a-4367-b7ab-f2aeef1ea89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.623477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f3287-a43a-4367-b7ab-f2aeef1ea89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.625076 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f3287-a43a-4367-b7ab-f2aeef1ea89b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.634933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1214/2424] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:34.639408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3287-a43a-4367-b7ab-f2aeef1ea89b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.648655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3287-a43a-4367-b7ab-f2aeef1ea89b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.651330 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3df09c-4d9e-4b2f-97d8-5e05fb17992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.652004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3df09c-4d9e-4b2f-97d8-5e05fb17992f admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.652288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3df09c-4d9e-4b2f-97d8-5e05fb17992f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.652567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3df09c-4d9e-4b2f-97d8-5e05fb17992f admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.653254 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3df09c-4d9e-4b2f-97d8-5e05fb17992f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.653361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427abb-3195-49e3-bbcc-0070587e15b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.654703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427abb-3195-49e3-bbcc-0070587e15b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.654986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427abb-3195-49e3-bbcc-0070587e15b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.655261 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427abb-3195-49e3-bbcc-0070587e15b0 admin admin] PATH_INFO: `/v3/projects/e560c3bc49264ba1b37acb3b3e9b3651/users/1267879f4e484a3a9cda3384d73affb2/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.655731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3df09c-4d9e-4b2f-97d8-5e05fb17992f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.657247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f427abb-3195-49e3-bbcc-0070587e15b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e560c3bc49264ba1b37acb3b3e9b3651, user_id=1267879f4e484a3a9cda3384d73affb2, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.659892 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f427abb-3195-49e3-bbcc-0070587e15b0 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.663341 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:34.671605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1215/2425] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:34 2022] PUT /identity/v3/projects/e560c3bc49264ba1b37acb3b3e9b3651/users/1267879f4e484a3a9cda3384d73affb2/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:53:34.682636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2e90-ab29-4a93-8c02-a1fe4ba86236 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.682924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2e90-ab29-4a93-8c02-a1fe4ba86236 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.683203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2e90-ab29-4a93-8c02-a1fe4ba86236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.708639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a80d2e90-ab29-4a93-8c02-a1fe4ba86236 None None] MFA Rules not processed for user `1267879f4e484a3a9cda3384d73affb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:34.709831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a80d2e90-ab29-4a93-8c02-a1fe4ba86236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:34.751290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1211/2426] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:34 2022] POST /identity/v3/users => generated 282 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:34.752371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3df09c-4d9e-4b2f-97d8-5e05fb17992f admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.762552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3df09c-4d9e-4b2f-97d8-5e05fb17992f admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.783584 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1216/2427] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:34.795957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d2e90-ab29-4a93-8c02-a1fe4ba86236 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.797399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a80d2e90-ab29-4a93-8c02-a1fe4ba86236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:34.817072 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:34.829186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532f484-2692-4b62-bfa5-62599f05617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.830108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532f484-2692-4b62-bfa5-62599f05617e admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.830427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532f484-2692-4b62-bfa5-62599f05617e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.830711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532f484-2692-4b62-bfa5-62599f05617e admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.831449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532f484-2692-4b62-bfa5-62599f05617e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.833051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532f484-2692-4b62-bfa5-62599f05617e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.844021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1212/2428] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:34.847876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532f484-2692-4b62-bfa5-62599f05617e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.858171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532f484-2692-4b62-bfa5-62599f05617e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.863693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5cb21-718e-4297-b33e-45da398cec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.864531 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5cb21-718e-4297-b33e-45da398cec9c admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.864883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5cb21-718e-4297-b33e-45da398cec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.865229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5cb21-718e-4297-b33e-45da398cec9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.865375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d2e90-ab29-4a93-8c02-a1fe4ba86236 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.866093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5cb21-718e-4297-b33e-45da398cec9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.867829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5cb21-718e-4297-b33e-45da398cec9c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.869568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced506e5-249b-4829-8ec5-d3cd3cdfbc45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.870226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced506e5-249b-4829-8ec5-d3cd3cdfbc45 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.870549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced506e5-249b-4829-8ec5-d3cd3cdfbc45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.870886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced506e5-249b-4829-8ec5-d3cd3cdfbc45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.882441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1213/2429] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:34.884078 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5cb21-718e-4297-b33e-45da398cec9c admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:34.890760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced506e5-249b-4829-8ec5-d3cd3cdfbc45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.892182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced506e5-249b-4829-8ec5-d3cd3cdfbc45 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.894414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5cb21-718e-4297-b33e-45da398cec9c admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:34.899747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aae85-2151-44a7-942c-2fc0e317272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:34.904628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aae85-2151-44a7-942c-2fc0e317272f admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.904628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aae85-2151-44a7-942c-2fc0e317272f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.904628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aae85-2151-44a7-942c-2fc0e317272f admin admin] PATH_INFO: `/v3/projects/3d787b0195414e3292de34e184ac6a5c/users/4e7b8d4a672a4433898c359ecd3affa5/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:34.922576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aae85-2151-44a7-942c-2fc0e317272f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d787b0195414e3292de34e184ac6a5c, user_id=4e7b8d4a672a4433898c359ecd3affa5, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:34.925300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aae85-2151-44a7-942c-2fc0e317272f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:34.928887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1217/2430] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:34.980757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1214/2431] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:34 2022] PUT /identity/v3/projects/3d787b0195414e3292de34e184ac6a5c/users/4e7b8d4a672a4433898c359ecd3affa5/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:34.991652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ec193-4299-4b49-b5be-7d570f4f4125 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:34.992095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ec193-4299-4b49-b5be-7d570f4f4125 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:34.992298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ec193-4299-4b49-b5be-7d570f4f4125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:35.024378 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-559ec193-4299-4b49-b5be-7d570f4f4125 None None] MFA Rules not processed for user `4e7b8d4a672a4433898c359ecd3affa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:35.025728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-559ec193-4299-4b49-b5be-7d570f4f4125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:35.091496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1218/2432] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:35.096645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aae85-2151-44a7-942c-2fc0e317272f admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:35.160842 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aae85-2151-44a7-942c-2fc0e317272f admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:35.165556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79d601-bf34-428b-bfdd-a2e352701989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:35.166187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79d601-bf34-428b-bfdd-a2e352701989 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:35.166501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79d601-bf34-428b-bfdd-a2e352701989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:35.166776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79d601-bf34-428b-bfdd-a2e352701989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:35.167501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79d601-bf34-428b-bfdd-a2e352701989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:35.169511 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79d601-bf34-428b-bfdd-a2e352701989 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:35.315672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1215/2433] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:35 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:35.321409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ec193-4299-4b49-b5be-7d570f4f4125 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:35.333355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ec193-4299-4b49-b5be-7d570f4f4125 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:35.343047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:35.391421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c5181-801f-445d-9860-44b133c518cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:35.392128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5181-801f-445d-9860-44b133c518cc admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:35.392414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5181-801f-445d-9860-44b133c518cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:35.392694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5181-801f-445d-9860-44b133c518cc admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:35.393402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c5181-801f-445d-9860-44b133c518cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:35.395463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c5181-801f-445d-9860-44b133c518cc admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:35.481629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1219/2434] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:35 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:35.485622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79d601-bf34-428b-bfdd-a2e352701989 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:35.496061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79d601-bf34-428b-bfdd-a2e352701989 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:35.501351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8334c5f-4a55-4ac2-8e32-30c5f536530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:35.502008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334c5f-4a55-4ac2-8e32-30c5f536530d admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:35.502328 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334c5f-4a55-4ac2-8e32-30c5f536530d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:35.502639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334c5f-4a55-4ac2-8e32-30c5f536530d admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:35.503451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8334c5f-4a55-4ac2-8e32-30c5f536530d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:35.505053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8334c5f-4a55-4ac2-8e32-30c5f536530d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:35.518947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1216/2435] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:35.520614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c5181-801f-445d-9860-44b133c518cc admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:35.530727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c5181-801f-445d-9860-44b133c518cc admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:35.535861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7579cc-9909-4857-9de3-bb7115743f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:35.536749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7579cc-9909-4857-9de3-bb7115743f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:35.537144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7579cc-9909-4857-9de3-bb7115743f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:35.537421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7579cc-9909-4857-9de3-bb7115743f67 admin admin] PATH_INFO: `/v3/projects/13a20665ef554743841e70469c1442dc/users/048af660b9c44c2e9a4d80cce26791f2/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:35.552426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7579cc-9909-4857-9de3-bb7115743f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a20665ef554743841e70469c1442dc, user_id=048af660b9c44c2e9a4d80cce26791f2, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:35.555242 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7579cc-9909-4857-9de3-bb7115743f67 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:35.677227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1220/2436] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:35 2022] PUT /identity/v3/projects/13a20665ef554743841e70469c1442dc/users/048af660b9c44c2e9a4d80cce26791f2/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:35.681302 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8334c5f-4a55-4ac2-8e32-30c5f536530d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:35.692032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8334c5f-4a55-4ac2-8e32-30c5f536530d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:35.751741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0218a8-ad31-44cc-bc24-8ae8ea51032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:35.752413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0218a8-ad31-44cc-bc24-8ae8ea51032c admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:35.752701 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0218a8-ad31-44cc-bc24-8ae8ea51032c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:35.752980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0218a8-ad31-44cc-bc24-8ae8ea51032c admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:35.756556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0218a8-ad31-44cc-bc24-8ae8ea51032c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:35.756556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0218a8-ad31-44cc-bc24-8ae8ea51032c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:35.765212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1217/2437] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:35.769665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7579cc-9909-4857-9de3-bb7115743f67 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:35.781829 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7579cc-9909-4857-9de3-bb7115743f67 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:35.786586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733893c-3102-4ac8-84bd-9e53f2f0bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:35.787580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733893c-3102-4ac8-84bd-9e53f2f0bfd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:35.787738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733893c-3102-4ac8-84bd-9e53f2f0bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:35.788015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733893c-3102-4ac8-84bd-9e53f2f0bfd9 admin admin] PATH_INFO: `/v3/projects/13a20665ef554743841e70469c1442dc/users/048af660b9c44c2e9a4d80cce26791f2/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:35.790323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733893c-3102-4ac8-84bd-9e53f2f0bfd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a20665ef554743841e70469c1442dc, user_id=048af660b9c44c2e9a4d80cce26791f2, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:35.793354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733893c-3102-4ac8-84bd-9e53f2f0bfd9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:35.804134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1221/2438] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:35 2022] PUT /identity/v3/projects/13a20665ef554743841e70469c1442dc/users/048af660b9c44c2e9a4d80cce26791f2/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:35.816690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e2b8f-cd72-40e1-be5e-229bffd5460d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:35.816989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e2b8f-cd72-40e1-be5e-229bffd5460d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:35.817272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e2b8f-cd72-40e1-be5e-229bffd5460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:35.843728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a03e2b8f-cd72-40e1-be5e-229bffd5460d None None] MFA Rules not processed for user `048af660b9c44c2e9a4d80cce26791f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:35.844935 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a03e2b8f-cd72-40e1-be5e-229bffd5460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:35.849929 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:35.917398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1218/2439] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:35.937815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733893c-3102-4ac8-84bd-9e53f2f0bfd9 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:35.939642 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-1733893c-3102-4ac8-84bd-9e53f2f0bfd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:36.005809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733893c-3102-4ac8-84bd-9e53f2f0bfd9 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:36.009498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280da10-c97f-4017-adfa-7407303b7834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:36.010194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280da10-c97f-4017-adfa-7407303b7834 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:36.010536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280da10-c97f-4017-adfa-7407303b7834 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:36.010801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280da10-c97f-4017-adfa-7407303b7834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:36.020814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280da10-c97f-4017-adfa-7407303b7834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:36.022378 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280da10-c97f-4017-adfa-7407303b7834 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:36.032313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1222/2440] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:36.386966 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e2b8f-cd72-40e1-be5e-229bffd5460d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:36.396975 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e2b8f-cd72-40e1-be5e-229bffd5460d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:36.400248 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e56adc-580c-4b8c-8126-103e551bbe39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:36.401056 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e56adc-580c-4b8c-8126-103e551bbe39 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:36.401386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e56adc-580c-4b8c-8126-103e551bbe39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:36.401665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e56adc-580c-4b8c-8126-103e551bbe39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:36.463718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e56adc-580c-4b8c-8126-103e551bbe39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:36.465484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e56adc-580c-4b8c-8126-103e551bbe39 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:36.475839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1219/2441] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:36 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:38.728097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280da10-c97f-4017-adfa-7407303b7834 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:38.812245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280da10-c97f-4017-adfa-7407303b7834 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:38.817665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:38.818629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:38.818915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:38.819463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] PATH_INFO: `/v3/users/de3593a3287445579c5508162ac6781f` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:38.820822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3593a3287445579c5508162ac6781f)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:38.823189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:38.836984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:39.050427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3593a3287445579c5508162ac6781f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:39.051115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3593a3287445579c5508162ac6781f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:39.113203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3593a3287445579c5508162ac6781f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:39.134380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3593a3287445579c5508162ac6781f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:39.146652 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3593a3287445579c5508162ac6781f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:39.159182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1223/2442] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:38 2022] DELETE /identity/v3/users/de3593a3287445579c5508162ac6781f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:39.159379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd401f-cf90-4306-8565-98c220aa6704 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:39.159379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd401f-cf90-4306-8565-98c220aa6704 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:39.159379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd401f-cf90-4306-8565-98c220aa6704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:39.176809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a0cd401f-cf90-4306-8565-98c220aa6704 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:39.178064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a0cd401f-cf90-4306-8565-98c220aa6704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:39.239040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1220/2443] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:39.249174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:39.250663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:39.308342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf330f-0a4f-4ec4-bec4-3a15c3c7228c admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:39.312437 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e1dee-2cee-422b-a9f3-336f03f6b69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:39.313063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1dee-2cee-422b-a9f3-336f03f6b69b service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:39.313340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1dee-2cee-422b-a9f3-336f03f6b69b service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:39.313614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1dee-2cee-422b-a9f3-336f03f6b69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:39.322526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e1dee-2cee-422b-a9f3-336f03f6b69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:39.323919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e1dee-2cee-422b-a9f3-336f03f6b69b service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:39.334641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1224/2444] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:53:39.755477 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd401f-cf90-4306-8565-98c220aa6704 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:39.756898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a0cd401f-cf90-4306-8565-98c220aa6704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:39.770173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd401f-cf90-4306-8565-98c220aa6704 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:39.775185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:39.778741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:39.780462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:39.780462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] PATH_INFO: `/v3/projects/bc9c0171ea2149a9a0a44f87c74cf23b` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:39.780806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9c0171ea2149a9a0a44f87c74cf23b)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:39.784190 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:39.894732 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:39.904293 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9c0171ea2149a9a0a44f87c74cf23b', 'request_id': 'req-11861fa1-eec7-4d73-a39b-0dcca3224075'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:39.993863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9c0171ea2149a9a0a44f87c74cf23b', 'request_id': 'req-11861fa1-eec7-4d73-a39b-0dcca3224075'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:40.002625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9c0171ea2149a9a0a44f87c74cf23b', 'request_id': 'req-11861fa1-eec7-4d73-a39b-0dcca3224075'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:40.014683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] The token cache is being invalidate because project bc9c0171ea2149a9a0a44f87c74cf23b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:40.015182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:40.016469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:40.018635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1221/2445] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:39 2022] DELETE /identity/v3/projects/bc9c0171ea2149a9a0a44f87c74cf23b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:53:40.022746 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e1dee-2cee-422b-a9f3-336f03f6b69b service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:40.033299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e1dee-2cee-422b-a9f3-336f03f6b69b service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:40.088327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436206dc-4234-47e8-b150-c33582c295d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:40.089248 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436206dc-4234-47e8-b150-c33582c295d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:40.089536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436206dc-4234-47e8-b150-c33582c295d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:40.089806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436206dc-4234-47e8-b150-c33582c295d2 admin admin] PATH_INFO: `/v3/users/1267879f4e484a3a9cda3384d73affb2` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:40.091011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436206dc-4234-47e8-b150-c33582c295d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1267879f4e484a3a9cda3384d73affb2)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:40.093477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436206dc-4234-47e8-b150-c33582c295d2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:40.283424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:40.296252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-436206dc-4234-47e8-b150-c33582c295d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1267879f4e484a3a9cda3384d73affb2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:40.296912 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-436206dc-4234-47e8-b150-c33582c295d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1267879f4e484a3a9cda3384d73affb2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:40.384243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-436206dc-4234-47e8-b150-c33582c295d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1267879f4e484a3a9cda3384d73affb2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:40.398077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-436206dc-4234-47e8-b150-c33582c295d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1267879f4e484a3a9cda3384d73affb2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:40.406866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-436206dc-4234-47e8-b150-c33582c295d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1267879f4e484a3a9cda3384d73affb2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:40.414706 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1225/2446] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:40 2022] DELETE /identity/v3/users/1267879f4e484a3a9cda3384d73affb2 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:53:40.898188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:40.899779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:40.918551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11861fa1-eec7-4d73-a39b-0dcca3224075 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:40.985713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:40.986618 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:40.986932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:40.987219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] PATH_INFO: `/v3/projects/e560c3bc49264ba1b37acb3b3e9b3651` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:40.988559 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e560c3bc49264ba1b37acb3b3e9b3651)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:40.990659 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:41.114763 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e560c3bc49264ba1b37acb3b3e9b3651', 'request_id': 'req-b8ac7315-36aa-42b1-9546-d3d13345d128'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:41.187901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e560c3bc49264ba1b37acb3b3e9b3651', 'request_id': 'req-b8ac7315-36aa-42b1-9546-d3d13345d128'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:41.194671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e560c3bc49264ba1b37acb3b3e9b3651', 'request_id': 'req-b8ac7315-36aa-42b1-9546-d3d13345d128'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:41.205279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] The token cache is being invalidate because project e560c3bc49264ba1b37acb3b3e9b3651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:41.205573 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:41.206210 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-b8ac7315-36aa-42b1-9546-d3d13345d128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:41.207788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1222/2447] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:40 2022] DELETE /identity/v3/projects/e560c3bc49264ba1b37acb3b3e9b3651 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:41.212742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f9c7-30c3-471a-9519-b753113548e8 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:41.213199 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f9c7-30c3-471a-9519-b753113548e8 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:41.213291 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f9c7-30c3-471a-9519-b753113548e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:41.233141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-7f04f9c7-30c3-471a-9519-b753113548e8 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:41.234478 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-7f04f9c7-30c3-471a-9519-b753113548e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:41.296364 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1226/2448] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:41.303962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18172828-04c4-4c9d-833c-e746434e3f78 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:41.304262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18172828-04c4-4c9d-833c-e746434e3f78 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:41.304571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18172828-04c4-4c9d-833c-e746434e3f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:41.323390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-18172828-04c4-4c9d-833c-e746434e3f78 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:41.324599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-18172828-04c4-4c9d-833c-e746434e3f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:41.332785 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1223/2449] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:41.336846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f9c7-30c3-471a-9519-b753113548e8 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:41.346648 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f9c7-30c3-471a-9519-b753113548e8 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:41.351335 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8818-2206-4543-9ebf-f1cecfc66e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:41.352020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8818-2206-4543-9ebf-f1cecfc66e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:41.352311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8818-2206-4543-9ebf-f1cecfc66e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:41.360173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8818-2206-4543-9ebf-f1cecfc66e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:41.360173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc8818-2206-4543-9ebf-f1cecfc66e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:53:41.360173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc8818-2206-4543-9ebf-f1cecfc66e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:41.360173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc8818-2206-4543-9ebf-f1cecfc66e8e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:41.367818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1227/2450] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:53:41.372217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18172828-04c4-4c9d-833c-e746434e3f78 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:41.382418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18172828-04c4-4c9d-833c-e746434e3f78 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:41.387141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408203e-eb77-4dc2-b38d-85daf6e2c53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:41.387821 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408203e-eb77-4dc2-b38d-85daf6e2c53a admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:41.388108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408203e-eb77-4dc2-b38d-85daf6e2c53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:41.388380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408203e-eb77-4dc2-b38d-85daf6e2c53a admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:41.389077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408203e-eb77-4dc2-b38d-85daf6e2c53a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:41.391014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408203e-eb77-4dc2-b38d-85daf6e2c53a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:41.497131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1224/2451] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:41 2022] POST /identity/v3/projects => generated 393 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:41.507053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8818-2206-4543-9ebf-f1cecfc66e8e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:41.519198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8818-2206-4543-9ebf-f1cecfc66e8e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:41.577210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae74c7-fea4-4ca6-9f7d-ef4d46b86ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:41.577855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae74c7-fea4-4ca6-9f7d-ef4d46b86ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:41.578140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae74c7-fea4-4ca6-9f7d-ef4d46b86ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:41.578457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae74c7-fea4-4ca6-9f7d-ef4d46b86ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:41.579149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae74c7-fea4-4ca6-9f7d-ef4d46b86ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:41.581064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae74c7-fea4-4ca6-9f7d-ef4d46b86ad6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:41.664687 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1228/2452] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:41 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:41.668672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408203e-eb77-4dc2-b38d-85daf6e2c53a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:41.679669 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408203e-eb77-4dc2-b38d-85daf6e2c53a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:41.684647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe04f5-5aee-4f2b-9ad2-f9f0757a547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:41.685331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe04f5-5aee-4f2b-9ad2-f9f0757a547c admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:41.685584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe04f5-5aee-4f2b-9ad2-f9f0757a547c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:41.685863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe04f5-5aee-4f2b-9ad2-f9f0757a547c admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:41.686642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe04f5-5aee-4f2b-9ad2-f9f0757a547c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:41.688265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe04f5-5aee-4f2b-9ad2-f9f0757a547c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:41.698865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1225/2453] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:41.703064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae74c7-fea4-4ca6-9f7d-ef4d46b86ad6 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:41.712951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae74c7-fea4-4ca6-9f7d-ef4d46b86ad6 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:41.718136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcc80e-b329-47fa-a45e-f8e8e4786289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:41.718814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcc80e-b329-47fa-a45e-f8e8e4786289 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:41.719101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcc80e-b329-47fa-a45e-f8e8e4786289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:41.719378 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcc80e-b329-47fa-a45e-f8e8e4786289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:41.720161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcc80e-b329-47fa-a45e-f8e8e4786289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:41.721743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcc80e-b329-47fa-a45e-f8e8e4786289 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:41.731568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1229/2454] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:41.736062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe04f5-5aee-4f2b-9ad2-f9f0757a547c admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:41.745818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe04f5-5aee-4f2b-9ad2-f9f0757a547c admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:41.750469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad897f6-8234-41dc-b86b-ae89c2d6bb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:41.751338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad897f6-8234-41dc-b86b-ae89c2d6bb4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:41.751621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad897f6-8234-41dc-b86b-ae89c2d6bb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:41.751901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad897f6-8234-41dc-b86b-ae89c2d6bb4b admin admin] PATH_INFO: `/v3/projects/cefd3e136e3744f8bfd328b9f6923ca4/users/ac24703aa735408c994e8edda0006f59/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:41.764229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:41.767264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad897f6-8234-41dc-b86b-ae89c2d6bb4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefd3e136e3744f8bfd328b9f6923ca4, user_id=ac24703aa735408c994e8edda0006f59, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:41.769912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad897f6-8234-41dc-b86b-ae89c2d6bb4b admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:41.859413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1226/2455] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:41 2022] PUT /identity/v3/projects/cefd3e136e3744f8bfd328b9f6923ca4/users/ac24703aa735408c994e8edda0006f59/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:41.876433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808183de-a62e-4c49-ad21-16070e662d1a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:41.876741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808183de-a62e-4c49-ad21-16070e662d1a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:41.877018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808183de-a62e-4c49-ad21-16070e662d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:41.903623 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-808183de-a62e-4c49-ad21-16070e662d1a None None] MFA Rules not processed for user `ac24703aa735408c994e8edda0006f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:41.905545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-808183de-a62e-4c49-ad21-16070e662d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:41.909610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:41.969334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1230/2456] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:41.973878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad897f6-8234-41dc-b86b-ae89c2d6bb4b admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:42.038776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad897f6-8234-41dc-b86b-ae89c2d6bb4b admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:42.043366 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f2d6d-cad0-4f64-9ce0-704feea35ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:42.044028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f2d6d-cad0-4f64-9ce0-704feea35ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:42.044311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f2d6d-cad0-4f64-9ce0-704feea35ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:42.044634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f2d6d-cad0-4f64-9ce0-704feea35ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:42.045332 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f2d6d-cad0-4f64-9ce0-704feea35ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:42.047268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f2d6d-cad0-4f64-9ce0-704feea35ba2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:42.166295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1227/2457] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:41 2022] POST /identity/v3/projects => generated 393 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:42.170586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808183de-a62e-4c49-ad21-16070e662d1a None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:42.181140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808183de-a62e-4c49-ad21-16070e662d1a None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:42.235996 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891978-5be2-4ee7-a028-41cb4fd8e49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:42.236656 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891978-5be2-4ee7-a028-41cb4fd8e49a admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:42.236936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891978-5be2-4ee7-a028-41cb4fd8e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:42.237212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891978-5be2-4ee7-a028-41cb4fd8e49a admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:42.237886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891978-5be2-4ee7-a028-41cb4fd8e49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:42.239807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891978-5be2-4ee7-a028-41cb4fd8e49a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:42.336255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1231/2458] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:42 2022] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:42.340258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f2d6d-cad0-4f64-9ce0-704feea35ba2 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:42.350576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f2d6d-cad0-4f64-9ce0-704feea35ba2 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:42.355495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774e08e-2d83-4cbf-8154-b5a0a3228112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:42.356182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e08e-2d83-4cbf-8154-b5a0a3228112 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:42.356489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e08e-2d83-4cbf-8154-b5a0a3228112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:42.356770 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e08e-2d83-4cbf-8154-b5a0a3228112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:42.357496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774e08e-2d83-4cbf-8154-b5a0a3228112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:42.359115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774e08e-2d83-4cbf-8154-b5a0a3228112 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:42.369495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1228/2459] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:42.374190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891978-5be2-4ee7-a028-41cb4fd8e49a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:42.384204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891978-5be2-4ee7-a028-41cb4fd8e49a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:42.389302 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881cc49-8a9e-4d15-b608-4fe994c4fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:42.390204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881cc49-8a9e-4d15-b608-4fe994c4fc7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:42.390518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881cc49-8a9e-4d15-b608-4fe994c4fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:42.390792 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881cc49-8a9e-4d15-b608-4fe994c4fc7d admin admin] PATH_INFO: `/v3/projects/7731dd16327c40eab0681b0deb235e37/users/7ad126bbbfca47a5a74864814a226add/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:42.405072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881cc49-8a9e-4d15-b608-4fe994c4fc7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7731dd16327c40eab0681b0deb235e37, user_id=7ad126bbbfca47a5a74864814a226add, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:42.407728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881cc49-8a9e-4d15-b608-4fe994c4fc7d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:42.473421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1232/2460] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:42 2022] PUT /identity/v3/projects/7731dd16327c40eab0681b0deb235e37/users/7ad126bbbfca47a5a74864814a226add/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:42.477379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774e08e-2d83-4cbf-8154-b5a0a3228112 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:42.488090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774e08e-2d83-4cbf-8154-b5a0a3228112 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:42.544201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad717e9-2113-42d1-9d20-d8503d75d8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:42.545384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad717e9-2113-42d1-9d20-d8503d75d8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:42.545662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad717e9-2113-42d1-9d20-d8503d75d8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:42.545932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad717e9-2113-42d1-9d20-d8503d75d8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:42.546681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad717e9-2113-42d1-9d20-d8503d75d8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:42.548249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad717e9-2113-42d1-9d20-d8503d75d8c3 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:42.558120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1229/2461] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:42.563136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881cc49-8a9e-4d15-b608-4fe994c4fc7d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:42.573824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881cc49-8a9e-4d15-b608-4fe994c4fc7d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:42.578724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4ec62-39fe-4c48-a1d0-07f3e352cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:42.580217 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ec62-39fe-4c48-a1d0-07f3e352cc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:42.580735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ec62-39fe-4c48-a1d0-07f3e352cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:42.582588 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ec62-39fe-4c48-a1d0-07f3e352cc5c admin admin] PATH_INFO: `/v3/projects/7731dd16327c40eab0681b0deb235e37/users/7ad126bbbfca47a5a74864814a226add/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:42.583448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4ec62-39fe-4c48-a1d0-07f3e352cc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7731dd16327c40eab0681b0deb235e37, user_id=7ad126bbbfca47a5a74864814a226add, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:42.587830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4ec62-39fe-4c48-a1d0-07f3e352cc5c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:42.599142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1233/2462] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:42 2022] PUT /identity/v3/projects/7731dd16327c40eab0681b0deb235e37/users/7ad126bbbfca47a5a74864814a226add/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:42.610934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf3f6-b638-4852-8dd7-88853fc6695c None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:42.611224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf3f6-b638-4852-8dd7-88853fc6695c None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:42.611500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf3f6-b638-4852-8dd7-88853fc6695c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:42.638742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-cd2cf3f6-b638-4852-8dd7-88853fc6695c None None] MFA Rules not processed for user `7ad126bbbfca47a5a74864814a226add`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:42.639969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-cd2cf3f6-b638-4852-8dd7-88853fc6695c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:42.686450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:42.706301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1230/2463] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:42.717424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4ec62-39fe-4c48-a1d0-07f3e352cc5c admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:42.719251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d2c4ec62-39fe-4c48-a1d0-07f3e352cc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:42.775532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4ec62-39fe-4c48-a1d0-07f3e352cc5c admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:42.779846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345408f-a593-4b70-8c1c-e67fdf0e3b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:42.780482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345408f-a593-4b70-8c1c-e67fdf0e3b3a service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:42.780768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345408f-a593-4b70-8c1c-e67fdf0e3b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:42.781046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345408f-a593-4b70-8c1c-e67fdf0e3b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:42.790307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345408f-a593-4b70-8c1c-e67fdf0e3b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:42.791726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345408f-a593-4b70-8c1c-e67fdf0e3b3a service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:42.796669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:42.801484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1234/2464] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:42.859081 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cf3f6-b638-4852-8dd7-88853fc6695c None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:42.860497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-cd2cf3f6-b638-4852-8dd7-88853fc6695c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:42.873225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cf3f6-b638-4852-8dd7-88853fc6695c None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:42.876943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837ca3-a708-4435-b2fe-341ba5f08cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:42.877590 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837ca3-a708-4435-b2fe-341ba5f08cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:42.877883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837ca3-a708-4435-b2fe-341ba5f08cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:42.878307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837ca3-a708-4435-b2fe-341ba5f08cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:42.936123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837ca3-a708-4435-b2fe-341ba5f08cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:42.937697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837ca3-a708-4435-b2fe-341ba5f08cb5 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:42.949688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1231/2465] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:45.056824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345408f-a593-4b70-8c1c-e67fdf0e3b3a service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:45.058347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e345408f-a593-4b70-8c1c-e67fdf0e3b3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:45.118458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345408f-a593-4b70-8c1c-e67fdf0e3b3a service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:45.122261 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc5626-aa05-4982-b8cc-724d85a03686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:45.123448 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc5626-aa05-4982-b8cc-724d85a03686 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:45.123725 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc5626-aa05-4982-b8cc-724d85a03686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:45.123997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc5626-aa05-4982-b8cc-724d85a03686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:45.125763 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-99bc5626-aa05-4982-b8cc-724d85a03686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:45.190053 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc5626-aa05-4982-b8cc-724d85a03686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:45.191524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc5626-aa05-4982-b8cc-724d85a03686 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:45.202573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1235/2466] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:48.734177 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837ca3-a708-4435-b2fe-341ba5f08cb5 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:48.739641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5a837ca3-a708-4435-b2fe-341ba5f08cb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:48.810517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837ca3-a708-4435-b2fe-341ba5f08cb5 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:48.815576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0dd5a-3d88-4cf3-b1c1-1799abbb97f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:48.816226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0dd5a-3d88-4cf3-b1c1-1799abbb97f9 service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:48.816510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0dd5a-3d88-4cf3-b1c1-1799abbb97f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:48.819964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0dd5a-3d88-4cf3-b1c1-1799abbb97f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:48.819964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7bc0dd5a-3d88-4cf3-b1c1-1799abbb97f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:48.830792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0dd5a-3d88-4cf3-b1c1-1799abbb97f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:48.832394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0dd5a-3d88-4cf3-b1c1-1799abbb97f9 service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:48.842191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1232/2467] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:48.885573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc5626-aa05-4982-b8cc-724d85a03686 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:48.887133 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-99bc5626-aa05-4982-b8cc-724d85a03686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:48.899796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc5626-aa05-4982-b8cc-724d85a03686 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:48.905280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5170b74-4aad-4402-9629-a58d5e7186be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:48.906155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5170b74-4aad-4402-9629-a58d5e7186be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:48.908834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5170b74-4aad-4402-9629-a58d5e7186be admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:48.908834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5170b74-4aad-4402-9629-a58d5e7186be admin admin] PATH_INFO: `/v3/users/7f7bf346718b4c61bab0fdc198af8818` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:48.908834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5170b74-4aad-4402-9629-a58d5e7186be admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7bf346718b4c61bab0fdc198af8818)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:48.910037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5170b74-4aad-4402-9629-a58d5e7186be admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:49.065655 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d5170b74-4aad-4402-9629-a58d5e7186be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7bf346718b4c61bab0fdc198af8818'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:49.066356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d5170b74-4aad-4402-9629-a58d5e7186be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7bf346718b4c61bab0fdc198af8818'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:49.158823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d5170b74-4aad-4402-9629-a58d5e7186be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7bf346718b4c61bab0fdc198af8818'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:49.172377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d5170b74-4aad-4402-9629-a58d5e7186be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7bf346718b4c61bab0fdc198af8818'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:49.179235 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d5170b74-4aad-4402-9629-a58d5e7186be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7bf346718b4c61bab0fdc198af8818'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:49.185185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1236/2468] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:48 2022] DELETE /identity/v3/users/7f7bf346718b4c61bab0fdc198af8818 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:49.420189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0dd5a-3d88-4cf3-b1c1-1799abbb97f9 service placement] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:49.432158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0dd5a-3d88-4cf3-b1c1-1799abbb97f9 service placement] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:49.495661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:49.496523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:49.496801 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:49.497070 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] PATH_INFO: `/v3/projects/5939bb2d7ba94aaeaf67ce4b12b5b330` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:49.498356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5939bb2d7ba94aaeaf67ce4b12b5b330)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:49.500331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:49.517849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:49.605803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5939bb2d7ba94aaeaf67ce4b12b5b330', 'request_id': 'req-63e6aaae-2495-4588-a0e0-2968c57772dc'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:49.661458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5939bb2d7ba94aaeaf67ce4b12b5b330', 'request_id': 'req-63e6aaae-2495-4588-a0e0-2968c57772dc'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:49.668227 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5939bb2d7ba94aaeaf67ce4b12b5b330', 'request_id': 'req-63e6aaae-2495-4588-a0e0-2968c57772dc'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:49.678698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] The token cache is being invalidate because project 5939bb2d7ba94aaeaf67ce4b12b5b330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:49.678988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:49.679620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-63e6aaae-2495-4588-a0e0-2968c57772dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:49.681172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1233/2469] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:49 2022] DELETE /identity/v3/projects/5939bb2d7ba94aaeaf67ce4b12b5b330 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:49.686787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23232f-bedf-4010-b840-a4e529c919c9 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:49.687074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23232f-bedf-4010-b840-a4e529c919c9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:49.687354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23232f-bedf-4010-b840-a4e529c919c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:49.705920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0c23232f-bedf-4010-b840-a4e529c919c9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:49.707226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0c23232f-bedf-4010-b840-a4e529c919c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:49.724456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:49.766195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1237/2470] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:49.774204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c4cec-4a14-48f9-9a8f-787e2b40e463 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:49.774712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c4cec-4a14-48f9-9a8f-787e2b40e463 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:49.774809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c4cec-4a14-48f9-9a8f-787e2b40e463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:49.792932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ef3c4cec-4a14-48f9-9a8f-787e2b40e463 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:49.794259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ef3c4cec-4a14-48f9-9a8f-787e2b40e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:49.802435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1234/2471] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:49.806735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23232f-bedf-4010-b840-a4e529c919c9 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:49.816656 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23232f-bedf-4010-b840-a4e529c919c9 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:49.821169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648511f-94cf-4c5b-aa47-0c20901680c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:49.821812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648511f-94cf-4c5b-aa47-0c20901680c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:49.822097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648511f-94cf-4c5b-aa47-0c20901680c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:49.822435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648511f-94cf-4c5b-aa47-0c20901680c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:49.823222 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648511f-94cf-4c5b-aa47-0c20901680c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:53:49.823523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648511f-94cf-4c5b-aa47-0c20901680c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:49.825373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648511f-94cf-4c5b-aa47-0c20901680c9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:49.837505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1238/2472] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:53:49.841661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c4cec-4a14-48f9-9a8f-787e2b40e463 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:49.856313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c4cec-4a14-48f9-9a8f-787e2b40e463 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:49.860989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c1fa-a953-4407-86f1-4d329f8c1172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:49.861633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c1fa-a953-4407-86f1-4d329f8c1172 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:49.861914 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c1fa-a953-4407-86f1-4d329f8c1172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:49.862186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c1fa-a953-4407-86f1-4d329f8c1172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:49.862917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96c1fa-a953-4407-86f1-4d329f8c1172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:49.864826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96c1fa-a953-4407-86f1-4d329f8c1172 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:49.957652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1235/2473] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:49 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:49.961728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648511f-94cf-4c5b-aa47-0c20901680c9 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:49.971710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648511f-94cf-4c5b-aa47-0c20901680c9 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:50.029351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7a64c-ca14-423b-86d7-62c841f5c51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:50.030001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a64c-ca14-423b-86d7-62c841f5c51b admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:50.030306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a64c-ca14-423b-86d7-62c841f5c51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:50.030641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a64c-ca14-423b-86d7-62c841f5c51b admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:50.031382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7a64c-ca14-423b-86d7-62c841f5c51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:50.033287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7a64c-ca14-423b-86d7-62c841f5c51b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:50.115350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1239/2474] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:49 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:50.119527 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c1fa-a953-4407-86f1-4d329f8c1172 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:50.131021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c1fa-a953-4407-86f1-4d329f8c1172 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:50.135655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d2714-c71a-41b9-aef5-547be6c73d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:50.136327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d2714-c71a-41b9-aef5-547be6c73d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:50.136621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d2714-c71a-41b9-aef5-547be6c73d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:50.136890 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d2714-c71a-41b9-aef5-547be6c73d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:50.137623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d2714-c71a-41b9-aef5-547be6c73d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:50.139282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d2714-c71a-41b9-aef5-547be6c73d44 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:50.150615 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1236/2475] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:50.154758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7a64c-ca14-423b-86d7-62c841f5c51b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:50.164685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7a64c-ca14-423b-86d7-62c841f5c51b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:50.169865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0326317-b9de-44cd-8784-a9c02033d293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:50.170572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0326317-b9de-44cd-8784-a9c02033d293 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:50.170853 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0326317-b9de-44cd-8784-a9c02033d293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:50.171127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0326317-b9de-44cd-8784-a9c02033d293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:50.171943 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0326317-b9de-44cd-8784-a9c02033d293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:50.173518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0326317-b9de-44cd-8784-a9c02033d293 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:50.183320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1240/2476] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:50.188077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d2714-c71a-41b9-aef5-547be6c73d44 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:50.198009 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d2714-c71a-41b9-aef5-547be6c73d44 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:50.203140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad65a72-afbb-47a0-a8c4-afea152fb2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:50.204014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad65a72-afbb-47a0-a8c4-afea152fb2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:50.204294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad65a72-afbb-47a0-a8c4-afea152fb2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:50.204567 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad65a72-afbb-47a0-a8c4-afea152fb2d3 admin admin] PATH_INFO: `/v3/projects/75cd6c12481b47a895b7a1f98cf51349/users/16012edaa6d945a993ae90e883922909/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:50.219446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad65a72-afbb-47a0-a8c4-afea152fb2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cd6c12481b47a895b7a1f98cf51349, user_id=16012edaa6d945a993ae90e883922909, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:50.222181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad65a72-afbb-47a0-a8c4-afea152fb2d3 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:50.299690 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1237/2477] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:50 2022] PUT /identity/v3/projects/75cd6c12481b47a895b7a1f98cf51349/users/16012edaa6d945a993ae90e883922909/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:50.309699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9ec5f-d06b-4d16-8138-a0e2c431dcf5 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:50.310666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9ec5f-d06b-4d16-8138-a0e2c431dcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:50.310951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9ec5f-d06b-4d16-8138-a0e2c431dcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:50.337546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-43b9ec5f-d06b-4d16-8138-a0e2c431dcf5 None None] MFA Rules not processed for user `16012edaa6d945a993ae90e883922909`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:50.338788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-43b9ec5f-d06b-4d16-8138-a0e2c431dcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:50.404324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1241/2478] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:50.409807 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad65a72-afbb-47a0-a8c4-afea152fb2d3 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:50.475664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad65a72-afbb-47a0-a8c4-afea152fb2d3 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:50.481480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead3fa6-e920-4fbd-8796-04d547909af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:50.482775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead3fa6-e920-4fbd-8796-04d547909af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:50.483058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead3fa6-e920-4fbd-8796-04d547909af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:50.483337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead3fa6-e920-4fbd-8796-04d547909af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:50.484030 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead3fa6-e920-4fbd-8796-04d547909af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:50.486267 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead3fa6-e920-4fbd-8796-04d547909af4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:50.591621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1238/2479] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:50 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:50.594313 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9ec5f-d06b-4d16-8138-a0e2c431dcf5 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:50.605522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9ec5f-d06b-4d16-8138-a0e2c431dcf5 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:50.625856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:50.666253 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b901caa-846b-4dcc-a395-44e2fb563939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:50.666952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b901caa-846b-4dcc-a395-44e2fb563939 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:50.667240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b901caa-846b-4dcc-a395-44e2fb563939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:50.667520 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b901caa-846b-4dcc-a395-44e2fb563939 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:50.668205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b901caa-846b-4dcc-a395-44e2fb563939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:50.670809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b901caa-846b-4dcc-a395-44e2fb563939 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:50.776683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1242/2480] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:50 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:50.777828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead3fa6-e920-4fbd-8796-04d547909af4 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:50.789226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead3fa6-e920-4fbd-8796-04d547909af4 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:50.794013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a2a57-c283-4c91-9dc2-04978b8164ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:50.794698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2a57-c283-4c91-9dc2-04978b8164ed admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:50.794987 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2a57-c283-4c91-9dc2-04978b8164ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:50.795271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2a57-c283-4c91-9dc2-04978b8164ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:50.796024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a2a57-c283-4c91-9dc2-04978b8164ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:50.797626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a2a57-c283-4c91-9dc2-04978b8164ed admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:50.808329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1239/2481] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:50.812419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b901caa-846b-4dcc-a395-44e2fb563939 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:50.822670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b901caa-846b-4dcc-a395-44e2fb563939 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:50.828292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac58a65-369b-46b1-9567-aef0b6a3b9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:50.829193 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac58a65-369b-46b1-9567-aef0b6a3b9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:50.829478 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac58a65-369b-46b1-9567-aef0b6a3b9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:50.829756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac58a65-369b-46b1-9567-aef0b6a3b9c8 admin admin] PATH_INFO: `/v3/projects/4134af7a7fa54c5093d084cc8c45a37f/users/081d9a5334bb4062807cf355bc8290e3/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:50.857612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac58a65-369b-46b1-9567-aef0b6a3b9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4134af7a7fa54c5093d084cc8c45a37f, user_id=081d9a5334bb4062807cf355bc8290e3, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:50.857612 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac58a65-369b-46b1-9567-aef0b6a3b9c8 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:50.930852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1243/2482] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:50 2022] PUT /identity/v3/projects/4134af7a7fa54c5093d084cc8c45a37f/users/081d9a5334bb4062807cf355bc8290e3/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:50.935091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a2a57-c283-4c91-9dc2-04978b8164ed admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:50.945160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a2a57-c283-4c91-9dc2-04978b8164ed admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:50.958989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:51.003651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc06239-4d96-44a0-b83c-de42c9d09298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:51.004264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc06239-4d96-44a0-b83c-de42c9d09298 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:51.004552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc06239-4d96-44a0-b83c-de42c9d09298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:51.004830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc06239-4d96-44a0-b83c-de42c9d09298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:51.005554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc06239-4d96-44a0-b83c-de42c9d09298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:51.007195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc06239-4d96-44a0-b83c-de42c9d09298 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:51.026379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1240/2483] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:51.029517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac58a65-369b-46b1-9567-aef0b6a3b9c8 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:51.041118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac58a65-369b-46b1-9567-aef0b6a3b9c8 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:51.046425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcacb2-827e-497a-947b-e78eca175537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:51.047698 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcacb2-827e-497a-947b-e78eca175537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:51.048046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcacb2-827e-497a-947b-e78eca175537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:51.048417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcacb2-827e-497a-947b-e78eca175537 admin admin] PATH_INFO: `/v3/projects/4134af7a7fa54c5093d084cc8c45a37f/users/081d9a5334bb4062807cf355bc8290e3/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:51.050688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcacb2-827e-497a-947b-e78eca175537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4134af7a7fa54c5093d084cc8c45a37f, user_id=081d9a5334bb4062807cf355bc8290e3, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:51.054632 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcacb2-827e-497a-947b-e78eca175537 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:51.064570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1244/2484] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:51 2022] PUT /identity/v3/projects/4134af7a7fa54c5093d084cc8c45a37f/users/081d9a5334bb4062807cf355bc8290e3/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:51.076651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcee534-c17a-4863-a3ec-f364569382bd None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:51.076949 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcee534-c17a-4863-a3ec-f364569382bd None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:51.077390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcee534-c17a-4863-a3ec-f364569382bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:51.106512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-0dcee534-c17a-4863-a3ec-f364569382bd None None] MFA Rules not processed for user `081d9a5334bb4062807cf355bc8290e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:51.107808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0dcee534-c17a-4863-a3ec-f364569382bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:51.141662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcacb2-827e-497a-947b-e78eca175537 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:51.143589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-52fcacb2-827e-497a-947b-e78eca175537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:51.183365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1241/2485] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:51.196727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcee534-c17a-4863-a3ec-f364569382bd None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:51.198159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0dcee534-c17a-4863-a3ec-f364569382bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:51.212340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcacb2-827e-497a-947b-e78eca175537 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:51.217814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff9f5e-cfc9-4330-aef6-664ecfc4cae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:51.218729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff9f5e-cfc9-4330-aef6-664ecfc4cae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:51.219014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff9f5e-cfc9-4330-aef6-664ecfc4cae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:51.219289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff9f5e-cfc9-4330-aef6-664ecfc4cae2 admin admin] PATH_INFO: `/v3/users/ac24703aa735408c994e8edda0006f59` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:51.220559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff9f5e-cfc9-4330-aef6-664ecfc4cae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac24703aa735408c994e8edda0006f59)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:51.224688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff9f5e-cfc9-4330-aef6-664ecfc4cae2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:51.264447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcee534-c17a-4863-a3ec-f364569382bd None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:51.268124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d3b5e-5987-4428-aa4f-fdb685ca988e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:51.268775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d3b5e-5987-4428-aa4f-fdb685ca988e service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:51.269055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d3b5e-5987-4428-aa4f-fdb685ca988e service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:51.269331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d3b5e-5987-4428-aa4f-fdb685ca988e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:51.278576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d3b5e-5987-4428-aa4f-fdb685ca988e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:51.280057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d3b5e-5987-4428-aa4f-fdb685ca988e service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:51.289784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1242/2486] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:53:51.290643 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d3b5e-5987-4428-aa4f-fdb685ca988e service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:51.291955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e29d3b5e-5987-4428-aa4f-fdb685ca988e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:51.305318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d3b5e-5987-4428-aa4f-fdb685ca988e service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:51.310535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708173dd-891b-4415-9fe4-f31eeecf321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:51.311386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708173dd-891b-4415-9fe4-f31eeecf321d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:51.311667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708173dd-891b-4415-9fe4-f31eeecf321d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:51.311939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708173dd-891b-4415-9fe4-f31eeecf321d admin admin] PATH_INFO: `/v3/users/4e7b8d4a672a4433898c359ecd3affa5` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:51.313134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708173dd-891b-4415-9fe4-f31eeecf321d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7b8d4a672a4433898c359ecd3affa5)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:51.315058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708173dd-891b-4415-9fe4-f31eeecf321d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:51.490696 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a0ff9f5e-cfc9-4330-aef6-664ecfc4cae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac24703aa735408c994e8edda0006f59'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:51.491632 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a0ff9f5e-cfc9-4330-aef6-664ecfc4cae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac24703aa735408c994e8edda0006f59'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:51.538520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:51.548364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-708173dd-891b-4415-9fe4-f31eeecf321d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7b8d4a672a4433898c359ecd3affa5'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:51.549044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-708173dd-891b-4415-9fe4-f31eeecf321d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7b8d4a672a4433898c359ecd3affa5'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:51.561584 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-708173dd-891b-4415-9fe4-f31eeecf321d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7b8d4a672a4433898c359ecd3affa5'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:51.562095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a0ff9f5e-cfc9-4330-aef6-664ecfc4cae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac24703aa735408c994e8edda0006f59'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:51.575425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a0ff9f5e-cfc9-4330-aef6-664ecfc4cae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac24703aa735408c994e8edda0006f59'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:51.576662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:51.582548 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a0ff9f5e-cfc9-4330-aef6-664ecfc4cae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac24703aa735408c994e8edda0006f59'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:51.588547 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1245/2487] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:51 2022] DELETE /identity/v3/users/ac24703aa735408c994e8edda0006f59 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:53:51.593033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d9d6c-0b2f-483f-9738-836fb1428209 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:51.593320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d9d6c-0b2f-483f-9738-836fb1428209 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:51.594484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d9d6c-0b2f-483f-9738-836fb1428209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:51.610800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-140d9d6c-0b2f-483f-9738-836fb1428209 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:51.611998 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-140d9d6c-0b2f-483f-9738-836fb1428209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:51.664996 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-708173dd-891b-4415-9fe4-f31eeecf321d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7b8d4a672a4433898c359ecd3affa5'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:51.670245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1246/2488] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:51.673265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-708173dd-891b-4415-9fe4-f31eeecf321d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7b8d4a672a4433898c359ecd3affa5'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:51.679517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1243/2489] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:51 2022] DELETE /identity/v3/users/4e7b8d4a672a4433898c359ecd3affa5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:51.679915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d9d6c-0b2f-483f-9738-836fb1428209 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:51.681311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-140d9d6c-0b2f-483f-9738-836fb1428209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:51.683729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99bb0-fd46-4660-ab89-d45c7b8e2f83 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:51.684145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99bb0-fd46-4660-ab89-d45c7b8e2f83 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:51.684456 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99bb0-fd46-4660-ab89-d45c7b8e2f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:51.703299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-00d99bb0-fd46-4660-ab89-d45c7b8e2f83 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:51.704547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-00d99bb0-fd46-4660-ab89-d45c7b8e2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:51.738590 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d9d6c-0b2f-483f-9738-836fb1428209 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:51.761950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1244/2490] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:51.771494 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99bb0-fd46-4660-ab89-d45c7b8e2f83 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:51.772831 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-00d99bb0-fd46-4660-ab89-d45c7b8e2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:51.787173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d86aac-8d9a-4fa5-830a-79900edb6d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:51.787840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d86aac-8d9a-4fa5-830a-79900edb6d56 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:51.788124 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d86aac-8d9a-4fa5-830a-79900edb6d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:51.788397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d86aac-8d9a-4fa5-830a-79900edb6d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:51.798831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d86aac-8d9a-4fa5-830a-79900edb6d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:51.800290 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d86aac-8d9a-4fa5-830a-79900edb6d56 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:51.810702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1247/2491] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:53:51.831438 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99bb0-fd46-4660-ab89-d45c7b8e2f83 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:51.835180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc147ea-f0d1-4f85-a73a-9ec6ca810606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:51.835826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc147ea-f0d1-4f85-a73a-9ec6ca810606 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:51.836106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc147ea-f0d1-4f85-a73a-9ec6ca810606 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:51.836379 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc147ea-f0d1-4f85-a73a-9ec6ca810606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:51.846026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc147ea-f0d1-4f85-a73a-9ec6ca810606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:51.847605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc147ea-f0d1-4f85-a73a-9ec6ca810606 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:51.857824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1245/2492] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:53:52.313952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d86aac-8d9a-4fa5-830a-79900edb6d56 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:52.314922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc147ea-f0d1-4f85-a73a-9ec6ca810606 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:52.317326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8bc147ea-f0d1-4f85-a73a-9ec6ca810606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:52.320170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-94d86aac-8d9a-4fa5-830a-79900edb6d56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:52.336421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d86aac-8d9a-4fa5-830a-79900edb6d56 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:52.350755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc147ea-f0d1-4f85-a73a-9ec6ca810606 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:52.350755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:52.350755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:52.350755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:52.351278 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] PATH_INFO: `/v3/projects/3d787b0195414e3292de34e184ac6a5c` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:52.352714 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d787b0195414e3292de34e184ac6a5c)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:52.355066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:52.359150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:52.360182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:52.360684 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:52.360962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] PATH_INFO: `/v3/projects/cefd3e136e3744f8bfd328b9f6923ca4` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:52.362737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=cefd3e136e3744f8bfd328b9f6923ca4)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:52.365551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:52.520592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d787b0195414e3292de34e184ac6a5c', 'request_id': 'req-166845af-eb7d-4b72-bfbb-7b0d683a2570'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:52.524035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:52.529585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:52.533336 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cefd3e136e3744f8bfd328b9f6923ca4', 'request_id': 'req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:52.618544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d787b0195414e3292de34e184ac6a5c', 'request_id': 'req-166845af-eb7d-4b72-bfbb-7b0d683a2570'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:52.625792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d787b0195414e3292de34e184ac6a5c', 'request_id': 'req-166845af-eb7d-4b72-bfbb-7b0d683a2570'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:52.636679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] The token cache is being invalidate because project 3d787b0195414e3292de34e184ac6a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:52.636967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:52.637604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:52.639771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1246/2493] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:52 2022] DELETE /identity/v3/projects/3d787b0195414e3292de34e184ac6a5c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:52.640616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:52.641884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:52.692833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cefd3e136e3744f8bfd328b9f6923ca4', 'request_id': 'req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:52.699031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cefd3e136e3744f8bfd328b9f6923ca4', 'request_id': 'req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:52.705365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166845af-eb7d-4b72-bfbb-7b0d683a2570 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:52.711387 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] The token cache is being invalidate because project cefd3e136e3744f8bfd328b9f6923ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:52.711675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:52.712309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:52.716958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1248/2494] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:52 2022] DELETE /identity/v3/projects/cefd3e136e3744f8bfd328b9f6923ca4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:52.716958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:52.716958 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:52.767160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5546ade-7203-45e5-9068-5122a55dc2a4 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '081d9a5334bb4062807cf355bc8290e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4134af7a7fa54c5093d084cc8c45a37f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:52.767832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5546ade-7203-45e5-9068-5122a55dc2a4 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:52.768119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5546ade-7203-45e5-9068-5122a55dc2a4 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:52.768399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5546ade-7203-45e5-9068-5122a55dc2a4 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:52.769217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5546ade-7203-45e5-9068-5122a55dc2a4 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:53:52.769535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5546ade-7203-45e5-9068-5122a55dc2a4 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:52.772620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5546ade-7203-45e5-9068-5122a55dc2a4 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:52.785018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88536d19-f27c-4a5c-b3fc-f2fdbb7a2dfe admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:52.786478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1247/2495] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:53:52.787854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5546ade-7203-45e5-9068-5122a55dc2a4 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:52.789762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c5546ade-7203-45e5-9068-5122a55dc2a4 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:52.789930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:52.791142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:52.791431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:52.791709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] PATH_INFO: `/v3/users/048af660b9c44c2e9a4d80cce26791f2` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:52.792917 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048af660b9c44c2e9a4d80cce26791f2)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:52.795002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:52.804161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5546ade-7203-45e5-9068-5122a55dc2a4 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:52.808979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:52.811324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:52.811324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:52.811324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] PATH_INFO: `/v3/users/7ad126bbbfca47a5a74864814a226add` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:52.812140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad126bbbfca47a5a74864814a226add)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:52.814075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:53.006955 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048af660b9c44c2e9a4d80cce26791f2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.007614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048af660b9c44c2e9a4d80cce26791f2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.092709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad126bbbfca47a5a74864814a226add'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.093386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad126bbbfca47a5a74864814a226add'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.104985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad126bbbfca47a5a74864814a226add'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.107417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048af660b9c44c2e9a4d80cce26791f2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.120113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048af660b9c44c2e9a4d80cce26791f2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.127413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048af660b9c44c2e9a4d80cce26791f2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.133681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1249/2496] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:52 2022] DELETE /identity/v3/users/048af660b9c44c2e9a4d80cce26791f2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:53.143326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:53.144773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:53.196660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:53.207218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad126bbbfca47a5a74864814a226add'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.210272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:53.210722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7103bff-6cbe-4c14-8d78-bd82d68d56c2 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:53.217101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978864b-d3bc-4689-a1c5-31ac9447767f tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '081d9a5334bb4062807cf355bc8290e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4134af7a7fa54c5093d084cc8c45a37f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:53.219681 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978864b-d3bc-4689-a1c5-31ac9447767f tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:53.219821 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad126bbbfca47a5a74864814a226add'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.219952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978864b-d3bc-4689-a1c5-31ac9447767f tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:53.219952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978864b-d3bc-4689-a1c5-31ac9447767f tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:53.219952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978864b-d3bc-4689-a1c5-31ac9447767f tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:53.221110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978864b-d3bc-4689-a1c5-31ac9447767f tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:53.237700 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1248/2497] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:52 2022] DELETE /identity/v3/users/7ad126bbbfca47a5a74864814a226add => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:53.349992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1250/2498] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:53 2022] POST /identity/v3/projects => generated 352 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:53.353955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:53.355467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:53.426056 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51edd18-18d8-44dd-a0ed-c80ddd9cf2cb admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:53.493185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb0836-eb2d-4f62-9125-fefa1f866024 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '081d9a5334bb4062807cf355bc8290e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4134af7a7fa54c5093d084cc8c45a37f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:53.493951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb0836-eb2d-4f62-9125-fefa1f866024 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:53.494338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb0836-eb2d-4f62-9125-fefa1f866024 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:53.494716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb0836-eb2d-4f62-9125-fefa1f866024 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:53.495517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb0836-eb2d-4f62-9125-fefa1f866024 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:53:53.495895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb0836-eb2d-4f62-9125-fefa1f866024 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:53.498155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb0836-eb2d-4f62-9125-fefa1f866024 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:53.510786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1249/2499] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:53:53.551438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978864b-d3bc-4689-a1c5-31ac9447767f tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:53.562638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978864b-d3bc-4689-a1c5-31ac9447767f tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:53.567266 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '081d9a5334bb4062807cf355bc8290e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4134af7a7fa54c5093d084cc8c45a37f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:53.568128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:53.568433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:53.568711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] PATH_INFO: `/v3/projects/0d2a6b8654c24dec93836faf68f0fb53` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:53.569934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0d2a6b8654c24dec93836faf68f0fb53)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:53.571868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:53.677978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb0836-eb2d-4f62-9125-fefa1f866024 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:53.681721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8afb0836-eb2d-4f62-9125-fefa1f866024 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:53.689434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2a6b8654c24dec93836faf68f0fb53', 'request_id': 'req-96bc4655-9564-4268-a24f-0c69032f91c2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.766096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb0836-eb2d-4f62-9125-fefa1f866024 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:53.773007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2a6b8654c24dec93836faf68f0fb53', 'request_id': 'req-96bc4655-9564-4268-a24f-0c69032f91c2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.780997 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2a6b8654c24dec93836faf68f0fb53', 'request_id': 'req-96bc4655-9564-4268-a24f-0c69032f91c2'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.793829 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] The token cache is being invalidate because project 0d2a6b8654c24dec93836faf68f0fb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:53.798431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.798431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:53.802354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1251/2500] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:53 2022] DELETE /identity/v3/projects/0d2a6b8654c24dec93836faf68f0fb53 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:53.802354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:53.802354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:53.843899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:53.845124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:53.845480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:53.845824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] PATH_INFO: `/v3/projects/13a20665ef554743841e70469c1442dc` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:53.847153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a20665ef554743841e70469c1442dc)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:53.849187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:53.874823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:53.880104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc4655-9564-4268-a24f-0c69032f91c2 tempest-VolumeQuotaClassesTest-1351000730 tempest-VolumeQuotaClassesTest-1351000730-project-admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:53.885034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:53.890146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:53.890146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:53.890146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] PATH_INFO: `/v3/projects/7731dd16327c40eab0681b0deb235e37` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:53.890146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7731dd16327c40eab0681b0deb235e37)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:53.890146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:53.949719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a20665ef554743841e70469c1442dc', 'request_id': 'req-6df118e3-06d7-47c0-9f3a-7300f00bfeec'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.016369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a20665ef554743841e70469c1442dc', 'request_id': 'req-6df118e3-06d7-47c0-9f3a-7300f00bfeec'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.023464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a20665ef554743841e70469c1442dc', 'request_id': 'req-6df118e3-06d7-47c0-9f3a-7300f00bfeec'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.034129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] The token cache is being invalidate because project 13a20665ef554743841e70469c1442dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:54.034641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.035306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6df118e3-06d7-47c0-9f3a-7300f00bfeec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.036966 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1250/2501] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:53 2022] DELETE /identity/v3/projects/13a20665ef554743841e70469c1442dc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:53:54.038461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7731dd16327c40eab0681b0deb235e37', 'request_id': 'req-8a601b8e-5a8b-4913-98da-961aae00545f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.042388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35e6d-c3ae-448b-b46e-6bdb3917af4a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.042680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35e6d-c3ae-448b-b46e-6bdb3917af4a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.042963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35e6d-c3ae-448b-b46e-6bdb3917af4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.062611 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-71b35e6d-c3ae-448b-b46e-6bdb3917af4a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:54.063747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-71b35e6d-c3ae-448b-b46e-6bdb3917af4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:54.134640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1251/2502] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:54.135967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69244d-55a0-4582-b530-845a79b9e9a1 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.136282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69244d-55a0-4582-b530-845a79b9e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.136563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69244d-55a0-4582-b530-845a79b9e9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.147824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7731dd16327c40eab0681b0deb235e37', 'request_id': 'req-8a601b8e-5a8b-4913-98da-961aae00545f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.152386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:54.156241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7731dd16327c40eab0681b0deb235e37', 'request_id': 'req-8a601b8e-5a8b-4913-98da-961aae00545f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.158506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-7c69244d-55a0-4582-b530-845a79b9e9a1 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:54.159729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7c69244d-55a0-4582-b530-845a79b9e9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:54.168185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] The token cache is being invalidate because project 7731dd16327c40eab0681b0deb235e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:54.168473 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.169729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8a601b8e-5a8b-4913-98da-961aae00545f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.171325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1252/2503] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:53 2022] DELETE /identity/v3/projects/7731dd16327c40eab0681b0deb235e37 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:54.172235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1252/2504] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:54.176195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768a71-1e27-4a95-9abd-599a88ab8980 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.176487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768a71-1e27-4a95-9abd-599a88ab8980 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.176589 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69244d-55a0-4582-b530-845a79b9e9a1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.176764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768a71-1e27-4a95-9abd-599a88ab8980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.186185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69244d-55a0-4582-b530-845a79b9e9a1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.191209 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e5523-394a-4de8-8392-ca96c30936ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.191920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5523-394a-4de8-8392-ca96c30936ac admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.192150 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5523-394a-4de8-8392-ca96c30936ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.192427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5523-394a-4de8-8392-ca96c30936ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.193166 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e5523-394a-4de8-8392-ca96c30936ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:53:54.193463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e5523-394a-4de8-8392-ca96c30936ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.194796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a9768a71-1e27-4a95-9abd-599a88ab8980 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:54.195235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e5523-394a-4de8-8392-ca96c30936ac admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.195996 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a9768a71-1e27-4a95-9abd-599a88ab8980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:54.206174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1253/2505] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:54.213574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1cb1-ab2f-4c4c-ae5e-cbfd6a80e38c None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.213870 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1cb1-ab2f-4c4c-ae5e-cbfd6a80e38c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.214017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1253/2506] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:53:54.214177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1cb1-ab2f-4c4c-ae5e-cbfd6a80e38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.218640 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e5523-394a-4de8-8392-ca96c30936ac admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.220429 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c34e5523-394a-4de8-8392-ca96c30936ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:54.232847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-cbda1cb1-ab2f-4c4c-ae5e-cbfd6a80e38c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:54.235430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e5523-394a-4de8-8392-ca96c30936ac admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.235571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-cbda1cb1-ab2f-4c4c-ae5e-cbfd6a80e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:54.239872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7a32f-2890-4ea7-9050-41da34da34e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.240630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7a32f-2890-4ea7-9050-41da34da34e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.240920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7a32f-2890-4ea7-9050-41da34da34e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.241196 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7a32f-2890-4ea7-9050-41da34da34e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.241894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7a32f-2890-4ea7-9050-41da34da34e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.242457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1254/2507] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:54.243836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7a32f-2890-4ea7-9050-41da34da34e0 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.246556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda1cb1-ab2f-4c4c-ae5e-cbfd6a80e38c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.255552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda1cb1-ab2f-4c4c-ae5e-cbfd6a80e38c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.260385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199539-ec20-434d-ae78-cc4b4a916c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.261083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199539-ec20-434d-ae78-cc4b4a916c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.261370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199539-ec20-434d-ae78-cc4b4a916c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.261649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199539-ec20-434d-ae78-cc4b4a916c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.262423 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199539-ec20-434d-ae78-cc4b4a916c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:53:54.262735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199539-ec20-434d-ae78-cc4b4a916c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.264382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199539-ec20-434d-ae78-cc4b4a916c93 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.284407 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1255/2508] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:53:54.288485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199539-ec20-434d-ae78-cc4b4a916c93 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.301064 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199539-ec20-434d-ae78-cc4b4a916c93 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.306152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c7799-ea26-4df7-9883-dff55563da34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.307031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c7799-ea26-4df7-9883-dff55563da34 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.307298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c7799-ea26-4df7-9883-dff55563da34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.307583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c7799-ea26-4df7-9883-dff55563da34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.308279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c7799-ea26-4df7-9883-dff55563da34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.312301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c7799-ea26-4df7-9883-dff55563da34 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.342503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1254/2509] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:54 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:54.342503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7a32f-2890-4ea7-9050-41da34da34e0 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.342503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8ff7a32f-2890-4ea7-9050-41da34da34e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:54.373617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:54.406561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1256/2510] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:54 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:54.406561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c7799-ea26-4df7-9883-dff55563da34 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.407199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7a32f-2890-4ea7-9050-41da34da34e0 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.463159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.464046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.464329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.464658 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] PATH_INFO: `/v3/users/be85a2cb169a4d13aaad149c8613ee55` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.466577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be85a2cb169a4d13aaad149c8613ee55)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.469093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.470967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c7799-ea26-4df7-9883-dff55563da34 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.476530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e6a9-5725-4d07-b16e-446b159a67ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.477243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e6a9-5725-4d07-b16e-446b159a67ad admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.477542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e6a9-5725-4d07-b16e-446b159a67ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.477827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e6a9-5725-4d07-b16e-446b159a67ad admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.478565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320e6a9-5725-4d07-b16e-446b159a67ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.483202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320e6a9-5725-4d07-b16e-446b159a67ad admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.622572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1257/2511] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:54 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:54.622572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e6a9-5725-4d07-b16e-446b159a67ad admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.630151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e6a9-5725-4d07-b16e-446b159a67ad admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.634873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fd7d7-b8f6-4b8a-b312-eaadd2574143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.635532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fd7d7-b8f6-4b8a-b312-eaadd2574143 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.635814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fd7d7-b8f6-4b8a-b312-eaadd2574143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.636085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fd7d7-b8f6-4b8a-b312-eaadd2574143 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.636746 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fd7d7-b8f6-4b8a-b312-eaadd2574143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.639324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fd7d7-b8f6-4b8a-b312-eaadd2574143 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.683193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be85a2cb169a4d13aaad149c8613ee55'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.683947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be85a2cb169a4d13aaad149c8613ee55'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.695892 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be85a2cb169a4d13aaad149c8613ee55'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.750045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1258/2512] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:54 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:54.751010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fd7d7-b8f6-4b8a-b312-eaadd2574143 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.752574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8c6fd7d7-b8f6-4b8a-b312-eaadd2574143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:54.764720 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fd7d7-b8f6-4b8a-b312-eaadd2574143 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.769694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.770578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.770864 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.771144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] PATH_INFO: `/v3/users/16012edaa6d945a993ae90e883922909` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.772322 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16012edaa6d945a993ae90e883922909)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.772715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be85a2cb169a4d13aaad149c8613ee55'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.774295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.780865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be85a2cb169a4d13aaad149c8613ee55'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.787316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1255/2513] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:54 2022] DELETE /identity/v3/users/be85a2cb169a4d13aaad149c8613ee55 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:54.788277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.789795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:54.848605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:54.853719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04869928-13fb-4865-9b5e-516d185ea838 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.858488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6e35d-f07a-4de2-9a37-e2a27acdc2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.859181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6e35d-f07a-4de2-9a37-e2a27acdc2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.859466 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6e35d-f07a-4de2-9a37-e2a27acdc2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.859744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6e35d-f07a-4de2-9a37-e2a27acdc2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.860505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6e35d-f07a-4de2-9a37-e2a27acdc2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.862252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6e35d-f07a-4de2-9a37-e2a27acdc2a5 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.872695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1256/2514] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:54.873447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6e35d-f07a-4de2-9a37-e2a27acdc2a5 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.875098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c4e6e35d-f07a-4de2-9a37-e2a27acdc2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:54.887384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6e35d-f07a-4de2-9a37-e2a27acdc2a5 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.892549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70df5b9-005e-4eba-b076-35b176653149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.893173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70df5b9-005e-4eba-b076-35b176653149 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.893457 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70df5b9-005e-4eba-b076-35b176653149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.893733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70df5b9-005e-4eba-b076-35b176653149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.894474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70df5b9-005e-4eba-b076-35b176653149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.896017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70df5b9-005e-4eba-b076-35b176653149 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.909393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1257/2515] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:54.909393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4b13a-99ce-449d-b118-2c079f22ec69 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.909393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4b13a-99ce-449d-b118-2c079f22ec69 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.909393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4b13a-99ce-449d-b118-2c079f22ec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.927110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-2da4b13a-99ce-449d-b118-2c079f22ec69 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:54.928298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2da4b13a-99ce-449d-b118-2c079f22ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:54.936939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1258/2516] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:54.937762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4b13a-99ce-449d-b118-2c079f22ec69 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.946596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16012edaa6d945a993ae90e883922909'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.947603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16012edaa6d945a993ae90e883922909'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:54.947791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4b13a-99ce-449d-b118-2c079f22ec69 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.953607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7205a2-14eb-4428-a1db-b0d9723643f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.954291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7205a2-14eb-4428-a1db-b0d9723643f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.954604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7205a2-14eb-4428-a1db-b0d9723643f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.954877 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7205a2-14eb-4428-a1db-b0d9723643f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.955595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7205a2-14eb-4428-a1db-b0d9723643f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.957164 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7205a2-14eb-4428-a1db-b0d9723643f7 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.967458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1259/2517] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:54.968403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7205a2-14eb-4428-a1db-b0d9723643f7 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:54.969840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3d7205a2-14eb-4428-a1db-b0d9723643f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:54.981620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7205a2-14eb-4428-a1db-b0d9723643f7 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:54.986108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d650-4c67-4f1d-b8fe-2bb95b6f1257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:54.986750 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d650-4c67-4f1d-b8fe-2bb95b6f1257 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:54.987032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d650-4c67-4f1d-b8fe-2bb95b6f1257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:54.987303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d650-4c67-4f1d-b8fe-2bb95b6f1257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:54.987992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870d650-4c67-4f1d-b8fe-2bb95b6f1257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:54.989492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870d650-4c67-4f1d-b8fe-2bb95b6f1257 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:54.999352 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1260/2518] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:55.000096 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d650-4c67-4f1d-b8fe-2bb95b6f1257 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:55.001621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1870d650-4c67-4f1d-b8fe-2bb95b6f1257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:55.057196 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d650-4c67-4f1d-b8fe-2bb95b6f1257 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:55.061709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323a634-bbab-48eb-add8-69c232488d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:55.061903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16012edaa6d945a993ae90e883922909'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:55.062533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a634-bbab-48eb-add8-69c232488d11 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.062828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a634-bbab-48eb-add8-69c232488d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.063722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a634-bbab-48eb-add8-69c232488d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.065554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d323a634-bbab-48eb-add8-69c232488d11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:55.072884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:DELETE=10,keystone:SELECT=82,keystone:INSERT=8 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:55.076356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16012edaa6d945a993ae90e883922909'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:55.078111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323a634-bbab-48eb-add8-69c232488d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:55.079564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323a634-bbab-48eb-add8-69c232488d11 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:55.083213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16012edaa6d945a993ae90e883922909'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:55.092010 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1259/2519] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:54 2022] DELETE /identity/v3/users/16012edaa6d945a993ae90e883922909 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:55.092172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1261/2520] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:55.092273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:55.092366 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323a634-bbab-48eb-add8-69c232488d11 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:55.092476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:55.101859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323a634-bbab-48eb-add8-69c232488d11 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:55.167734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713509ff-6890-4690-a8f2-a9034ea372f1 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:55.173438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2755f-7095-4890-9159-c7212c5e90cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:55.174626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2755f-7095-4890-9159-c7212c5e90cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.174908 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2755f-7095-4890-9159-c7212c5e90cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.175186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2755f-7095-4890-9159-c7212c5e90cc admin admin] PATH_INFO: `/v3/projects/a643734a7b59414c9ef4c27dad11d84e/users/a4a61cfbc2cd4a229a345617e18148d2/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.177642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1b742-405a-40d1-9070-6d38e731b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:55.179253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1b742-405a-40d1-9070-6d38e731b284 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.179253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1b742-405a-40d1-9070-6d38e731b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.179253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1b742-405a-40d1-9070-6d38e731b284 admin admin] PATH_INFO: `/v3/projects/2a7aaeab18ff4033b294a415fb14b356/users/f5631e7b4f1d4e0ba112ed5b3ba5f453/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.191447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2755f-7095-4890-9159-c7212c5e90cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a643734a7b59414c9ef4c27dad11d84e, user_id=a4a61cfbc2cd4a229a345617e18148d2, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:55.194142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2755f-7095-4890-9159-c7212c5e90cc admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:55.195641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1b742-405a-40d1-9070-6d38e731b284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7aaeab18ff4033b294a415fb14b356, user_id=f5631e7b4f1d4e0ba112ed5b3ba5f453, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:55.198617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1b742-405a-40d1-9070-6d38e731b284 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:55.296431 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1260/2521] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:55 2022] PUT /identity/v3/projects/a643734a7b59414c9ef4c27dad11d84e/users/a4a61cfbc2cd4a229a345617e18148d2/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:55.297738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dbc4a-c749-47a1-9676-31a3559b4ffc None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.298027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dbc4a-c749-47a1-9676-31a3559b4ffc None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.298330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dbc4a-c749-47a1-9676-31a3559b4ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.316187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-4e2dbc4a-c749-47a1-9676-31a3559b4ffc None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:55.317609 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-4e2dbc4a-c749-47a1-9676-31a3559b4ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:55.326731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1262/2522] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:55 2022] PUT /identity/v3/projects/2a7aaeab18ff4033b294a415fb14b356/users/f5631e7b4f1d4e0ba112ed5b3ba5f453/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:55.327902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62cdb3-e6cb-4118-9467-e079b10ef4f5 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.328275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62cdb3-e6cb-4118-9467-e079b10ef4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.328489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62cdb3-e6cb-4118-9467-e079b10ef4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.357404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ee62cdb3-e6cb-4118-9467-e079b10ef4f5 None None] MFA Rules not processed for user `a4a61cfbc2cd4a229a345617e18148d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:55.358679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ee62cdb3-e6cb-4118-9467-e079b10ef4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:55.388126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:55.398119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1261/2523] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:55.399592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474de03e-c15c-4259-9a9a-a9f6ea5b5cb4 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.399884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474de03e-c15c-4259-9a9a-a9f6ea5b5cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.400374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474de03e-c15c-4259-9a9a-a9f6ea5b5cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.429756 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-474de03e-c15c-4259-9a9a-a9f6ea5b5cb4 None None] MFA Rules not processed for user `f5631e7b4f1d4e0ba112ed5b3ba5f453`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:55.431127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-474de03e-c15c-4259-9a9a-a9f6ea5b5cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:55.446303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1263/2524] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:55.446303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62cdb3-e6cb-4118-9467-e079b10ef4f5 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:55.505100 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62cdb3-e6cb-4118-9467-e079b10ef4f5 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:55.507024 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:55.509430 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d049e-d6f7-4ef1-8175-23e1ab9d67fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:55.509745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1262/2525] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:55.510937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474de03e-c15c-4259-9a9a-a9f6ea5b5cb4 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:55.513708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d049e-d6f7-4ef1-8175-23e1ab9d67fb service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.514000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d049e-d6f7-4ef1-8175-23e1ab9d67fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.514305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d049e-d6f7-4ef1-8175-23e1ab9d67fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.521368 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474de03e-c15c-4259-9a9a-a9f6ea5b5cb4 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:55.524123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d049e-d6f7-4ef1-8175-23e1ab9d67fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:55.525551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d049e-d6f7-4ef1-8175-23e1ab9d67fb service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:55.526536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7defa5b-f5da-4658-acf6-25f0dbdf3356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:55.527256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defa5b-f5da-4658-acf6-25f0dbdf3356 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.527607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defa5b-f5da-4658-acf6-25f0dbdf3356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.527951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defa5b-f5da-4658-acf6-25f0dbdf3356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.528799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7defa5b-f5da-4658-acf6-25f0dbdf3356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:55.531807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7defa5b-f5da-4658-acf6-25f0dbdf3356 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:55.536794 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1264/2526] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:55.537607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d049e-d6f7-4ef1-8175-23e1ab9d67fb service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:55.548755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d049e-d6f7-4ef1-8175-23e1ab9d67fb service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:55.553969 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8d37e-4849-47af-be67-4d8f7ac0d7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:55.554844 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8d37e-4849-47af-be67-4d8f7ac0d7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.555518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8d37e-4849-47af-be67-4d8f7ac0d7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.555518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8d37e-4849-47af-be67-4d8f7ac0d7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.556077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8d37e-4849-47af-be67-4d8f7ac0d7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:55.558180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8d37e-4849-47af-be67-4d8f7ac0d7a9 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:55.673922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1263/2527] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:55 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:55.675888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7defa5b-f5da-4658-acf6-25f0dbdf3356 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:55.678597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a7defa5b-f5da-4658-acf6-25f0dbdf3356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:55.681524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1265/2528] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:55 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:55.681524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8d37e-4849-47af-be67-4d8f7ac0d7a9 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:55.743349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8d37e-4849-47af-be67-4d8f7ac0d7a9 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:55.746061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7defa5b-f5da-4658-acf6-25f0dbdf3356 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:55.748629 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c143f2-ea8b-4b91-aa41-e68ab245ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:55.749298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c143f2-ea8b-4b91-aa41-e68ab245ec6e admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.749581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c143f2-ea8b-4b91-aa41-e68ab245ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.749851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c143f2-ea8b-4b91-aa41-e68ab245ec6e admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.750574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c143f2-ea8b-4b91-aa41-e68ab245ec6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:55.751992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:55.752490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c143f2-ea8b-4b91-aa41-e68ab245ec6e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:55.752856 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.753141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.753422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] PATH_INFO: `/v3/projects/24375a75f27440f59177b10a1d4229ed` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.754639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] RBAC: Authorizing `identity:delete_project(project_id=24375a75f27440f59177b10a1d4229ed)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:55.759241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:55.874481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1266/2529] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:55 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:55.874481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c143f2-ea8b-4b91-aa41-e68ab245ec6e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:55.883105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c143f2-ea8b-4b91-aa41-e68ab245ec6e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:55.888323 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17875b79-dc81-4706-ba97-67e196c29a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:55.888991 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17875b79-dc81-4706-ba97-67e196c29a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:55.889281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17875b79-dc81-4706-ba97-67e196c29a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:55.889561 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17875b79-dc81-4706-ba97-67e196c29a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:55.890270 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17875b79-dc81-4706-ba97-67e196c29a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:55.893403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17875b79-dc81-4706-ba97-67e196c29a03 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:55.912676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24375a75f27440f59177b10a1d4229ed', 'request_id': 'req-39f13ca5-9064-4858-b222-904e0056f28e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.008026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24375a75f27440f59177b10a1d4229ed', 'request_id': 'req-39f13ca5-9064-4858-b222-904e0056f28e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.014331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1267/2530] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:55 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:56.019865 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17875b79-dc81-4706-ba97-67e196c29a03 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.020140 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24375a75f27440f59177b10a1d4229ed', 'request_id': 'req-39f13ca5-9064-4858-b222-904e0056f28e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.029242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17875b79-dc81-4706-ba97-67e196c29a03 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:56.033586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] The token cache is being invalidate because project 24375a75f27440f59177b10a1d4229ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:56.033881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.034657 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.036238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1264/2531] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:55 2022] DELETE /identity/v3/projects/24375a75f27440f59177b10a1d4229ed => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:56.039933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.041332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:56.051434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:56.092722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124aa7cb-baa4-4954-b977-de6ffdb44a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:56.093393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aa7cb-baa4-4954-b977-de6ffdb44a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.093683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aa7cb-baa4-4954-b977-de6ffdb44a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.093965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aa7cb-baa4-4954-b977-de6ffdb44a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.094730 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124aa7cb-baa4-4954-b977-de6ffdb44a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:56.096357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124aa7cb-baa4-4954-b977-de6ffdb44a81 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:56.105265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f13ca5-9064-4858-b222-904e0056f28e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:56.105985 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1268/2532] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:56.107417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124aa7cb-baa4-4954-b977-de6ffdb44a81 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.109038 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-124aa7cb-baa4-4954-b977-de6ffdb44a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:56.114045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:56.115073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.115354 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.115627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] PATH_INFO: `/v3/projects/75cd6c12481b47a895b7a1f98cf51349` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.116817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] RBAC: Authorizing `identity:delete_project(project_id=75cd6c12481b47a895b7a1f98cf51349)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:56.118787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:56.121190 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124aa7cb-baa4-4954-b977-de6ffdb44a81 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:56.126610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c5bda-1ee2-4ea2-92f2-1c96f59a87a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:56.127280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c5bda-1ee2-4ea2-92f2-1c96f59a87a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.127560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c5bda-1ee2-4ea2-92f2-1c96f59a87a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.127834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c5bda-1ee2-4ea2-92f2-1c96f59a87a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.128566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c5bda-1ee2-4ea2-92f2-1c96f59a87a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:56.130201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c5bda-1ee2-4ea2-92f2-1c96f59a87a7 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:56.145777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1269/2533] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:56.146835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c5bda-1ee2-4ea2-92f2-1c96f59a87a7 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.148723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-952c5bda-1ee2-4ea2-92f2-1c96f59a87a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:56.161159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c5bda-1ee2-4ea2-92f2-1c96f59a87a7 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:56.166021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:56.166830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.167117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.167395 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] PATH_INFO: `/v3/users/d51f40bb807149b0b77570644b29653a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.168580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51f40bb807149b0b77570644b29653a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:56.171281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:56.229737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75cd6c12481b47a895b7a1f98cf51349', 'request_id': 'req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.321256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75cd6c12481b47a895b7a1f98cf51349', 'request_id': 'req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.327563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75cd6c12481b47a895b7a1f98cf51349', 'request_id': 'req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.338642 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] The token cache is being invalidate because project 75cd6c12481b47a895b7a1f98cf51349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:56.338934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.339578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.341132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1265/2534] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:56 2022] DELETE /identity/v3/projects/75cd6c12481b47a895b7a1f98cf51349 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:56.341865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.343240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:56.363714 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51f40bb807149b0b77570644b29653a'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.364513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51f40bb807149b0b77570644b29653a'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.376826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51f40bb807149b0b77570644b29653a'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.405806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ef76a-a840-4d98-8dbd-6b3cf0f5ceed admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:56.410635 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987f982-7d0c-41c0-ab10-b8edb043947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:56.411532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987f982-7d0c-41c0-ab10-b8edb043947d admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.411818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987f982-7d0c-41c0-ab10-b8edb043947d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.412096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987f982-7d0c-41c0-ab10-b8edb043947d admin admin] PATH_INFO: `/v3/projects/7655c8b0af7d400e813935756a6fcd4b/users/a6a6b1a0ca5d4220a257148ebc262ee6/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.429648 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987f982-7d0c-41c0-ab10-b8edb043947d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7655c8b0af7d400e813935756a6fcd4b, user_id=a6a6b1a0ca5d4220a257148ebc262ee6, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:56.429648 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987f982-7d0c-41c0-ab10-b8edb043947d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:56.450536 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51f40bb807149b0b77570644b29653a'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.457702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51f40bb807149b0b77570644b29653a'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.463868 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1270/2535] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:56 2022] DELETE /identity/v3/users/d51f40bb807149b0b77570644b29653a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:56.464719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.466649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:56.484901 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:56.532205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18faf5-780f-465c-a3e5-54873186b7f2 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:56.534105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1266/2536] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:56 2022] PUT /identity/v3/projects/7655c8b0af7d400e813935756a6fcd4b/users/a6a6b1a0ca5d4220a257148ebc262ee6/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:56.535089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987f982-7d0c-41c0-ab10-b8edb043947d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.536722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3987f982-7d0c-41c0-ab10-b8edb043947d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:56.596870 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a69db-fd25-4ca4-971f-5dd630a0e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:56.597895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a69db-fd25-4ca4-971f-5dd630a0e111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.598528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a69db-fd25-4ca4-971f-5dd630a0e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.598938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a69db-fd25-4ca4-971f-5dd630a0e111 admin admin] PATH_INFO: `/v3/projects/0e1b0df0a0f74206bda991ac3767e2e9/users/468362fd7a0a4b3d829c8b25c496f220/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.601047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:56.616774 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987f982-7d0c-41c0-ab10-b8edb043947d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:56.617504 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a69db-fd25-4ca4-971f-5dd630a0e111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1b0df0a0f74206bda991ac3767e2e9, user_id=468362fd7a0a4b3d829c8b25c496f220, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:56.620249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a69db-fd25-4ca4-971f-5dd630a0e111 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:56.621639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8cd3e-8367-499d-a825-dc3ddad8d0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:56.622650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cd3e-8367-499d-a825-dc3ddad8d0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.622999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cd3e-8367-499d-a825-dc3ddad8d0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.623288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cd3e-8367-499d-a825-dc3ddad8d0b0 admin admin] PATH_INFO: `/v3/users/081d9a5334bb4062807cf355bc8290e3` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.624498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8cd3e-8367-499d-a825-dc3ddad8d0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=081d9a5334bb4062807cf355bc8290e3)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:56.626463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8cd3e-8367-499d-a825-dc3ddad8d0b0 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:56.696316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1271/2537] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:56 2022] PUT /identity/v3/projects/0e1b0df0a0f74206bda991ac3767e2e9/users/468362fd7a0a4b3d829c8b25c496f220/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:56.697173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a69db-fd25-4ca4-971f-5dd630a0e111 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.702024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-711a69db-fd25-4ca4-971f-5dd630a0e111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:56.770001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a69db-fd25-4ca4-971f-5dd630a0e111 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:56.775006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67e472-e6d9-4587-8627-5e9a11ed90ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:56.775672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67e472-e6d9-4587-8627-5e9a11ed90ee admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.776282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67e472-e6d9-4587-8627-5e9a11ed90ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.776282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67e472-e6d9-4587-8627-5e9a11ed90ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.776927 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67e472-e6d9-4587-8627-5e9a11ed90ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:56.779258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67e472-e6d9-4587-8627-5e9a11ed90ee admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:56.789121 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1272/2538] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:56.789989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67e472-e6d9-4587-8627-5e9a11ed90ee admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.800224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67e472-e6d9-4587-8627-5e9a11ed90ee admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:56.804873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a11b2a-b4bf-45bd-af12-5d4024157f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:56.805564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11b2a-b4bf-45bd-af12-5d4024157f99 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.805848 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11b2a-b4bf-45bd-af12-5d4024157f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.806151 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11b2a-b4bf-45bd-af12-5d4024157f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.806934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a11b2a-b4bf-45bd-af12-5d4024157f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:56.808497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a11b2a-b4bf-45bd-af12-5d4024157f99 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:56.818364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1273/2539] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:56.819756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a11b2a-b4bf-45bd-af12-5d4024157f99 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.830620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a11b2a-b4bf-45bd-af12-5d4024157f99 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:56.835301 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a770781-0287-421b-addb-d8f7ed1fdcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:56.836168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a770781-0287-421b-addb-d8f7ed1fdcdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.836450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a770781-0287-421b-addb-d8f7ed1fdcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.836726 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a770781-0287-421b-addb-d8f7ed1fdcdf admin admin] PATH_INFO: `/v3/projects/7655c8b0af7d400e813935756a6fcd4b/users/a6a6b1a0ca5d4220a257148ebc262ee6/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.838716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a770781-0287-421b-addb-d8f7ed1fdcdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7655c8b0af7d400e813935756a6fcd4b, user_id=a6a6b1a0ca5d4220a257148ebc262ee6, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:56.838893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-24e8cd3e-8367-499d-a825-dc3ddad8d0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081d9a5334bb4062807cf355bc8290e3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.839577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-24e8cd3e-8367-499d-a825-dc3ddad8d0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081d9a5334bb4062807cf355bc8290e3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.842037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a770781-0287-421b-addb-d8f7ed1fdcdf admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:56.852664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1274/2540] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:56 2022] PUT /identity/v3/projects/7655c8b0af7d400e813935756a6fcd4b/users/a6a6b1a0ca5d4220a257148ebc262ee6/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:56.853475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a770781-0287-421b-addb-d8f7ed1fdcdf admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.855061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7a770781-0287-421b-addb-d8f7ed1fdcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:56.905824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-24e8cd3e-8367-499d-a825-dc3ddad8d0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081d9a5334bb4062807cf355bc8290e3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.920254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-24e8cd3e-8367-499d-a825-dc3ddad8d0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081d9a5334bb4062807cf355bc8290e3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.924741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a770781-0287-421b-addb-d8f7ed1fdcdf admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:56.927172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-24e8cd3e-8367-499d-a825-dc3ddad8d0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081d9a5334bb4062807cf355bc8290e3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:56.929577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81483f1-c64b-4f3f-a86e-6b857721dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:56.930552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81483f1-c64b-4f3f-a86e-6b857721dda8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.930780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81483f1-c64b-4f3f-a86e-6b857721dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.931071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81483f1-c64b-4f3f-a86e-6b857721dda8 admin admin] PATH_INFO: `/v3/projects/0e1b0df0a0f74206bda991ac3767e2e9/users/468362fd7a0a4b3d829c8b25c496f220/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.933140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81483f1-c64b-4f3f-a86e-6b857721dda8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1b0df0a0f74206bda991ac3767e2e9, user_id=468362fd7a0a4b3d829c8b25c496f220, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:56.933450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1267/2541] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:53:56 2022] DELETE /identity/v3/users/081d9a5334bb4062807cf355bc8290e3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:56.936469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083306-d06a-4b6e-b027-74a6463c8308 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:56.936469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083306-d06a-4b6e-b027-74a6463c8308 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:56.936469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083306-d06a-4b6e-b027-74a6463c8308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:56.936747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81483f1-c64b-4f3f-a86e-6b857721dda8 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:56.947298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1275/2542] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:56 2022] PUT /identity/v3/projects/0e1b0df0a0f74206bda991ac3767e2e9/users/468362fd7a0a4b3d829c8b25c496f220/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:56.948213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81483f1-c64b-4f3f-a86e-6b857721dda8 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:56.949881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f81483f1-c64b-4f3f-a86e-6b857721dda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:56.973872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0b083306-d06a-4b6e-b027-74a6463c8308 None None] MFA Rules not processed for user `a6a6b1a0ca5d4220a257148ebc262ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:56.976016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0b083306-d06a-4b6e-b027-74a6463c8308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.031699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81483f1-c64b-4f3f-a86e-6b857721dda8 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:57.036524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:57.037403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.037762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.037963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] PATH_INFO: `/v3/projects/a4b19f4ab9844a489058119ed7fd55dd` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.039169 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b19f4ab9844a489058119ed7fd55dd)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:57.042122 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:57.049784 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1268/2543] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:57.051121 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead01b-cfeb-4575-beaa-a4ac43e3db04 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.051415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead01b-cfeb-4575-beaa-a4ac43e3db04 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.051686 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead01b-cfeb-4575-beaa-a4ac43e3db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.081167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-56ead01b-cfeb-4575-beaa-a4ac43e3db04 None None] MFA Rules not processed for user `468362fd7a0a4b3d829c8b25c496f220`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:57.082437 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-56ead01b-cfeb-4575-beaa-a4ac43e3db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.156008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b19f4ab9844a489058119ed7fd55dd', 'request_id': 'req-0e92464f-7864-4a3b-93d8-273b38da4369'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:57.156156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1269/2544] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:57.157433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ead01b-cfeb-4575-beaa-a4ac43e3db04 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:57.158710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-56ead01b-cfeb-4575-beaa-a4ac43e3db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.191148 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:57.227239 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ead01b-cfeb-4575-beaa-a4ac43e3db04 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:57.247756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b19f4ab9844a489058119ed7fd55dd', 'request_id': 'req-0e92464f-7864-4a3b-93d8-273b38da4369'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:57.254569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b19f4ab9844a489058119ed7fd55dd', 'request_id': 'req-0e92464f-7864-4a3b-93d8-273b38da4369'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:57.267748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] The token cache is being invalidate because project a4b19f4ab9844a489058119ed7fd55dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:57.267748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:57.268407 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:57.270223 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1276/2545] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:56 2022] DELETE /identity/v3/projects/a4b19f4ab9844a489058119ed7fd55dd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:57.274004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:57.275383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.280200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc401f-9f60-4583-a0e4-7f9b6d3ccc49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:57.281083 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc401f-9f60-4583-a0e4-7f9b6d3ccc49 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.281585 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc401f-9f60-4583-a0e4-7f9b6d3ccc49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.281859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc401f-9f60-4583-a0e4-7f9b6d3ccc49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.283699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5ddc401f-9f60-4583-a0e4-7f9b6d3ccc49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.288140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92464f-7864-4a3b-93d8-273b38da4369 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:57.294804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822ccfd-43e5-402c-bcf6-0b6e5f762579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:57.294804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822ccfd-43e5-402c-bcf6-0b6e5f762579 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.294804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822ccfd-43e5-402c-bcf6-0b6e5f762579 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.294804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822ccfd-43e5-402c-bcf6-0b6e5f762579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.295194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7822ccfd-43e5-402c-bcf6-0b6e5f762579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.339691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:57.341502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc401f-9f60-4583-a0e4-7f9b6d3ccc49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:57.343041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc401f-9f60-4583-a0e4-7f9b6d3ccc49 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:57.352025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1270/2546] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:57.353280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163628d-808e-4cef-8116-5a8a1a8bba7f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.353574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163628d-808e-4cef-8116-5a8a1a8bba7f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.353854 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163628d-808e-4cef-8116-5a8a1a8bba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.359905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822ccfd-43e5-402c-bcf6-0b6e5f762579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:57.361424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822ccfd-43e5-402c-bcf6-0b6e5f762579 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:57.372604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1277/2547] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:57.375018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c163628d-808e-4cef-8116-5a8a1a8bba7f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:57.376223 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c163628d-808e-4cef-8116-5a8a1a8bba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.378385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822ccfd-43e5-402c-bcf6-0b6e5f762579 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:57.379970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7822ccfd-43e5-402c-bcf6-0b6e5f762579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.469540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822ccfd-43e5-402c-bcf6-0b6e5f762579 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:57.475439 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:57.476383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.476630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.476967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] PATH_INFO: `/v3/projects/4134af7a7fa54c5093d084cc8c45a37f` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.478163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4134af7a7fa54c5093d084cc8c45a37f)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:57.480923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:57.486439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1271/2548] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:57.495735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d1ba8-21c5-4e6d-8cad-b26409517bf7 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.495735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d1ba8-21c5-4e6d-8cad-b26409517bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.495935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d1ba8-21c5-4e6d-8cad-b26409517bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.515311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-b36d1ba8-21c5-4e6d-8cad-b26409517bf7 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:57.520786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b36d1ba8-21c5-4e6d-8cad-b26409517bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.524574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1272/2549] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:57.525358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d1ba8-21c5-4e6d-8cad-b26409517bf7 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:57.536070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d1ba8-21c5-4e6d-8cad-b26409517bf7 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:57.539659 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767d293-1cc1-4b0c-b4f7-2f7d9948ff6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:57.540289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767d293-1cc1-4b0c-b4f7-2f7d9948ff6d service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.540575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767d293-1cc1-4b0c-b4f7-2f7d9948ff6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.540851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767d293-1cc1-4b0c-b4f7-2f7d9948ff6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.542866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9767d293-1cc1-4b0c-b4f7-2f7d9948ff6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.600285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767d293-1cc1-4b0c-b4f7-2f7d9948ff6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:57.601715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767d293-1cc1-4b0c-b4f7-2f7d9948ff6d service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:57.611116 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1273/2550] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:53:57.611898 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767d293-1cc1-4b0c-b4f7-2f7d9948ff6d service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:57.622950 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767d293-1cc1-4b0c-b4f7-2f7d9948ff6d service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:57.630822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4134af7a7fa54c5093d084cc8c45a37f', 'request_id': 'req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:57.681187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796af3c-2dda-4c1c-a7a6-cd765f38a4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:57.681854 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796af3c-2dda-4c1c-a7a6-cd765f38a4de admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.682135 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796af3c-2dda-4c1c-a7a6-cd765f38a4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.682441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796af3c-2dda-4c1c-a7a6-cd765f38a4de admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.683195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796af3c-2dda-4c1c-a7a6-cd765f38a4de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:53:57.683498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796af3c-2dda-4c1c-a7a6-cd765f38a4de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:57.685960 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796af3c-2dda-4c1c-a7a6-cd765f38a4de admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:57.697614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1274/2551] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:53:57.702424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796af3c-2dda-4c1c-a7a6-cd765f38a4de admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:57.712501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796af3c-2dda-4c1c-a7a6-cd765f38a4de admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:57.717360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362084e-de99-4aff-bdfa-3f29daf13c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:57.718006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362084e-de99-4aff-bdfa-3f29daf13c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.718349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362084e-de99-4aff-bdfa-3f29daf13c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.718618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362084e-de99-4aff-bdfa-3f29daf13c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.719312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362084e-de99-4aff-bdfa-3f29daf13c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:57.721205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362084e-de99-4aff-bdfa-3f29daf13c7e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:57.758832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4134af7a7fa54c5093d084cc8c45a37f', 'request_id': 'req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:57.768849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4134af7a7fa54c5093d084cc8c45a37f', 'request_id': 'req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:57.776599 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] The token cache is being invalidate because project 4134af7a7fa54c5093d084cc8c45a37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:53:57.776888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:57.777560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-006b00d8-2a97-4dd5-9134-9d463fbe8ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:53:57.779224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1278/2552] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:53:57 2022] DELETE /identity/v3/projects/4134af7a7fa54c5093d084cc8c45a37f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:57.783869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b103d-33c7-490a-a0b8-e3dd437060ad None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.784160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b103d-33c7-490a-a0b8-e3dd437060ad None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.784441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b103d-33c7-490a-a0b8-e3dd437060ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.803869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-fc4b103d-33c7-490a-a0b8-e3dd437060ad None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:57.805069 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-fc4b103d-33c7-490a-a0b8-e3dd437060ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.814992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1279/2553] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:57.818628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1275/2554] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:57 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:57.822373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362084e-de99-4aff-bdfa-3f29daf13c7e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:57.822664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61fe8-741a-484a-8c33-bff8ef45970d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.822954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61fe8-741a-484a-8c33-bff8ef45970d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.823226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61fe8-741a-484a-8c33-bff8ef45970d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.824041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3362084e-de99-4aff-bdfa-3f29daf13c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.850318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-27f61fe8-741a-484a-8c33-bff8ef45970d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:57.851663 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-27f61fe8-741a-484a-8c33-bff8ef45970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:57.895539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362084e-de99-4aff-bdfa-3f29daf13c7e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:57.900513 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9fb03-fe95-4a93-945c-7e418337e8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:57.901186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9fb03-fe95-4a93-945c-7e418337e8ae admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.904152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9fb03-fe95-4a93-945c-7e418337e8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.904152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9fb03-fe95-4a93-945c-7e418337e8ae admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.904152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9fb03-fe95-4a93-945c-7e418337e8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:57.904861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9fb03-fe95-4a93-945c-7e418337e8ae admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:57.915538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1280/2555] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:57.920294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f61fe8-741a-484a-8c33-bff8ef45970d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:57.929177 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f61fe8-741a-484a-8c33-bff8ef45970d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:57.933836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4298a-0520-4b5d-9a3c-a5858fc46c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:57.934551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4298a-0520-4b5d-9a3c-a5858fc46c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.934833 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4298a-0520-4b5d-9a3c-a5858fc46c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.935107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4298a-0520-4b5d-9a3c-a5858fc46c7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.935822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4298a-0520-4b5d-9a3c-a5858fc46c7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:53:57.936127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4298a-0520-4b5d-9a3c-a5858fc46c7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:57.937744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4298a-0520-4b5d-9a3c-a5858fc46c7b admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:57.949753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1281/2556] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:53:57.954262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4298a-0520-4b5d-9a3c-a5858fc46c7b admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:57.964314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4298a-0520-4b5d-9a3c-a5858fc46c7b admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:57.969830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a23a3-0365-464e-9ecb-0fbd0c47cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:57.970577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a23a3-0365-464e-9ecb-0fbd0c47cefd admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:57.970996 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a23a3-0365-464e-9ecb-0fbd0c47cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:57.971281 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a23a3-0365-464e-9ecb-0fbd0c47cefd admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:57.971968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a23a3-0365-464e-9ecb-0fbd0c47cefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:57.973901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a23a3-0365-464e-9ecb-0fbd0c47cefd admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.002107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1276/2557] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:57 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:58.006092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9fb03-fe95-4a93-945c-7e418337e8ae admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.015750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9fb03-fe95-4a93-945c-7e418337e8ae admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.020305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aafda-0749-4341-b3fc-8b882527feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.021026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aafda-0749-4341-b3fc-8b882527feaa admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.021311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aafda-0749-4341-b3fc-8b882527feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.021676 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aafda-0749-4341-b3fc-8b882527feaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.022430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aafda-0749-4341-b3fc-8b882527feaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.022931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:58.024186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aafda-0749-4341-b3fc-8b882527feaa admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.034568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1277/2558] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:58.038347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aafda-0749-4341-b3fc-8b882527feaa admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.048297 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aafda-0749-4341-b3fc-8b882527feaa admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.057476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e13218-c7d1-4edc-a4b6-8abbb926edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.057476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e13218-c7d1-4edc-a4b6-8abbb926edaa admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.057476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e13218-c7d1-4edc-a4b6-8abbb926edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.057476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e13218-c7d1-4edc-a4b6-8abbb926edaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.057865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e13218-c7d1-4edc-a4b6-8abbb926edaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.057865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e13218-c7d1-4edc-a4b6-8abbb926edaa admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.066018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1278/2559] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:58.069760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e13218-c7d1-4edc-a4b6-8abbb926edaa admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.077860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1282/2560] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:57 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:58.080986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e13218-c7d1-4edc-a4b6-8abbb926edaa admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.083641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a23a3-0365-464e-9ecb-0fbd0c47cefd admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.144572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2ae9e-f4fc-4c5f-8e95-b4d2618a197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.145722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2ae9e-f4fc-4c5f-8e95-b4d2618a197a admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.146027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2ae9e-f4fc-4c5f-8e95-b4d2618a197a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.146330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2ae9e-f4fc-4c5f-8e95-b4d2618a197a admin admin] PATH_INFO: `/v3/projects/064027a1e1b54b48bc8e3bb324e65c60/users/aace7e9627544c60abb9c053efb80125/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.162719 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2ae9e-f4fc-4c5f-8e95-b4d2618a197a admin admin] RBAC: Authorizing `identity:create_grant(project_id=064027a1e1b54b48bc8e3bb324e65c60, user_id=aace7e9627544c60abb9c053efb80125, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.165385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2ae9e-f4fc-4c5f-8e95-b4d2618a197a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.178692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a23a3-0365-464e-9ecb-0fbd0c47cefd admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.183414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430e57a-33de-4cd4-9eba-45bf343da974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.184083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430e57a-33de-4cd4-9eba-45bf343da974 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.184372 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430e57a-33de-4cd4-9eba-45bf343da974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.184698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430e57a-33de-4cd4-9eba-45bf343da974 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.185390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430e57a-33de-4cd4-9eba-45bf343da974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.187378 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430e57a-33de-4cd4-9eba-45bf343da974 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.240556 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1279/2561] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:58 2022] PUT /identity/v3/projects/064027a1e1b54b48bc8e3bb324e65c60/users/aace7e9627544c60abb9c053efb80125/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:58.251475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced4f51-db7f-42e8-ab2c-82cc35d61ac0 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.251854 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced4f51-db7f-42e8-ab2c-82cc35d61ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.252066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced4f51-db7f-42e8-ab2c-82cc35d61ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.261373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1283/2562] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:58 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:58.267974 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430e57a-33de-4cd4-9eba-45bf343da974 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.279528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430e57a-33de-4cd4-9eba-45bf343da974 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.294565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:58.296402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-dced4f51-db7f-42e8-ab2c-82cc35d61ac0 None None] MFA Rules not processed for user `aace7e9627544c60abb9c053efb80125`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:58.298395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-dced4f51-db7f-42e8-ab2c-82cc35d61ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:58.348242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c018ce6-b447-47f8-9800-8cd7f1545561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.349218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c018ce6-b447-47f8-9800-8cd7f1545561 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.349782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c018ce6-b447-47f8-9800-8cd7f1545561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.351270 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c018ce6-b447-47f8-9800-8cd7f1545561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.352182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c018ce6-b447-47f8-9800-8cd7f1545561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.355698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c018ce6-b447-47f8-9800-8cd7f1545561 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.368574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1284/2563] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:58.372963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1280/2564] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:53:58.373153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c018ce6-b447-47f8-9800-8cd7f1545561 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.376092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced4f51-db7f-42e8-ab2c-82cc35d61ac0 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.383714 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c018ce6-b447-47f8-9800-8cd7f1545561 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.389678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaae50-4006-4364-afbe-476442d2c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.390382 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaae50-4006-4364-afbe-476442d2c770 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.390671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaae50-4006-4364-afbe-476442d2c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.390953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaae50-4006-4364-afbe-476442d2c770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.391682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acaae50-4006-4364-afbe-476442d2c770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.393415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acaae50-4006-4364-afbe-476442d2c770 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.396570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced4f51-db7f-42e8-ab2c-82cc35d61ac0 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.401616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed9bd-b9a2-4dd9-bf0c-98aef9677a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.402622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed9bd-b9a2-4dd9-bf0c-98aef9677a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.402913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed9bd-b9a2-4dd9-bf0c-98aef9677a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.404018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed9bd-b9a2-4dd9-bf0c-98aef9677a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.404602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed9bd-b9a2-4dd9-bf0c-98aef9677a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.404926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1285/2565] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:53:58.406642 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed9bd-b9a2-4dd9-bf0c-98aef9677a9d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.415062 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaae50-4006-4364-afbe-476442d2c770 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.420876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaae50-4006-4364-afbe-476442d2c770 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.426008 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6471a2-3881-4771-9396-9f4e3ca0ac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.426920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6471a2-3881-4771-9396-9f4e3ca0ac95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.427207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6471a2-3881-4771-9396-9f4e3ca0ac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.427483 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6471a2-3881-4771-9396-9f4e3ca0ac95 admin admin] PATH_INFO: `/v3/projects/b6bd5e3fe2db47f4990e6662e3ca29c3/users/04c4d0820574464099e60883d12740a5/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.443496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6471a2-3881-4771-9396-9f4e3ca0ac95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bd5e3fe2db47f4990e6662e3ca29c3, user_id=04c4d0820574464099e60883d12740a5, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.446174 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6471a2-3881-4771-9396-9f4e3ca0ac95 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.526639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1281/2566] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:58 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:53:58.532591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed9bd-b9a2-4dd9-bf0c-98aef9677a9d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.550790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1286/2567] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:58 2022] PUT /identity/v3/projects/b6bd5e3fe2db47f4990e6662e3ca29c3/users/04c4d0820574464099e60883d12740a5/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:53:58.558279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0925-8bde-425d-8cd6-52e29f4332e2 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.558576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0925-8bde-425d-8cd6-52e29f4332e2 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.558858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0925-8bde-425d-8cd6-52e29f4332e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.585888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-0dbe0925-8bde-425d-8cd6-52e29f4332e2 None None] MFA Rules not processed for user `04c4d0820574464099e60883d12740a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:58.587235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0dbe0925-8bde-425d-8cd6-52e29f4332e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:58.602306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed9bd-b9a2-4dd9-bf0c-98aef9677a9d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.652275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1287/2568] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:58.656801 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe0925-8bde-425d-8cd6-52e29f4332e2 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.660966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419df6a6-0e4b-4b13-94f2-87347e2b741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.661650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419df6a6-0e4b-4b13-94f2-87347e2b741d admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.661935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419df6a6-0e4b-4b13-94f2-87347e2b741d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.662211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419df6a6-0e4b-4b13-94f2-87347e2b741d admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.663040 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419df6a6-0e4b-4b13-94f2-87347e2b741d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.664947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419df6a6-0e4b-4b13-94f2-87347e2b741d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.667693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe0925-8bde-425d-8cd6-52e29f4332e2 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.672698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53352d-b0be-43e1-b2ac-fbb781ad4009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.674840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53352d-b0be-43e1-b2ac-fbb781ad4009 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.674840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53352d-b0be-43e1-b2ac-fbb781ad4009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.674840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53352d-b0be-43e1-b2ac-fbb781ad4009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.675526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53352d-b0be-43e1-b2ac-fbb781ad4009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.677542 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53352d-b0be-43e1-b2ac-fbb781ad4009 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.790282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1282/2569] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:58 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:58.794204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419df6a6-0e4b-4b13-94f2-87347e2b741d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.803812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419df6a6-0e4b-4b13-94f2-87347e2b741d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.808459 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919073d-00e9-4636-bdb6-3265ad692eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.809112 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919073d-00e9-4636-bdb6-3265ad692eab admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.809381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919073d-00e9-4636-bdb6-3265ad692eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.810162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919073d-00e9-4636-bdb6-3265ad692eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.810967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919073d-00e9-4636-bdb6-3265ad692eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.812563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919073d-00e9-4636-bdb6-3265ad692eab admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.820475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1288/2570] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:58 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:58.824460 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53352d-b0be-43e1-b2ac-fbb781ad4009 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.827453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1283/2571] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:58.831392 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919073d-00e9-4636-bdb6-3265ad692eab admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:58.844305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919073d-00e9-4636-bdb6-3265ad692eab admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.891491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53352d-b0be-43e1-b2ac-fbb781ad4009 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:58.896229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17344ade-5661-43b4-8b30-02e4217fade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.896945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344ade-5661-43b4-8b30-02e4217fade1 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.897425 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344ade-5661-43b4-8b30-02e4217fade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.897937 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344ade-5661-43b4-8b30-02e4217fade1 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.899781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:58.899906 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276e829-76aa-4136-869a-ba072e6f37cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:58.902191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17344ade-5661-43b4-8b30-02e4217fade1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.902328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e829-76aa-4136-869a-ba072e6f37cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:58.902328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e829-76aa-4136-869a-ba072e6f37cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:58.902328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e829-76aa-4136-869a-ba072e6f37cf admin admin] PATH_INFO: `/v3/projects/2ef023dbb8a14f409e4d3f8fd4134ea3/users/c9d6b68dfa8346ecbc99192d75fd8345/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:58.902706 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17344ade-5661-43b4-8b30-02e4217fade1 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.916352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276e829-76aa-4136-869a-ba072e6f37cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef023dbb8a14f409e4d3f8fd4134ea3, user_id=c9d6b68dfa8346ecbc99192d75fd8345, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:58.919049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276e829-76aa-4136-869a-ba072e6f37cf admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:58.978906 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:59.007109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1284/2572] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:58 2022] PUT /identity/v3/projects/2ef023dbb8a14f409e4d3f8fd4134ea3/users/c9d6b68dfa8346ecbc99192d75fd8345/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:59.010220 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1289/2573] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:58 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:59.010980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276e829-76aa-4136-869a-ba072e6f37cf admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:59.011264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17344ade-5661-43b4-8b30-02e4217fade1 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:59.021026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17344ade-5661-43b4-8b30-02e4217fade1 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:59.072102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276e829-76aa-4136-869a-ba072e6f37cf admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:59.077252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a8be9-7913-47d5-9cc5-b836bb692622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:59.077421 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cb8b7-5a8b-4422-acde-a509f56337b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:59.077912 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a8be9-7913-47d5-9cc5-b836bb692622 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.079888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cb8b7-5a8b-4422-acde-a509f56337b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.079996 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a8be9-7913-47d5-9cc5-b836bb692622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.079996 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a8be9-7913-47d5-9cc5-b836bb692622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.080163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cb8b7-5a8b-4422-acde-a509f56337b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.080163 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cb8b7-5a8b-4422-acde-a509f56337b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.080359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a8be9-7913-47d5-9cc5-b836bb692622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:59.080460 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cb8b7-5a8b-4422-acde-a509f56337b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:59.080781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a8be9-7913-47d5-9cc5-b836bb692622 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:59.081106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cb8b7-5a8b-4422-acde-a509f56337b4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:59.093727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1285/2574] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:59.093903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1290/2575] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:59.094822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a8be9-7913-47d5-9cc5-b836bb692622 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:59.094981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cb8b7-5a8b-4422-acde-a509f56337b4 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:59.104663 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a8be9-7913-47d5-9cc5-b836bb692622 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:59.114394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cb8b7-5a8b-4422-acde-a509f56337b4 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:59.114537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b2358-4cb1-46be-8879-5c8210f46afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:59.114678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d2542-d154-43ca-bcc1-dad16f405953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:59.114787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b2358-4cb1-46be-8879-5c8210f46afc admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.114787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b2358-4cb1-46be-8879-5c8210f46afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.114954 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2542-d154-43ca-bcc1-dad16f405953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.115073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b2358-4cb1-46be-8879-5c8210f46afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.115173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2542-d154-43ca-bcc1-dad16f405953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.115173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2542-d154-43ca-bcc1-dad16f405953 admin admin] PATH_INFO: `/v3/projects/2ef023dbb8a14f409e4d3f8fd4134ea3/users/c9d6b68dfa8346ecbc99192d75fd8345/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.115337 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b2358-4cb1-46be-8879-5c8210f46afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:59.115424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d2542-d154-43ca-bcc1-dad16f405953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef023dbb8a14f409e4d3f8fd4134ea3, user_id=c9d6b68dfa8346ecbc99192d75fd8345, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:59.115522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b2358-4cb1-46be-8879-5c8210f46afc admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:59.116304 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d2542-d154-43ca-bcc1-dad16f405953 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:59.130436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1286/2576] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:59.130641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1291/2577] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:59 2022] PUT /identity/v3/projects/2ef023dbb8a14f409e4d3f8fd4134ea3/users/c9d6b68dfa8346ecbc99192d75fd8345/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:53:59.131442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b2358-4cb1-46be-8879-5c8210f46afc admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:59.140929 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b5a1d-6eaa-4393-8732-4698450175cd None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.141218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b5a1d-6eaa-4393-8732-4698450175cd None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.141499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b5a1d-6eaa-4393-8732-4698450175cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.143113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b2358-4cb1-46be-8879-5c8210f46afc admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:59.169680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a73b5a1d-6eaa-4393-8732-4698450175cd None None] MFA Rules not processed for user `c9d6b68dfa8346ecbc99192d75fd8345`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:59.170926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a73b5a1d-6eaa-4393-8732-4698450175cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:59.207293 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821fd14-c8b9-4da2-9bdd-4958d2951cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:59.208226 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821fd14-c8b9-4da2-9bdd-4958d2951cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.212993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821fd14-c8b9-4da2-9bdd-4958d2951cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.212993 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821fd14-c8b9-4da2-9bdd-4958d2951cb9 admin admin] PATH_INFO: `/v3/projects/9ef9dfdc845d403380cbbbc50cff5888/users/4ffee4f06f934b2d9ed104c0ad8a6c3f/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.228232 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821fd14-c8b9-4da2-9bdd-4958d2951cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef9dfdc845d403380cbbbc50cff5888, user_id=4ffee4f06f934b2d9ed104c0ad8a6c3f, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:59.229545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:59.233264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821fd14-c8b9-4da2-9bdd-4958d2951cb9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:59.260447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1292/2578] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:59.272260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b5a1d-6eaa-4393-8732-4698450175cd None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:59.273707 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a73b5a1d-6eaa-4393-8732-4698450175cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:59.329964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b5a1d-6eaa-4393-8732-4698450175cd None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:59.330638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1287/2579] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:59 2022] PUT /identity/v3/projects/9ef9dfdc845d403380cbbbc50cff5888/users/4ffee4f06f934b2d9ed104c0ad8a6c3f/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:53:59.342025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773f88a-4051-42af-b773-b51447203901 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.342345 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773f88a-4051-42af-b773-b51447203901 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.342622 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773f88a-4051-42af-b773-b51447203901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.369259 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-6773f88a-4051-42af-b773-b51447203901 None None] MFA Rules not processed for user `4ffee4f06f934b2d9ed104c0ad8a6c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:53:59.370571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6773f88a-4051-42af-b773-b51447203901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:53:59.381828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3117cd2-e785-42d5-9ab1-e08a7f71f1d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:59.382529 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117cd2-e785-42d5-9ab1-e08a7f71f1d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.382797 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117cd2-e785-42d5-9ab1-e08a7f71f1d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.383075 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117cd2-e785-42d5-9ab1-e08a7f71f1d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.430840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:59.435236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1288/2580] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:53:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:53:59.439570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773f88a-4051-42af-b773-b51447203901 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:59.448600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3117cd2-e785-42d5-9ab1-e08a7f71f1d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:59.450329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3117cd2-e785-42d5-9ab1-e08a7f71f1d5 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:59.460197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1293/2581] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:53:59.484990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:59.509660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773f88a-4051-42af-b773-b51447203901 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:59.510693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86856c48-0fa4-4b31-9295-f6c53f998ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:59.511542 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86856c48-0fa4-4b31-9295-f6c53f998ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.511682 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86856c48-0fa4-4b31-9295-f6c53f998ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.511920 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86856c48-0fa4-4b31-9295-f6c53f998ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.512644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86856c48-0fa4-4b31-9295-f6c53f998ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:59.514572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86856c48-0fa4-4b31-9295-f6c53f998ed4 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:59.622016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3117cd2-e785-42d5-9ab1-e08a7f71f1d5 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:59.630795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3117cd2-e785-42d5-9ab1-e08a7f71f1d5 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:59.634551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd8340-b287-4774-9d4a-4c72cd1c9155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:59.635182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd8340-b287-4774-9d4a-4c72cd1c9155 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.635462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd8340-b287-4774-9d4a-4c72cd1c9155 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.635733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd8340-b287-4774-9d4a-4c72cd1c9155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.651984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1289/2582] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:53:59 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:59.660085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86856c48-0fa4-4b31-9295-f6c53f998ed4 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:59.693115 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd8340-b287-4774-9d4a-4c72cd1c9155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:59.694577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd8340-b287-4774-9d4a-4c72cd1c9155 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:59.706708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1294/2583] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:53:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:53:59.726014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86856c48-0fa4-4b31-9295-f6c53f998ed4 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:59.732033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc0ce4-1cd7-4e56-a8b3-f75af08069cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:59.732715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc0ce4-1cd7-4e56-a8b3-f75af08069cf admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.732999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc0ce4-1cd7-4e56-a8b3-f75af08069cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.733280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc0ce4-1cd7-4e56-a8b3-f75af08069cf admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.733972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc0ce4-1cd7-4e56-a8b3-f75af08069cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:59.736203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc0ce4-1cd7-4e56-a8b3-f75af08069cf admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:59.830976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1290/2584] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:53:59 2022] POST /identity/v3/users => generated 300 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:53:59.836147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd8340-b287-4774-9d4a-4c72cd1c9155 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:59.849959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd8340-b287-4774-9d4a-4c72cd1c9155 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:59.854825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6472812-09bf-4afa-99aa-d682bfaef464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:59.855576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6472812-09bf-4afa-99aa-d682bfaef464 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.855860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6472812-09bf-4afa-99aa-d682bfaef464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.856134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6472812-09bf-4afa-99aa-d682bfaef464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.856892 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6472812-09bf-4afa-99aa-d682bfaef464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:59.858563 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6472812-09bf-4afa-99aa-d682bfaef464 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:59.868531 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1295/2585] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:53:59.872809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc0ce4-1cd7-4e56-a8b3-f75af08069cf admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:53:59.882723 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc0ce4-1cd7-4e56-a8b3-f75af08069cf admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:53:59.887404 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710050-0790-4635-9111-cf40444cb39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:53:59.888810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710050-0790-4635-9111-cf40444cb39e admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:53:59.889097 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710050-0790-4635-9111-cf40444cb39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:53:59.889390 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710050-0790-4635-9111-cf40444cb39e admin admin] PATH_INFO: `/v3/projects/f853166a973744ec8cd413755127b45f/users/140d62a1318d45d4966147326147f985/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:53:59.905004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85710050-0790-4635-9111-cf40444cb39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f853166a973744ec8cd413755127b45f, user_id=140d62a1318d45d4966147326147f985, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:53:59.907853 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85710050-0790-4635-9111-cf40444cb39e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:53:59.913699 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:53:59.994349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:00.001403 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1291/2586] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:53:59 2022] PUT /identity/v3/projects/f853166a973744ec8cd413755127b45f/users/140d62a1318d45d4966147326147f985/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:00.005495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6472812-09bf-4afa-99aa-d682bfaef464 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:00.016665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6472812-09bf-4afa-99aa-d682bfaef464 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:00.070319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e57ac-6459-47ec-9cf2-23654126f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:00.070973 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e57ac-6459-47ec-9cf2-23654126f27c admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:00.071259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e57ac-6459-47ec-9cf2-23654126f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:00.071537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e57ac-6459-47ec-9cf2-23654126f27c admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:00.072249 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e57ac-6459-47ec-9cf2-23654126f27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:00.073842 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e57ac-6459-47ec-9cf2-23654126f27c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:00.083694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1296/2587] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:00.091615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710050-0790-4635-9111-cf40444cb39e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:00.099638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710050-0790-4635-9111-cf40444cb39e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:00.104404 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca765c-52fc-44ea-ac40-fd16220cdd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:00.105235 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca765c-52fc-44ea-ac40-fd16220cdd9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:00.105528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca765c-52fc-44ea-ac40-fd16220cdd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:00.105889 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca765c-52fc-44ea-ac40-fd16220cdd9f admin admin] PATH_INFO: `/v3/projects/f853166a973744ec8cd413755127b45f/users/140d62a1318d45d4966147326147f985/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:00.107835 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca765c-52fc-44ea-ac40-fd16220cdd9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f853166a973744ec8cd413755127b45f, user_id=140d62a1318d45d4966147326147f985, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:00.110726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca765c-52fc-44ea-ac40-fd16220cdd9f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:00.127216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1292/2588] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:00 2022] PUT /identity/v3/projects/f853166a973744ec8cd413755127b45f/users/140d62a1318d45d4966147326147f985/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:00.142290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58c5f0-11c0-4467-a2bb-9d41a5660e45 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:00.142290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58c5f0-11c0-4467-a2bb-9d41a5660e45 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:00.142290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58c5f0-11c0-4467-a2bb-9d41a5660e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:00.167181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ed58c5f0-11c0-4467-a2bb-9d41a5660e45 None None] MFA Rules not processed for user `140d62a1318d45d4966147326147f985`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:00.168403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ed58c5f0-11c0-4467-a2bb-9d41a5660e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:00.239034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1297/2589] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:00.251715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca765c-52fc-44ea-ac40-fd16220cdd9f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:00.254178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-1aca765c-52fc-44ea-ac40-fd16220cdd9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:00.310503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca765c-52fc-44ea-ac40-fd16220cdd9f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:00.314174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ce94e-5d15-43e8-a62a-41e95f744363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:00.314859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ce94e-5d15-43e8-a62a-41e95f744363 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:00.315146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ce94e-5d15-43e8-a62a-41e95f744363 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:00.319423 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ce94e-5d15-43e8-a62a-41e95f744363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:00.324318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ce94e-5d15-43e8-a62a-41e95f744363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:00.326624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ce94e-5d15-43e8-a62a-41e95f744363 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:00.335866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1293/2590] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:00.384462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:00.516113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:01.469533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58c5f0-11c0-4467-a2bb-9d41a5660e45 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:01.479047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58c5f0-11c0-4467-a2bb-9d41a5660e45 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:01.482602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0adf3f-46d0-4ee7-a5d6-b4ddcd2f907f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:01.483241 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adf3f-46d0-4ee7-a5d6-b4ddcd2f907f service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:01.483526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adf3f-46d0-4ee7-a5d6-b4ddcd2f907f service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:01.483803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adf3f-46d0-4ee7-a5d6-b4ddcd2f907f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:01.537457 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:01.540000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0adf3f-46d0-4ee7-a5d6-b4ddcd2f907f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:01.541415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0adf3f-46d0-4ee7-a5d6-b4ddcd2f907f service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:01.550356 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1298/2591] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:02.965907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ce94e-5d15-43e8-a62a-41e95f744363 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:02.974745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ce94e-5d15-43e8-a62a-41e95f744363 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:02.978406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6614b-5b44-402d-8a25-fe1c73c28697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:02.979042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6614b-5b44-402d-8a25-fe1c73c28697 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:02.979325 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6614b-5b44-402d-8a25-fe1c73c28697 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:02.983999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6614b-5b44-402d-8a25-fe1c73c28697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:02.983999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fcf6614b-5b44-402d-8a25-fe1c73c28697 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:03.009570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:03.044838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6614b-5b44-402d-8a25-fe1c73c28697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:03.046263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6614b-5b44-402d-8a25-fe1c73c28697 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:03.055764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1294/2592] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:04.339540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0adf3f-46d0-4ee7-a5d6-b4ddcd2f907f service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:04.342880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1a0adf3f-46d0-4ee7-a5d6-b4ddcd2f907f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:04.405868 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0adf3f-46d0-4ee7-a5d6-b4ddcd2f907f service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:04.410398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:04.411280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:04.411556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:04.411834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] PATH_INFO: `/v3/users/f5631e7b4f1d4e0ba112ed5b3ba5f453` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:04.413247 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5631e7b4f1d4e0ba112ed5b3ba5f453)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:04.415258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:04.586672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5631e7b4f1d4e0ba112ed5b3ba5f453'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:04.587312 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5631e7b4f1d4e0ba112ed5b3ba5f453'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:04.599134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5631e7b4f1d4e0ba112ed5b3ba5f453'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:04.702510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5631e7b4f1d4e0ba112ed5b3ba5f453'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:04.710562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5631e7b4f1d4e0ba112ed5b3ba5f453'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:04.717196 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1299/2593] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:04 2022] DELETE /identity/v3/users/f5631e7b4f1d4e0ba112ed5b3ba5f453 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:04.721650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044ea21-3292-4fac-ab92-91f122dde3a9 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:04.722341 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044ea21-3292-4fac-ab92-91f122dde3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:04.722341 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044ea21-3292-4fac-ab92-91f122dde3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:04.739666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-3044ea21-3292-4fac-ab92-91f122dde3a9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:04.740881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3044ea21-3292-4fac-ab92-91f122dde3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:04.783551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:04.785234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:04.811378 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1295/2594] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:04.821190 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044ea21-3292-4fac-ab92-91f122dde3a9 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:04.822599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3044ea21-3292-4fac-ab92-91f122dde3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:04.855898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b20e8-6bca-41fe-b791-4e0d28efce2e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:04.861605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:04.862510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:04.862800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:04.863079 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] PATH_INFO: `/v3/users/aace7e9627544c60abb9c053efb80125` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:04.864289 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=aace7e9627544c60abb9c053efb80125)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:04.866341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:04.884154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:04.887172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044ea21-3292-4fac-ab92-91f122dde3a9 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:04.891643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8145a5-f7b0-4e1f-8f8b-5d56aa9099fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:04.892751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8145a5-f7b0-4e1f-8f8b-5d56aa9099fd service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:04.893173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8145a5-f7b0-4e1f-8f8b-5d56aa9099fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:04.893707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8145a5-f7b0-4e1f-8f8b-5d56aa9099fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:04.904176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8145a5-f7b0-4e1f-8f8b-5d56aa9099fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:04.905589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8145a5-f7b0-4e1f-8f8b-5d56aa9099fd service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:04.916168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1296/2595] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:05.154446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aace7e9627544c60abb9c053efb80125'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.155285 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aace7e9627544c60abb9c053efb80125'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.167777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aace7e9627544c60abb9c053efb80125'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.238846 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aace7e9627544c60abb9c053efb80125'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.246431 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aace7e9627544c60abb9c053efb80125'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.253605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1300/2596] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:04 2022] DELETE /identity/v3/users/aace7e9627544c60abb9c053efb80125 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:05.258654 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a46063-33a5-4a7f-8edf-764ab2acb7f7 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:05.259116 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a46063-33a5-4a7f-8edf-764ab2acb7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:05.259595 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a46063-33a5-4a7f-8edf-764ab2acb7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:05.279504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-99a46063-33a5-4a7f-8edf-764ab2acb7f7 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:05.280732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-99a46063-33a5-4a7f-8edf-764ab2acb7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:05.341628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1297/2597] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:05.351478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:05.353136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:05.364261 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a46063-33a5-4a7f-8edf-764ab2acb7f7 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:05.365666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-99a46063-33a5-4a7f-8edf-764ab2acb7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:05.379425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a46063-33a5-4a7f-8edf-764ab2acb7f7 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:05.385635 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:05.386699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:05.386981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:05.387256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] PATH_INFO: `/v3/projects/2a7aaeab18ff4033b294a415fb14b356` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:05.388561 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7aaeab18ff4033b294a415fb14b356)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:05.390680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:05.392357 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:05.435014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e159a3-5ee8-4bb9-99f8-a306e42579ab admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:05.438606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4a309-f7a7-4b0a-acfe-50f51026b71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:05.439256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4a309-f7a7-4b0a-acfe-50f51026b71b service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:05.439540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4a309-f7a7-4b0a-acfe-50f51026b71b service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:05.439814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4a309-f7a7-4b0a-acfe-50f51026b71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:05.448770 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4a309-f7a7-4b0a-acfe-50f51026b71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:05.450575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4a309-f7a7-4b0a-acfe-50f51026b71b service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:05.460252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1301/2598] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:05.530660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7aaeab18ff4033b294a415fb14b356', 'request_id': 'req-3308bfcf-5b9f-46a6-8a65-7a16524ee685'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.624186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7aaeab18ff4033b294a415fb14b356', 'request_id': 'req-3308bfcf-5b9f-46a6-8a65-7a16524ee685'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.630547 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7aaeab18ff4033b294a415fb14b356', 'request_id': 'req-3308bfcf-5b9f-46a6-8a65-7a16524ee685'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.641485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] The token cache is being invalidate because project 2a7aaeab18ff4033b294a415fb14b356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:05.641767 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.642433 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.643995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1298/2599] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:05 2022] DELETE /identity/v3/projects/2a7aaeab18ff4033b294a415fb14b356 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:05.648111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4a309-f7a7-4b0a-acfe-50f51026b71b service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:05.658597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4a309-f7a7-4b0a-acfe-50f51026b71b service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:05.717043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:05.717938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:05.718410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:05.718665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] PATH_INFO: `/v3/users/468362fd7a0a4b3d829c8b25c496f220` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:05.720761 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=468362fd7a0a4b3d829c8b25c496f220)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:05.722014 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:05.890554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:05.896238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468362fd7a0a4b3d829c8b25c496f220'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.896888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468362fd7a0a4b3d829c8b25c496f220'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.911288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468362fd7a0a4b3d829c8b25c496f220'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:05.921314 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:05.921314 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:05.935385 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308bfcf-5b9f-46a6-8a65-7a16524ee685 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:05.940691 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:05.942152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:05.942724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:05.943225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] PATH_INFO: `/v3/projects/064027a1e1b54b48bc8e3bb324e65c60` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:05.944839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064027a1e1b54b48bc8e3bb324e65c60)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:05.946812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:06.007006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468362fd7a0a4b3d829c8b25c496f220'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.014752 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468362fd7a0a4b3d829c8b25c496f220'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.020564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1302/2600] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:05 2022] DELETE /identity/v3/users/468362fd7a0a4b3d829c8b25c496f220 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:06.059833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064027a1e1b54b48bc8e3bb324e65c60', 'request_id': 'req-6dac51bf-c4cf-4e44-beca-5c65f021b613'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.139212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064027a1e1b54b48bc8e3bb324e65c60', 'request_id': 'req-6dac51bf-c4cf-4e44-beca-5c65f021b613'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.145320 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064027a1e1b54b48bc8e3bb324e65c60', 'request_id': 'req-6dac51bf-c4cf-4e44-beca-5c65f021b613'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.157025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] The token cache is being invalidate because project 064027a1e1b54b48bc8e3bb324e65c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:06.157315 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.157962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.159516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1299/2601] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:05 2022] DELETE /identity/v3/projects/064027a1e1b54b48bc8e3bb324e65c60 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:06.163500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:06.164956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:06.229873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17cdd7-63df-4349-9ef7-60f5977fcd5b admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:06.297154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe19fc-3854-41d0-aafc-8764ebe5f61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:06.299619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe19fc-3854-41d0-aafc-8764ebe5f61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:06.299902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe19fc-3854-41d0-aafc-8764ebe5f61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:06.300946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe19fc-3854-41d0-aafc-8764ebe5f61c admin admin] PATH_INFO: `/v3/users/c9d6b68dfa8346ecbc99192d75fd8345` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:06.302155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe19fc-3854-41d0-aafc-8764ebe5f61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d6b68dfa8346ecbc99192d75fd8345)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:06.304142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe19fc-3854-41d0-aafc-8764ebe5f61c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:06.477182 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:06.478603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:06.493285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac51bf-c4cf-4e44-beca-5c65f021b613 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:06.508994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:06.508994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:06.508994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:06.508994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] PATH_INFO: `/v3/projects/0e1b0df0a0f74206bda991ac3767e2e9` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:06.509362 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1b0df0a0f74206bda991ac3767e2e9)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:06.509727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:06.516240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6efe19fc-3854-41d0-aafc-8764ebe5f61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d6b68dfa8346ecbc99192d75fd8345'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.516892 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6efe19fc-3854-41d0-aafc-8764ebe5f61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d6b68dfa8346ecbc99192d75fd8345'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.530085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6efe19fc-3854-41d0-aafc-8764ebe5f61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d6b68dfa8346ecbc99192d75fd8345'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.531809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:06.633076 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6efe19fc-3854-41d0-aafc-8764ebe5f61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d6b68dfa8346ecbc99192d75fd8345'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.641366 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6efe19fc-3854-41d0-aafc-8764ebe5f61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d6b68dfa8346ecbc99192d75fd8345'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.647608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1303/2602] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:06 2022] DELETE /identity/v3/users/c9d6b68dfa8346ecbc99192d75fd8345 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:06.667113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1b0df0a0f74206bda991ac3767e2e9', 'request_id': 'req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.812644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1b0df0a0f74206bda991ac3767e2e9', 'request_id': 'req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.818814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1b0df0a0f74206bda991ac3767e2e9', 'request_id': 'req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.821830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:06.830912 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] The token cache is being invalidate because project 0e1b0df0a0f74206bda991ac3767e2e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:06.831203 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.831835 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ba5ca418-21cc-48a7-8f4b-750932cb0bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:06.833377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1300/2603] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:06 2022] DELETE /identity/v3/projects/0e1b0df0a0f74206bda991ac3767e2e9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:06.838353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a24c6d-8c76-43cb-adb9-00b4c3431b7a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:06.838650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a24c6d-8c76-43cb-adb9-00b4c3431b7a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:06.838934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a24c6d-8c76-43cb-adb9-00b4c3431b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:06.858686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-e1a24c6d-8c76-43cb-adb9-00b4c3431b7a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:06.859903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e1a24c6d-8c76-43cb-adb9-00b4c3431b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:06.924678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1304/2604] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:06.939016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41361064-f572-4507-b34b-605320cf68db None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:06.939016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41361064-f572-4507-b34b-605320cf68db None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:06.939507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41361064-f572-4507-b34b-605320cf68db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:06.959800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-41361064-f572-4507-b34b-605320cf68db None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:06.960978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-41361064-f572-4507-b34b-605320cf68db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:06.969348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1301/2605] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:06.976711 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a24c6d-8c76-43cb-adb9-00b4c3431b7a None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:06.987370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a24c6d-8c76-43cb-adb9-00b4c3431b7a None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:06.993541 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d69a1-169c-46b1-85a5-0aca0920b20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:06.994141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d69a1-169c-46b1-85a5-0aca0920b20d admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:06.994458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d69a1-169c-46b1-85a5-0aca0920b20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:06.994736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d69a1-169c-46b1-85a5-0aca0920b20d admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:06.995467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d69a1-169c-46b1-85a5-0aca0920b20d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:54:06.995776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d69a1-169c-46b1-85a5-0aca0920b20d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:06.997401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d69a1-169c-46b1-85a5-0aca0920b20d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.012826 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1305/2606] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:54:07.016984 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41361064-f572-4507-b34b-605320cf68db None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.026828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41361064-f572-4507-b34b-605320cf68db None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.031648 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ceab4-ff9a-48d4-b81b-9134dfbade29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.032301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ceab4-ff9a-48d4-b81b-9134dfbade29 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.032589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ceab4-ff9a-48d4-b81b-9134dfbade29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.032969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ceab4-ff9a-48d4-b81b-9134dfbade29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.033661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ceab4-ff9a-48d4-b81b-9134dfbade29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.035752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ceab4-ff9a-48d4-b81b-9134dfbade29 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.107828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d69a1-169c-46b1-85a5-0aca0920b20d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.109776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a55d69a1-169c-46b1-85a5-0aca0920b20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:07.131332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1302/2607] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:07 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:07.131920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d69a1-169c-46b1-85a5-0aca0920b20d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.132361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ceab4-ff9a-48d4-b81b-9134dfbade29 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.194103 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.194844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ceab4-ff9a-48d4-b81b-9134dfbade29 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.195028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.195339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.195613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] PATH_INFO: `/v3/projects/2ef023dbb8a14f409e4d3f8fd4134ea3` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.196851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef023dbb8a14f409e4d3f8fd4134ea3)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.198810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.199689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7097f3-46da-49c8-ad3c-3d42359fcbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.200630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7097f3-46da-49c8-ad3c-3d42359fcbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.201059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7097f3-46da-49c8-ad3c-3d42359fcbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.201339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7097f3-46da-49c8-ad3c-3d42359fcbe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.202031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7097f3-46da-49c8-ad3c-3d42359fcbe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.204012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7097f3-46da-49c8-ad3c-3d42359fcbe6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.302517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1303/2608] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:07 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:07.303733 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7097f3-46da-49c8-ad3c-3d42359fcbe6 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.312936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef023dbb8a14f409e4d3f8fd4134ea3', 'request_id': 'req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:07.313701 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7097f3-46da-49c8-ad3c-3d42359fcbe6 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.368457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f99cd-3c13-45de-9c1b-f186e3c6bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.369122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f99cd-3c13-45de-9c1b-f186e3c6bfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.369410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f99cd-3c13-45de-9c1b-f186e3c6bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.369690 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f99cd-3c13-45de-9c1b-f186e3c6bfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.370449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f99cd-3c13-45de-9c1b-f186e3c6bfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.372046 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f99cd-3c13-45de-9c1b-f186e3c6bfe7 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.381909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef023dbb8a14f409e4d3f8fd4134ea3', 'request_id': 'req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:07.382432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1304/2609] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:07.386191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f99cd-3c13-45de-9c1b-f186e3c6bfe7 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.394287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef023dbb8a14f409e4d3f8fd4134ea3', 'request_id': 'req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:07.396509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f99cd-3c13-45de-9c1b-f186e3c6bfe7 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.401257 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85cc9-9f52-4b0b-8f8b-b8e6a5baa149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.401904 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85cc9-9f52-4b0b-8f8b-b8e6a5baa149 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.402187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85cc9-9f52-4b0b-8f8b-b8e6a5baa149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.402500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85cc9-9f52-4b0b-8f8b-b8e6a5baa149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.403228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c85cc9-9f52-4b0b-8f8b-b8e6a5baa149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.405324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c85cc9-9f52-4b0b-8f8b-b8e6a5baa149 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.407500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:07.411881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] The token cache is being invalidate because project 2ef023dbb8a14f409e4d3f8fd4134ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:07.412261 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:07.413154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-38b53512-59b2-4bd7-8927-9b6bb7be0c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:07.415004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1306/2610] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:07 2022] DELETE /identity/v3/projects/2ef023dbb8a14f409e4d3f8fd4134ea3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:07.423402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37aa6e-ee06-46a3-a29c-cc092a02b7ba None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.428114 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37aa6e-ee06-46a3-a29c-cc092a02b7ba None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.428114 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37aa6e-ee06-46a3-a29c-cc092a02b7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.428305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1305/2611] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:07.431114 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85cc9-9f52-4b0b-8f8b-b8e6a5baa149 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.432891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-73c85cc9-9f52-4b0b-8f8b-b8e6a5baa149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:07.442940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-aa37aa6e-ee06-46a3-a29c-cc092a02b7ba None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:07.444144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-aa37aa6e-ee06-46a3-a29c-cc092a02b7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:07.446579 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85cc9-9f52-4b0b-8f8b-b8e6a5baa149 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.452769 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc529bd-80da-4e92-a3cf-0aa72352e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.461450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1307/2612] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:07.461597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc529bd-80da-4e92-a3cf-0aa72352e9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.461597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc529bd-80da-4e92-a3cf-0aa72352e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.461597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc529bd-80da-4e92-a3cf-0aa72352e9c6 admin admin] PATH_INFO: `/v3/projects/a4a02a4e765c4d9ebd7c3f67a51e6392/users/8dbf176cf3a74957868396435a05d7c8/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.463244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e711f3c-204b-485d-99ff-46a9392c4ccb None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.463404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e711f3c-204b-485d-99ff-46a9392c4ccb None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.463687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e711f3c-204b-485d-99ff-46a9392c4ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.471245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc529bd-80da-4e92-a3cf-0aa72352e9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a02a4e765c4d9ebd7c3f67a51e6392, user_id=8dbf176cf3a74957868396435a05d7c8, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.473962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc529bd-80da-4e92-a3cf-0aa72352e9c6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.484684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5e711f3c-204b-485d-99ff-46a9392c4ccb None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:07.485916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5e711f3c-204b-485d-99ff-46a9392c4ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:07.493972 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1308/2613] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:07.497785 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e711f3c-204b-485d-99ff-46a9392c4ccb None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.506809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e711f3c-204b-485d-99ff-46a9392c4ccb None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.511660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a3053-8987-4552-9479-f22ae3871ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.512482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a3053-8987-4552-9479-f22ae3871ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.512776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a3053-8987-4552-9479-f22ae3871ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.513045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a3053-8987-4552-9479-f22ae3871ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.513825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a3053-8987-4552-9479-f22ae3871ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:54:07.514137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a3053-8987-4552-9479-f22ae3871ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.515830 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a3053-8987-4552-9479-f22ae3871ce6 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.527219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1309/2614] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:54:07.537498 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a3053-8987-4552-9479-f22ae3871ce6 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.542766 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a3053-8987-4552-9479-f22ae3871ce6 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.548380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e418-0c99-49e8-875e-9162593c9d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.549024 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e418-0c99-49e8-875e-9162593c9d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.549311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e418-0c99-49e8-875e-9162593c9d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.549595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e418-0c99-49e8-875e-9162593c9d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.550333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819e418-0c99-49e8-875e-9162593c9d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.552370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819e418-0c99-49e8-875e-9162593c9d70 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.587101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1306/2615] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:07 2022] PUT /identity/v3/projects/a4a02a4e765c4d9ebd7c3f67a51e6392/users/8dbf176cf3a74957868396435a05d7c8/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:07.598750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a373c3f-bd31-4365-ad39-45e4a655f44c None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.599043 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a373c3f-bd31-4365-ad39-45e4a655f44c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.599323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a373c3f-bd31-4365-ad39-45e4a655f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.624801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-7a373c3f-bd31-4365-ad39-45e4a655f44c None None] MFA Rules not processed for user `8dbf176cf3a74957868396435a05d7c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:07.625987 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-7a373c3f-bd31-4365-ad39-45e4a655f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:07.668893 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1310/2616] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:07 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:07.673026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e418-0c99-49e8-875e-9162593c9d70 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.692683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1307/2617] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:07.699285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a373c3f-bd31-4365-ad39-45e4a655f44c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.739172 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e418-0c99-49e8-875e-9162593c9d70 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.743824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b11b7-3309-47e5-be22-6af564b20df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.744490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b11b7-3309-47e5-be22-6af564b20df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.744773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b11b7-3309-47e5-be22-6af564b20df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.745048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b11b7-3309-47e5-be22-6af564b20df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.745731 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b11b7-3309-47e5-be22-6af564b20df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.747714 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b11b7-3309-47e5-be22-6af564b20df8 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.764513 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a373c3f-bd31-4365-ad39-45e4a655f44c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.769195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09236096-19f2-450f-8f60-dec8afe1e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.769877 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236096-19f2-450f-8f60-dec8afe1e85e admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.770169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236096-19f2-450f-8f60-dec8afe1e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.770478 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236096-19f2-450f-8f60-dec8afe1e85e admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.771281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09236096-19f2-450f-8f60-dec8afe1e85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.773166 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09236096-19f2-450f-8f60-dec8afe1e85e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.779745 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:07.861420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1311/2618] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:07 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:07.866704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b11b7-3309-47e5-be22-6af564b20df8 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.866704 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a78b11b7-3309-47e5-be22-6af564b20df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:07.885833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1308/2619] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:07 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:07.886546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09236096-19f2-450f-8f60-dec8afe1e85e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.924883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b11b7-3309-47e5-be22-6af564b20df8 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.947150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09236096-19f2-450f-8f60-dec8afe1e85e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.952603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a41902-2d26-4814-9f05-820a531ba4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.953273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41902-2d26-4814-9f05-820a531ba4ed admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.953551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41902-2d26-4814-9f05-820a531ba4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.953822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41902-2d26-4814-9f05-820a531ba4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.954594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a41902-2d26-4814-9f05-820a531ba4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.956188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a41902-2d26-4814-9f05-820a531ba4ed admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:07.965927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1309/2620] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:07.965927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a41902-2d26-4814-9f05-820a531ba4ed admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:07.975774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd5211-c9ae-4fae-b48e-42d3a1107b79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.975774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd5211-c9ae-4fae-b48e-42d3a1107b79 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.975774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd5211-c9ae-4fae-b48e-42d3a1107b79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.975774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd5211-c9ae-4fae-b48e-42d3a1107b79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.977163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a41902-2d26-4814-9f05-820a531ba4ed admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:07.978402 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-70dd5211-c9ae-4fae-b48e-42d3a1107b79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:07.981912 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b720d-0fac-4dd3-9464-a8dd5c0dda5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:07.982611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b720d-0fac-4dd3-9464-a8dd5c0dda5e admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:07.982893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b720d-0fac-4dd3-9464-a8dd5c0dda5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:07.983169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b720d-0fac-4dd3-9464-a8dd5c0dda5e admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:07.983888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b720d-0fac-4dd3-9464-a8dd5c0dda5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:07.985811 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b720d-0fac-4dd3-9464-a8dd5c0dda5e admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.040713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd5211-c9ae-4fae-b48e-42d3a1107b79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.042155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd5211-c9ae-4fae-b48e-42d3a1107b79 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.051345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1312/2621] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:08.052380 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd5211-c9ae-4fae-b48e-42d3a1107b79 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.062951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd5211-c9ae-4fae-b48e-42d3a1107b79 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.067634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df606a-c21e-491d-bfde-12a377519e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.068293 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df606a-c21e-491d-bfde-12a377519e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.068678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df606a-c21e-491d-bfde-12a377519e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.068958 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df606a-c21e-491d-bfde-12a377519e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.069681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df606a-c21e-491d-bfde-12a377519e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.071297 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df606a-c21e-491d-bfde-12a377519e36 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.082295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1313/2622] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:08.086809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df606a-c21e-491d-bfde-12a377519e36 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.087443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1310/2623] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:07 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:08.093602 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b720d-0fac-4dd3-9464-a8dd5c0dda5e admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.099017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df606a-c21e-491d-bfde-12a377519e36 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.103712 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b720d-0fac-4dd3-9464-a8dd5c0dda5e admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.104748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68545311-0dfb-42c7-acc1-2249ec01622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.105751 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68545311-0dfb-42c7-acc1-2249ec01622e admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.106044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68545311-0dfb-42c7-acc1-2249ec01622e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.106351 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68545311-0dfb-42c7-acc1-2249ec01622e admin admin] PATH_INFO: `/v3/projects/2abbf3e18b7847bcbf0f3e73df08aea5/users/e945eddedd594cf0a63bf64efae1b61d/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.109700 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90a4a-ccb5-432f-b5ec-0f373a795e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.111396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90a4a-ccb5-432f-b5ec-0f373a795e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.112570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90a4a-ccb5-432f-b5ec-0f373a795e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.112570 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90a4a-ccb5-432f-b5ec-0f373a795e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.114274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea90a4a-ccb5-432f-b5ec-0f373a795e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.117611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea90a4a-ccb5-432f-b5ec-0f373a795e58 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.126916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68545311-0dfb-42c7-acc1-2249ec01622e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abbf3e18b7847bcbf0f3e73df08aea5, user_id=e945eddedd594cf0a63bf64efae1b61d, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.130103 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68545311-0dfb-42c7-acc1-2249ec01622e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.131432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1311/2624] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:08.136054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90a4a-ccb5-432f-b5ec-0f373a795e58 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.146917 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90a4a-ccb5-432f-b5ec-0f373a795e58 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.152321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74728ee4-dbf1-4720-8bf4-e39bbd38da68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.154734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728ee4-dbf1-4720-8bf4-e39bbd38da68 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.154734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728ee4-dbf1-4720-8bf4-e39bbd38da68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.154734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728ee4-dbf1-4720-8bf4-e39bbd38da68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.154734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74728ee4-dbf1-4720-8bf4-e39bbd38da68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.155860 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74728ee4-dbf1-4720-8bf4-e39bbd38da68 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.168716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1312/2625] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:08.172838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74728ee4-dbf1-4720-8bf4-e39bbd38da68 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.183675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74728ee4-dbf1-4720-8bf4-e39bbd38da68 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.189020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e224f42-494d-4777-afbd-752765edb08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.189899 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224f42-494d-4777-afbd-752765edb08c admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.190218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224f42-494d-4777-afbd-752765edb08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.190527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224f42-494d-4777-afbd-752765edb08c admin admin] PATH_INFO: `/v3/projects/0ca7c09ee9594e9d89afc5dd088c2473/users/85d6f88e853944aa8518b0eb67d1203e/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.205888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1314/2626] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:08 2022] PUT /identity/v3/projects/2abbf3e18b7847bcbf0f3e73df08aea5/users/e945eddedd594cf0a63bf64efae1b61d/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:08.209062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224f42-494d-4777-afbd-752765edb08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca7c09ee9594e9d89afc5dd088c2473, user_id=85d6f88e853944aa8518b0eb67d1203e, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.210090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224f42-494d-4777-afbd-752765edb08c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.216947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b84d8-35f3-4295-a21b-cb34e2beda53 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.217237 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b84d8-35f3-4295-a21b-cb34e2beda53 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.217508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b84d8-35f3-4295-a21b-cb34e2beda53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.243334 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-427b84d8-35f3-4295-a21b-cb34e2beda53 None None] MFA Rules not processed for user `e945eddedd594cf0a63bf64efae1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:08.244533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-427b84d8-35f3-4295-a21b-cb34e2beda53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:08.313675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1315/2627] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:08.313814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:08.315419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b84d8-35f3-4295-a21b-cb34e2beda53 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.318003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1313/2628] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:08 2022] PUT /identity/v3/projects/0ca7c09ee9594e9d89afc5dd088c2473/users/85d6f88e853944aa8518b0eb67d1203e/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:08.330047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5fa5-5533-4a0f-a4b9-11186d43489f None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.330362 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5fa5-5533-4a0f-a4b9-11186d43489f None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.330638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5fa5-5533-4a0f-a4b9-11186d43489f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.361886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-2f9f5fa5-5533-4a0f-a4b9-11186d43489f None None] MFA Rules not processed for user `85d6f88e853944aa8518b0eb67d1203e`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:08.363219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2f9f5fa5-5533-4a0f-a4b9-11186d43489f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:08.382895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b84d8-35f3-4295-a21b-cb34e2beda53 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.391015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:08.429306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1314/2629] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:08.433606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f5fa5-5533-4a0f-a4b9-11186d43489f None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.442772 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce3fc-2a2f-44f8-987d-7155769ac5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.443461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce3fc-2a2f-44f8-987d-7155769ac5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.443747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce3fc-2a2f-44f8-987d-7155769ac5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.444114 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce3fc-2a2f-44f8-987d-7155769ac5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.444858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce3fc-2a2f-44f8-987d-7155769ac5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.447022 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce3fc-2a2f-44f8-987d-7155769ac5a8 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.496777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f5fa5-5533-4a0f-a4b9-11186d43489f None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.502028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60846c-dd9e-4a4c-bc3f-464ebef69fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.502789 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60846c-dd9e-4a4c-bc3f-464ebef69fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.503074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60846c-dd9e-4a4c-bc3f-464ebef69fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.503351 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60846c-dd9e-4a4c-bc3f-464ebef69fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.504176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60846c-dd9e-4a4c-bc3f-464ebef69fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.506089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60846c-dd9e-4a4c-bc3f-464ebef69fa9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.546125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1316/2630] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:08 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:08.550064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce3fc-2a2f-44f8-987d-7155769ac5a8 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.610944 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce3fc-2a2f-44f8-987d-7155769ac5a8 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.616064 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a960a-827b-4e18-b28c-0b34e8e684a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.616675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a960a-827b-4e18-b28c-0b34e8e684a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.617001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a960a-827b-4e18-b28c-0b34e8e684a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.617284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a960a-827b-4e18-b28c-0b34e8e684a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.618016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a960a-827b-4e18-b28c-0b34e8e684a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.620209 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a960a-827b-4e18-b28c-0b34e8e684a9 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.639242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:08.646396 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1315/2631] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:08 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:08.650419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60846c-dd9e-4a4c-bc3f-464ebef69fa9 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.712160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60846c-dd9e-4a4c-bc3f-464ebef69fa9 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.717499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568cf68-8027-499c-a261-2fc19315ba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.718172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cf68-8027-499c-a261-2fc19315ba41 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.718492 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cf68-8027-499c-a261-2fc19315ba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.718771 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cf68-8027-499c-a261-2fc19315ba41 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.719464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568cf68-8027-499c-a261-2fc19315ba41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.721363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568cf68-8027-499c-a261-2fc19315ba41 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.725594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:08.731205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1317/2632] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:08 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:08.735943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a960a-827b-4e18-b28c-0b34e8e684a9 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.745546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a960a-827b-4e18-b28c-0b34e8e684a9 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.750886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757f3e-c410-42df-b29b-cc7873512672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.751507 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757f3e-c410-42df-b29b-cc7873512672 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.751787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757f3e-c410-42df-b29b-cc7873512672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.758102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757f3e-c410-42df-b29b-cc7873512672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.758102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757f3e-c410-42df-b29b-cc7873512672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.758102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757f3e-c410-42df-b29b-cc7873512672 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.763914 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1318/2633] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:08.767754 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757f3e-c410-42df-b29b-cc7873512672 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.776818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757f3e-c410-42df-b29b-cc7873512672 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.782497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34625cb5-dcd1-40f0-b485-a97ba620544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.783376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625cb5-dcd1-40f0-b485-a97ba620544c admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.783662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625cb5-dcd1-40f0-b485-a97ba620544c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.783939 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625cb5-dcd1-40f0-b485-a97ba620544c admin admin] PATH_INFO: `/v3/projects/4fd087952979494698951d5f8e274324/users/a8509355c9324f77ade53736ea131ea4/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.799776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34625cb5-dcd1-40f0-b485-a97ba620544c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd087952979494698951d5f8e274324, user_id=a8509355c9324f77ade53736ea131ea4, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.802468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34625cb5-dcd1-40f0-b485-a97ba620544c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.835796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1316/2634] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:08 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:08.837350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568cf68-8027-499c-a261-2fc19315ba41 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.847621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568cf68-8027-499c-a261-2fc19315ba41 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.852537 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eefade-610d-42f0-862b-c0964c609bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.853213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eefade-610d-42f0-862b-c0964c609bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.853500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eefade-610d-42f0-862b-c0964c609bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.853781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eefade-610d-42f0-862b-c0964c609bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.854539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eefade-610d-42f0-862b-c0964c609bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.856136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eefade-610d-42f0-862b-c0964c609bf0 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.867220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1317/2635] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:08.870695 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eefade-610d-42f0-862b-c0964c609bf0 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.879930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eefade-610d-42f0-862b-c0964c609bf0 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:08.884718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454dad-1c9a-41bc-bcac-3b031f585382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:08.885560 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454dad-1c9a-41bc-bcac-3b031f585382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:08.885839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454dad-1c9a-41bc-bcac-3b031f585382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:08.886111 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454dad-1c9a-41bc-bcac-3b031f585382 admin admin] PATH_INFO: `/v3/projects/e99a1914127c4b609b0a33f20926eb4f/users/ee753600ad054cdea32fdeb6ba3c74b3/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:08.900516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b454dad-1c9a-41bc-bcac-3b031f585382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99a1914127c4b609b0a33f20926eb4f, user_id=ee753600ad054cdea32fdeb6ba3c74b3, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:08.903251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b454dad-1c9a-41bc-bcac-3b031f585382 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:08.915828 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1319/2636] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:08 2022] PUT /identity/v3/projects/4fd087952979494698951d5f8e274324/users/a8509355c9324f77ade53736ea131ea4/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:08.920300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34625cb5-dcd1-40f0-b485-a97ba620544c admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.964683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1318/2637] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:08 2022] PUT /identity/v3/projects/e99a1914127c4b609b0a33f20926eb4f/users/ee753600ad054cdea32fdeb6ba3c74b3/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:08.969305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454dad-1c9a-41bc-bcac-3b031f585382 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:08.977255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:08.988212 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34625cb5-dcd1-40f0-b485-a97ba620544c admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:09.029319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454dad-1c9a-41bc-bcac-3b031f585382 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:09.034259 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2b69-49f2-4e44-bbbf-aa482fc0dc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:09.034934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2b69-49f2-4e44-bbbf-aa482fc0dc05 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.035220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2b69-49f2-4e44-bbbf-aa482fc0dc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.035501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2b69-49f2-4e44-bbbf-aa482fc0dc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.036280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc2b69-49f2-4e44-bbbf-aa482fc0dc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:09.037980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc2b69-49f2-4e44-bbbf-aa482fc0dc05 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:09.044051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8a4f1-945c-41fc-a7a5-4e45a131833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:09.045308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8a4f1-945c-41fc-a7a5-4e45a131833e admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.045592 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8a4f1-945c-41fc-a7a5-4e45a131833e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.045863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8a4f1-945c-41fc-a7a5-4e45a131833e admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.046627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8a4f1-945c-41fc-a7a5-4e45a131833e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:09.048207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8a4f1-945c-41fc-a7a5-4e45a131833e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:09.048799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1319/2638] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:09.053018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2b69-49f2-4e44-bbbf-aa482fc0dc05 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:09.058347 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1320/2639] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:09.062723 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8a4f1-945c-41fc-a7a5-4e45a131833e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:09.067332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2b69-49f2-4e44-bbbf-aa482fc0dc05 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:09.072189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87b00e-7b8f-43ca-83e1-4c5fb434d0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:09.072696 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8a4f1-945c-41fc-a7a5-4e45a131833e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:09.073072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b00e-7b8f-43ca-83e1-4c5fb434d0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.073471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b00e-7b8f-43ca-83e1-4c5fb434d0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.073753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b00e-7b8f-43ca-83e1-4c5fb434d0f8 admin admin] PATH_INFO: `/v3/projects/e99a1914127c4b609b0a33f20926eb4f/users/ee753600ad054cdea32fdeb6ba3c74b3/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.076179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87b00e-7b8f-43ca-83e1-4c5fb434d0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99a1914127c4b609b0a33f20926eb4f, user_id=ee753600ad054cdea32fdeb6ba3c74b3, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:09.077652 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd85e8d-ba8a-4e08-b152-87bdce58d31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:09.078536 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd85e8d-ba8a-4e08-b152-87bdce58d31a admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.078817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87b00e-7b8f-43ca-83e1-4c5fb434d0f8 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:09.078917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd85e8d-ba8a-4e08-b152-87bdce58d31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.079085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd85e8d-ba8a-4e08-b152-87bdce58d31a admin admin] PATH_INFO: `/v3/projects/4fd087952979494698951d5f8e274324/users/a8509355c9324f77ade53736ea131ea4/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.081011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd85e8d-ba8a-4e08-b152-87bdce58d31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd087952979494698951d5f8e274324, user_id=a8509355c9324f77ade53736ea131ea4, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:09.087248 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd85e8d-ba8a-4e08-b152-87bdce58d31a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:09.089444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1320/2640] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:09 2022] PUT /identity/v3/projects/e99a1914127c4b609b0a33f20926eb4f/users/ee753600ad054cdea32fdeb6ba3c74b3/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:09.094884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1321/2641] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:09 2022] PUT /identity/v3/projects/4fd087952979494698951d5f8e274324/users/a8509355c9324f77ade53736ea131ea4/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:09.103843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2cf98-4fde-4193-8c5d-6979c2ca5918 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.104139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2cf98-4fde-4193-8c5d-6979c2ca5918 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.105032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2cf98-4fde-4193-8c5d-6979c2ca5918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.105147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147a2e-78e8-4f20-88dd-78c7c666b229 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.105147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147a2e-78e8-4f20-88dd-78c7c666b229 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.105147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a147a2e-78e8-4f20-88dd-78c7c666b229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.133223 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-3a147a2e-78e8-4f20-88dd-78c7c666b229 None None] MFA Rules not processed for user `a8509355c9324f77ade53736ea131ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:09.133223 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3a147a2e-78e8-4f20-88dd-78c7c666b229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:09.140031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c6d2cf98-4fde-4193-8c5d-6979c2ca5918 None None] MFA Rules not processed for user `ee753600ad054cdea32fdeb6ba3c74b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:09.142536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c6d2cf98-4fde-4193-8c5d-6979c2ca5918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:09.212054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1322/2642] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:09.214007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1321/2643] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:09.226054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a147a2e-78e8-4f20-88dd-78c7c666b229 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:09.227861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3a147a2e-78e8-4f20-88dd-78c7c666b229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:09.283625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a147a2e-78e8-4f20-88dd-78c7c666b229 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:09.287538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47db6c-fefd-4b63-8bfe-3bc9ad6ab632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:09.288207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47db6c-fefd-4b63-8bfe-3bc9ad6ab632 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.288493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47db6c-fefd-4b63-8bfe-3bc9ad6ab632 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.288770 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47db6c-fefd-4b63-8bfe-3bc9ad6ab632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.298692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47db6c-fefd-4b63-8bfe-3bc9ad6ab632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:09.300111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47db6c-fefd-4b63-8bfe-3bc9ad6ab632 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:09.309724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1323/2644] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:09.337539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2cf98-4fde-4193-8c5d-6979c2ca5918 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:09.337980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47db6c-fefd-4b63-8bfe-3bc9ad6ab632 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:09.342699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:09.348454 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2cf98-4fde-4193-8c5d-6979c2ca5918 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:09.350947 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:09.352450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc60685-ab47-414c-bc3f-9c4af5fec5ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:09.357837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc60685-ab47-414c-bc3f-9c4af5fec5ae service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.357837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc60685-ab47-414c-bc3f-9c4af5fec5ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.357837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc60685-ab47-414c-bc3f-9c4af5fec5ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.363714 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc60685-ab47-414c-bc3f-9c4af5fec5ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:09.365145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc60685-ab47-414c-bc3f-9c4af5fec5ae service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:09.375727 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1322/2645] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:09.401941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47db6c-fefd-4b63-8bfe-3bc9ad6ab632 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:09.406808 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:09.407664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.407950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.408224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] PATH_INFO: `/v3/users/e945eddedd594cf0a63bf64efae1b61d` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.409468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e945eddedd594cf0a63bf64efae1b61d)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:09.411480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:09.538697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc60685-ab47-414c-bc3f-9c4af5fec5ae service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:09.548180 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc60685-ab47-414c-bc3f-9c4af5fec5ae service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:09.551969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c6a95-f5f2-4bcb-a9ea-ffcced5823d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:09.552594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c6a95-f5f2-4bcb-a9ea-ffcced5823d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.552874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c6a95-f5f2-4bcb-a9ea-ffcced5823d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.553144 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c6a95-f5f2-4bcb-a9ea-ffcced5823d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.606679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c6a95-f5f2-4bcb-a9ea-ffcced5823d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:09.609806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c6a95-f5f2-4bcb-a9ea-ffcced5823d8 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:09.624145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1323/2646] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:09.652813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e945eddedd594cf0a63bf64efae1b61d'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:09.654419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e945eddedd594cf0a63bf64efae1b61d'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:09.667464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e945eddedd594cf0a63bf64efae1b61d'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:09.730227 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e945eddedd594cf0a63bf64efae1b61d'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:09.738698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e945eddedd594cf0a63bf64efae1b61d'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:09.744949 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1324/2647] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:09 2022] DELETE /identity/v3/users/e945eddedd594cf0a63bf64efae1b61d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:09.749680 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394426c-350a-41dd-aa33-95fd88ab8488 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.749968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394426c-350a-41dd-aa33-95fd88ab8488 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.750258 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394426c-350a-41dd-aa33-95fd88ab8488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.767735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-0394426c-350a-41dd-aa33-95fd88ab8488 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:09.768742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0394426c-350a-41dd-aa33-95fd88ab8488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:09.827341 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1324/2648] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:09.836981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:09.838543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:09.896776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42296003-beac-4cd3-a96a-650f06aa77ac admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:09.900400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0761-1a9e-492c-b6c7-ed1809463fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:09.901003 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0761-1a9e-492c-b6c7-ed1809463fef service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:09.901280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0761-1a9e-492c-b6c7-ed1809463fef service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:09.901942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0761-1a9e-492c-b6c7-ed1809463fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:09.911368 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c0761-1a9e-492c-b6c7-ed1809463fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:09.912780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c0761-1a9e-492c-b6c7-ed1809463fef service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:09.922231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1325/2649] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:10.343685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394426c-350a-41dd-aa33-95fd88ab8488 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:10.345185 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0394426c-350a-41dd-aa33-95fd88ab8488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:10.357682 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394426c-350a-41dd-aa33-95fd88ab8488 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:10.363001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:10.363868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:10.364153 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:10.364590 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] PATH_INFO: `/v3/projects/2abbf3e18b7847bcbf0f3e73df08aea5` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:10.365671 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abbf3e18b7847bcbf0f3e73df08aea5)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:10.367675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:10.461861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abbf3e18b7847bcbf0f3e73df08aea5', 'request_id': 'req-78b965eb-466b-453e-ad2a-edcbfa744493'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:10.541152 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abbf3e18b7847bcbf0f3e73df08aea5', 'request_id': 'req-78b965eb-466b-453e-ad2a-edcbfa744493'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:10.547461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abbf3e18b7847bcbf0f3e73df08aea5', 'request_id': 'req-78b965eb-466b-453e-ad2a-edcbfa744493'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:10.558713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] The token cache is being invalidate because project 2abbf3e18b7847bcbf0f3e73df08aea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:10.559002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:10.559764 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:10.561370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1325/2650] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:10 2022] DELETE /identity/v3/projects/2abbf3e18b7847bcbf0f3e73df08aea5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:10.565479 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0761-1a9e-492c-b6c7-ed1809463fef service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:10.576631 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0761-1a9e-492c-b6c7-ed1809463fef service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:10.615327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:10.656798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb87823-1a05-4945-902e-0d44187670f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:10.656798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb87823-1a05-4945-902e-0d44187670f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:10.656798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb87823-1a05-4945-902e-0d44187670f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:10.656798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb87823-1a05-4945-902e-0d44187670f9 admin admin] PATH_INFO: `/v3/users/a8509355c9324f77ade53736ea131ea4` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:10.657821 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb87823-1a05-4945-902e-0d44187670f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8509355c9324f77ade53736ea131ea4)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:10.658702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb87823-1a05-4945-902e-0d44187670f9 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:10.872383 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4fb87823-1a05-4945-902e-0d44187670f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8509355c9324f77ade53736ea131ea4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:10.873532 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4fb87823-1a05-4945-902e-0d44187670f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8509355c9324f77ade53736ea131ea4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:10.885667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4fb87823-1a05-4945-902e-0d44187670f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8509355c9324f77ade53736ea131ea4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:11.015602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4fb87823-1a05-4945-902e-0d44187670f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8509355c9324f77ade53736ea131ea4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:11.023116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4fb87823-1a05-4945-902e-0d44187670f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8509355c9324f77ade53736ea131ea4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:11.029080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1326/2651] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:10 2022] DELETE /identity/v3/users/a8509355c9324f77ade53736ea131ea4 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:11.440380 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:11.441842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:11.455252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b965eb-466b-453e-ad2a-edcbfa744493 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:11.463674 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:11.511543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:11.512333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:11.512618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:11.512898 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] PATH_INFO: `/v3/projects/4fd087952979494698951d5f8e274324` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:11.514069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd087952979494698951d5f8e274324)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:11.515992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:11.635323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd087952979494698951d5f8e274324', 'request_id': 'req-a15e70fe-8ca1-480b-8019-f907fe2a6907'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:11.699042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd087952979494698951d5f8e274324', 'request_id': 'req-a15e70fe-8ca1-480b-8019-f907fe2a6907'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:11.705092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd087952979494698951d5f8e274324', 'request_id': 'req-a15e70fe-8ca1-480b-8019-f907fe2a6907'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:11.715820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] The token cache is being invalidate because project 4fd087952979494698951d5f8e274324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:11.716103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:11.717334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a15e70fe-8ca1-480b-8019-f907fe2a6907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:11.718962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1326/2652] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:11 2022] DELETE /identity/v3/projects/4fd087952979494698951d5f8e274324 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:11.724538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2818-1d1d-4830-be45-70c96a280aad None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:11.725001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2818-1d1d-4830-be45-70c96a280aad None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:11.725098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2818-1d1d-4830-be45-70c96a280aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:11.743175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-014d2818-1d1d-4830-be45-70c96a280aad None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:11.744405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-014d2818-1d1d-4830-be45-70c96a280aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:11.806109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1327/2653] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:11.813758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd288d22-d8bd-4dd0-8a2d-1c96acd8e782 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:11.814069 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd288d22-d8bd-4dd0-8a2d-1c96acd8e782 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:11.814369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd288d22-d8bd-4dd0-8a2d-1c96acd8e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:11.833581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-fd288d22-d8bd-4dd0-8a2d-1c96acd8e782 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:11.834796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fd288d22-d8bd-4dd0-8a2d-1c96acd8e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:11.843457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1327/2654] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:11.847556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d2818-1d1d-4830-be45-70c96a280aad None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:11.857896 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d2818-1d1d-4830-be45-70c96a280aad None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:11.862783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dba567-c038-4401-b3cb-7bc8851aa4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:11.863552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba567-c038-4401-b3cb-7bc8851aa4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:11.863834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba567-c038-4401-b3cb-7bc8851aa4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:11.864106 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba567-c038-4401-b3cb-7bc8851aa4c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:11.864829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dba567-c038-4401-b3cb-7bc8851aa4c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:54:11.865135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dba567-c038-4401-b3cb-7bc8851aa4c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:11.866741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dba567-c038-4401-b3cb-7bc8851aa4c6 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:11.878139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1328/2655] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:54:11.882688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd288d22-d8bd-4dd0-8a2d-1c96acd8e782 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:11.892558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd288d22-d8bd-4dd0-8a2d-1c96acd8e782 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:11.897158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77702ab0-2939-4a64-b6a1-9884773374b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:11.897800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77702ab0-2939-4a64-b6a1-9884773374b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:11.898078 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77702ab0-2939-4a64-b6a1-9884773374b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:11.898382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77702ab0-2939-4a64-b6a1-9884773374b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:11.899073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77702ab0-2939-4a64-b6a1-9884773374b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:11.900953 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77702ab0-2939-4a64-b6a1-9884773374b8 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:12.017807 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1328/2656] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:11 2022] POST /identity/v3/projects => generated 361 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:12.022083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dba567-c038-4401-b3cb-7bc8851aa4c6 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:12.032566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dba567-c038-4401-b3cb-7bc8851aa4c6 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:12.069523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:12.088229 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978827e9-2d6d-49e9-a7eb-00cdebeeff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:12.088898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978827e9-2d6d-49e9-a7eb-00cdebeeff11 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:12.089183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978827e9-2d6d-49e9-a7eb-00cdebeeff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:12.089459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978827e9-2d6d-49e9-a7eb-00cdebeeff11 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:12.090169 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978827e9-2d6d-49e9-a7eb-00cdebeeff11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:12.092742 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978827e9-2d6d-49e9-a7eb-00cdebeeff11 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:12.191414 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1329/2657] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:12 2022] POST /identity/v3/users => generated 281 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:12.195318 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77702ab0-2939-4a64-b6a1-9884773374b8 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:12.207066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77702ab0-2939-4a64-b6a1-9884773374b8 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:12.216078 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441227f-e474-49ad-b42c-e8dda4eb6b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:12.216798 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441227f-e474-49ad-b42c-e8dda4eb6b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:12.217077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441227f-e474-49ad-b42c-e8dda4eb6b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:12.217358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441227f-e474-49ad-b42c-e8dda4eb6b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:12.218120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441227f-e474-49ad-b42c-e8dda4eb6b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:12.219740 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441227f-e474-49ad-b42c-e8dda4eb6b77 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:12.230259 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1329/2658] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:12.234207 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978827e9-2d6d-49e9-a7eb-00cdebeeff11 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:12.244012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978827e9-2d6d-49e9-a7eb-00cdebeeff11 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:12.249091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66e605-9cab-493f-bf03-e8d6f551cc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:12.249733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66e605-9cab-493f-bf03-e8d6f551cc19 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:12.250016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66e605-9cab-493f-bf03-e8d6f551cc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:12.250339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66e605-9cab-493f-bf03-e8d6f551cc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:12.251057 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66e605-9cab-493f-bf03-e8d6f551cc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:12.252628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66e605-9cab-493f-bf03-e8d6f551cc19 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:12.262882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1330/2659] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:12.268062 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441227f-e474-49ad-b42c-e8dda4eb6b77 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:12.277998 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441227f-e474-49ad-b42c-e8dda4eb6b77 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:12.282628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b6faa-a33c-4eec-a56a-ed567659072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:12.283493 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b6faa-a33c-4eec-a56a-ed567659072a admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:12.283776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b6faa-a33c-4eec-a56a-ed567659072a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:12.284049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b6faa-a33c-4eec-a56a-ed567659072a admin admin] PATH_INFO: `/v3/projects/c7f79283855641549a3a89df258d8bed/users/18433a452a7b417cb2668402bb5e60d0/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:12.298264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b6faa-a33c-4eec-a56a-ed567659072a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f79283855641549a3a89df258d8bed, user_id=18433a452a7b417cb2668402bb5e60d0, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:12.300884 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b6faa-a33c-4eec-a56a-ed567659072a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:12.381460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1330/2660] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:12 2022] PUT /identity/v3/projects/c7f79283855641549a3a89df258d8bed/users/18433a452a7b417cb2668402bb5e60d0/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:12.453452 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b212-4975-43e8-8ccd-8728d150cf53 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:12.453776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b212-4975-43e8-8ccd-8728d150cf53 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:12.454017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b212-4975-43e8-8ccd-8728d150cf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:12.484174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b6faa-a33c-4eec-a56a-ed567659072a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:12.485173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9bd6b212-4975-43e8-8ccd-8728d150cf53 None None] MFA Rules not processed for user `18433a452a7b417cb2668402bb5e60d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:12.485893 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-be6b6faa-a33c-4eec-a56a-ed567659072a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:12.486339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9bd6b212-4975-43e8-8ccd-8728d150cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:12.527891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:12.549618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b6faa-a33c-4eec-a56a-ed567659072a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:12.550812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1331/2661] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:12.554401 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8f5df-7694-4599-a79d-bcbe3b1abe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:12.555618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8f5df-7694-4599-a79d-bcbe3b1abe18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:12.555900 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8f5df-7694-4599-a79d-bcbe3b1abe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:12.556172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8f5df-7694-4599-a79d-bcbe3b1abe18 admin admin] PATH_INFO: `/v3/users/04c4d0820574464099e60883d12740a5` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:12.557389 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8f5df-7694-4599-a79d-bcbe3b1abe18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c4d0820574464099e60883d12740a5)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:12.559350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8f5df-7694-4599-a79d-bcbe3b1abe18 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:12.582433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b212-4975-43e8-8ccd-8728d150cf53 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:12.583841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9bd6b212-4975-43e8-8ccd-8728d150cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:12.638983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b212-4975-43e8-8ccd-8728d150cf53 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:12.642536 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb93faf-09b2-4f87-a456-873bbd586c50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:12.643179 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb93faf-09b2-4f87-a456-873bbd586c50 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:12.643464 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb93faf-09b2-4f87-a456-873bbd586c50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:12.643737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb93faf-09b2-4f87-a456-873bbd586c50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:12.652898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb93faf-09b2-4f87-a456-873bbd586c50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:12.654474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb93faf-09b2-4f87-a456-873bbd586c50 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:12.664053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1332/2662] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:12.680851 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb93faf-09b2-4f87-a456-873bbd586c50 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:12.692556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb93faf-09b2-4f87-a456-873bbd586c50 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:12.697155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c424ca7-62e6-40c0-accd-0b8696129edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:12.698020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424ca7-62e6-40c0-accd-0b8696129edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:12.701503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424ca7-62e6-40c0-accd-0b8696129edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:12.701503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c424ca7-62e6-40c0-accd-0b8696129edc admin admin] PATH_INFO: `/v3/users/18433a452a7b417cb2668402bb5e60d0` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:12.701503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c424ca7-62e6-40c0-accd-0b8696129edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=18433a452a7b417cb2668402bb5e60d0)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:12.702286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c424ca7-62e6-40c0-accd-0b8696129edc admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:12.737992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-38d8f5df-7694-4599-a79d-bcbe3b1abe18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c4d0820574464099e60883d12740a5'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:12.738903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-38d8f5df-7694-4599-a79d-bcbe3b1abe18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c4d0820574464099e60883d12740a5'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:12.830205 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-38d8f5df-7694-4599-a79d-bcbe3b1abe18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c4d0820574464099e60883d12740a5'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:12.842828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-38d8f5df-7694-4599-a79d-bcbe3b1abe18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c4d0820574464099e60883d12740a5'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:12.849637 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-38d8f5df-7694-4599-a79d-bcbe3b1abe18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c4d0820574464099e60883d12740a5'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:12.856463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1331/2663] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:12 2022] DELETE /identity/v3/users/04c4d0820574464099e60883d12740a5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:12.861489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebefc3-2ec1-4cad-8080-cb3ac46affeb None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:12.861783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebefc3-2ec1-4cad-8080-cb3ac46affeb None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:12.862067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebefc3-2ec1-4cad-8080-cb3ac46affeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:12.880483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-a2ebefc3-2ec1-4cad-8080-cb3ac46affeb None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:12.881692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a2ebefc3-2ec1-4cad-8080-cb3ac46affeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:12.909457 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:12.911655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3c424ca7-62e6-40c0-accd-0b8696129edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18433a452a7b417cb2668402bb5e60d0'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:12.912669 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3c424ca7-62e6-40c0-accd-0b8696129edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18433a452a7b417cb2668402bb5e60d0'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:12.927143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3c424ca7-62e6-40c0-accd-0b8696129edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18433a452a7b417cb2668402bb5e60d0'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:12.949826 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1332/2664] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:12.959913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebefc3-2ec1-4cad-8080-cb3ac46affeb None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:12.961408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a2ebefc3-2ec1-4cad-8080-cb3ac46affeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:13.001181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3c424ca7-62e6-40c0-accd-0b8696129edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18433a452a7b417cb2668402bb5e60d0'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:13.008878 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-3c424ca7-62e6-40c0-accd-0b8696129edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18433a452a7b417cb2668402bb5e60d0'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:13.014825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1333/2665] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:12 2022] DELETE /identity/v3/users/18433a452a7b417cb2668402bb5e60d0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:13.017517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebefc3-2ec1-4cad-8080-cb3ac46affeb None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:13.019358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e2cbb-3306-4ee9-9e2b-89f7c827a334 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:13.019651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e2cbb-3306-4ee9-9e2b-89f7c827a334 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:13.019932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e2cbb-3306-4ee9-9e2b-89f7c827a334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:13.026475 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:13.037693 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-e02e2cbb-3306-4ee9-9e2b-89f7c827a334 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:13.038962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e02e2cbb-3306-4ee9-9e2b-89f7c827a334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:13.066786 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83ef93-38df-41b0-8823-0f8591c5e397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:13.067447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ef93-38df-41b0-8823-0f8591c5e397 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:13.067752 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ef93-38df-41b0-8823-0f8591c5e397 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:13.068007 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ef93-38df-41b0-8823-0f8591c5e397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:13.102459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1334/2666] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:13.112337 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e2cbb-3306-4ee9-9e2b-89f7c827a334 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:13.127136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e2cbb-3306-4ee9-9e2b-89f7c827a334 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:13.130855 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b60408-9b7a-4bc0-a099-2a861ed5da77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:13.131510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b60408-9b7a-4bc0-a099-2a861ed5da77 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:13.131798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b60408-9b7a-4bc0-a099-2a861ed5da77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:13.132077 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b60408-9b7a-4bc0-a099-2a861ed5da77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:13.132502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83ef93-38df-41b0-8823-0f8591c5e397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:13.133979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83ef93-38df-41b0-8823-0f8591c5e397 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:13.141667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b60408-9b7a-4bc0-a099-2a861ed5da77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:13.143344 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b60408-9b7a-4bc0-a099-2a861ed5da77 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:13.144108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1333/2667] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:13.156541 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1335/2668] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:13.709155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83ef93-38df-41b0-8823-0f8591c5e397 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:13.710718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2a83ef93-38df-41b0-8823-0f8591c5e397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:13.723672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83ef93-38df-41b0-8823-0f8591c5e397 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:13.728283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:13.729275 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:13.729415 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:13.729689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] PATH_INFO: `/v3/projects/b6bd5e3fe2db47f4990e6662e3ca29c3` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:13.730882 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bd5e3fe2db47f4990e6662e3ca29c3)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:13.732915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:13.754564 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b60408-9b7a-4bc0-a099-2a861ed5da77 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:13.755983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d3b60408-9b7a-4bc0-a099-2a861ed5da77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:13.778099 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b60408-9b7a-4bc0-a099-2a861ed5da77 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:13.783780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:13.784648 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:13.785133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:13.785441 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] PATH_INFO: `/v3/projects/c7f79283855641549a3a89df258d8bed` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:13.786790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f79283855641549a3a89df258d8bed)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:13.789461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:13.834596 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bd5e3fe2db47f4990e6662e3ca29c3', 'request_id': 'req-025f61e8-0603-4231-9fb9-357c23a36044'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:13.907499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f79283855641549a3a89df258d8bed', 'request_id': 'req-197cb240-977b-4ea9-b0b6-99b32e9ac35c'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:13.918439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bd5e3fe2db47f4990e6662e3ca29c3', 'request_id': 'req-025f61e8-0603-4231-9fb9-357c23a36044'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:13.925109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bd5e3fe2db47f4990e6662e3ca29c3', 'request_id': 'req-025f61e8-0603-4231-9fb9-357c23a36044'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:13.937003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] The token cache is being invalidate because project b6bd5e3fe2db47f4990e6662e3ca29c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:13.937294 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:13.937969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:13.939527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1334/2669] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:13 2022] DELETE /identity/v3/projects/b6bd5e3fe2db47f4990e6662e3ca29c3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:13.943441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:13.944790 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:13.995055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:14.006764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f79283855641549a3a89df258d8bed', 'request_id': 'req-197cb240-977b-4ea9-b0b6-99b32e9ac35c'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:14.010591 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f61e8-0603-4231-9fb9-357c23a36044 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:14.013964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f79283855641549a3a89df258d8bed', 'request_id': 'req-197cb240-977b-4ea9-b0b6-99b32e9ac35c'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:14.024358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] The token cache is being invalidate because project c7f79283855641549a3a89df258d8bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:14.024642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:14.025274 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-197cb240-977b-4ea9-b0b6-99b32e9ac35c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:14.026852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1336/2670] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:13 2022] DELETE /identity/v3/projects/c7f79283855641549a3a89df258d8bed => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:14.031498 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b2da0-89e5-462a-b8fd-428447ddd8b0 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:14.031835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b2da0-89e5-462a-b8fd-428447ddd8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:14.032118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b2da0-89e5-462a-b8fd-428447ddd8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:14.054260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-db1b2da0-89e5-462a-b8fd-428447ddd8b0 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:14.055754 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-db1b2da0-89e5-462a-b8fd-428447ddd8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:14.071615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:14.072494 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:14.072776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:14.073051 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] PATH_INFO: `/v3/users/4ffee4f06f934b2d9ed104c0ad8a6c3f` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:14.074283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffee4f06f934b2d9ed104c0ad8a6c3f)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:14.076461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:14.087398 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:14.116605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1337/2671] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:14.124474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0c2c-1faa-497e-9539-4ed64eb3401f None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:14.124768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0c2c-1faa-497e-9539-4ed64eb3401f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:14.125048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0c2c-1faa-497e-9539-4ed64eb3401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:14.142544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-525d0c2c-1faa-497e-9539-4ed64eb3401f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:14.143733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-525d0c2c-1faa-497e-9539-4ed64eb3401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:14.151566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1338/2672] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:14.155686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0c2c-1faa-497e-9539-4ed64eb3401f None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:14.164898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0c2c-1faa-497e-9539-4ed64eb3401f None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:14.170116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b2deb-ff8c-45e9-b5fa-c79eb821a174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:14.170813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2deb-ff8c-45e9-b5fa-c79eb821a174 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:14.171147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2deb-ff8c-45e9-b5fa-c79eb821a174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:14.171424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2deb-ff8c-45e9-b5fa-c79eb821a174 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:14.172142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b2deb-ff8c-45e9-b5fa-c79eb821a174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:54:14.172498 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b2deb-ff8c-45e9-b5fa-c79eb821a174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:14.174054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b2deb-ff8c-45e9-b5fa-c79eb821a174 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:14.187074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1339/2673] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:54:14.191384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b2deb-ff8c-45e9-b5fa-c79eb821a174 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:14.201371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b2deb-ff8c-45e9-b5fa-c79eb821a174 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:14.205929 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea220-7465-443e-8998-1e6415159898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:14.206586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea220-7465-443e-8998-1e6415159898 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:14.206871 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea220-7465-443e-8998-1e6415159898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:14.207148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea220-7465-443e-8998-1e6415159898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:14.207824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ea220-7465-443e-8998-1e6415159898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:14.209698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ea220-7465-443e-8998-1e6415159898 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:14.321293 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1340/2674] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:14 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:14.325390 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea220-7465-443e-8998-1e6415159898 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:14.327616 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffee4f06f934b2d9ed104c0ad8a6c3f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:14.328369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffee4f06f934b2d9ed104c0ad8a6c3f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:14.392058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea220-7465-443e-8998-1e6415159898 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:14.393111 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffee4f06f934b2d9ed104c0ad8a6c3f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:14.397160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758267-96b4-4136-a0b7-c2f2e5c13ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:14.397869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758267-96b4-4136-a0b7-c2f2e5c13ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:14.398362 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758267-96b4-4136-a0b7-c2f2e5c13ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:14.398647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758267-96b4-4136-a0b7-c2f2e5c13ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:14.399346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758267-96b4-4136-a0b7-c2f2e5c13ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:14.401264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758267-96b4-4136-a0b7-c2f2e5c13ce3 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:14.414420 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffee4f06f934b2d9ed104c0ad8a6c3f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:14.422907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffee4f06f934b2d9ed104c0ad8a6c3f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:14.430127 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1335/2675] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:13 2022] DELETE /identity/v3/users/4ffee4f06f934b2d9ed104c0ad8a6c3f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:14.582418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1341/2676] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:14 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:14.584309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:14.585851 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:14.659822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5377271-2796-4b52-801d-9a063080316d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:14.664502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72640c24-817b-4715-865a-28adc146464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:14.665163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640c24-817b-4715-865a-28adc146464a admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:14.665442 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640c24-817b-4715-865a-28adc146464a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:14.665715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640c24-817b-4715-865a-28adc146464a admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:14.666458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72640c24-817b-4715-865a-28adc146464a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:14.668074 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72640c24-817b-4715-865a-28adc146464a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:14.678194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1336/2677] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:14.682251 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758267-96b4-4136-a0b7-c2f2e5c13ce3 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:14.692465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758267-96b4-4136-a0b7-c2f2e5c13ce3 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:14.697093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586271d-a4f8-4ca5-9c1e-572e8b628c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:14.697749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586271d-a4f8-4ca5-9c1e-572e8b628c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:14.698032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586271d-a4f8-4ca5-9c1e-572e8b628c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:14.698338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586271d-a4f8-4ca5-9c1e-572e8b628c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:14.699065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586271d-a4f8-4ca5-9c1e-572e8b628c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:14.700983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586271d-a4f8-4ca5-9c1e-572e8b628c58 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:14.712471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1342/2678] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:14.720206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72640c24-817b-4715-865a-28adc146464a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:14.726742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72640c24-817b-4715-865a-28adc146464a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:14.732933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cec2d4-4362-41d2-9e72-46d9e3e17092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:14.733840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cec2d4-4362-41d2-9e72-46d9e3e17092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:14.734128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cec2d4-4362-41d2-9e72-46d9e3e17092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:14.734439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cec2d4-4362-41d2-9e72-46d9e3e17092 admin admin] PATH_INFO: `/v3/projects/89b9b90b4997406c9cf5915349f38d71/users/eb3fdd1fdd8042ae996331fde4874547/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:14.738669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:14.751683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cec2d4-4362-41d2-9e72-46d9e3e17092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b9b90b4997406c9cf5915349f38d71, user_id=eb3fdd1fdd8042ae996331fde4874547, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:14.754398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cec2d4-4362-41d2-9e72-46d9e3e17092 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:14.934179 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1337/2679] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:14 2022] PUT /identity/v3/projects/89b9b90b4997406c9cf5915349f38d71/users/eb3fdd1fdd8042ae996331fde4874547/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:14.944490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46513248-6f80-40d8-b287-bd89bdb09aaa None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:14.944788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46513248-6f80-40d8-b287-bd89bdb09aaa None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:14.945071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46513248-6f80-40d8-b287-bd89bdb09aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:14.974263 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-46513248-6f80-40d8-b287-bd89bdb09aaa None None] MFA Rules not processed for user `eb3fdd1fdd8042ae996331fde4874547`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:14.975493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-46513248-6f80-40d8-b287-bd89bdb09aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:14.991613 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cec2d4-4362-41d2-9e72-46d9e3e17092 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:14.993518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-09cec2d4-4362-41d2-9e72-46d9e3e17092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:15.049737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:15.053517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1343/2680] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:15.065604 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46513248-6f80-40d8-b287-bd89bdb09aaa None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:15.066926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-46513248-6f80-40d8-b287-bd89bdb09aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:15.073077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cec2d4-4362-41d2-9e72-46d9e3e17092 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:15.078774 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:15.079726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:15.080219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:15.080219 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] PATH_INFO: `/v3/projects/9ef9dfdc845d403380cbbbc50cff5888` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:15.081485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef9dfdc845d403380cbbbc50cff5888)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:15.083633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:15.130329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46513248-6f80-40d8-b287-bd89bdb09aaa None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:15.134781 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea450b5-bee5-47d5-ad9b-f095780d34c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5498a6912a08408d9ea30920faceee7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:15.135428 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea450b5-bee5-47d5-ad9b-f095780d34c0 service glance] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:15.135709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea450b5-bee5-47d5-ad9b-f095780d34c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:15.136010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea450b5-bee5-47d5-ad9b-f095780d34c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:15.145453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea450b5-bee5-47d5-ad9b-f095780d34c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:15.146913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea450b5-bee5-47d5-ad9b-f095780d34c0 service glance] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:15.155745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1344/2681] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:15.215171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef9dfdc845d403380cbbbc50cff5888', 'request_id': 'req-b5e77ecb-77b6-477c-a4a9-e6142a750be8'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:15.264002 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef9dfdc845d403380cbbbc50cff5888', 'request_id': 'req-b5e77ecb-77b6-477c-a4a9-e6142a750be8'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:15.270683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef9dfdc845d403380cbbbc50cff5888', 'request_id': 'req-b5e77ecb-77b6-477c-a4a9-e6142a750be8'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:15.282977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] The token cache is being invalidate because project 9ef9dfdc845d403380cbbbc50cff5888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:15.283262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:15.283925 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:15.285501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1338/2682] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:14 2022] DELETE /identity/v3/projects/9ef9dfdc845d403380cbbbc50cff5888 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:15.289603 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea450b5-bee5-47d5-ad9b-f095780d34c0 service glance] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:15.301581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea450b5-bee5-47d5-ad9b-f095780d34c0 service glance] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:15.363401 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:15.371667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:15.371667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:15.371667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] PATH_INFO: `/v3/users/140d62a1318d45d4966147326147f985` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:15.371667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=140d62a1318d45d4966147326147f985)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:15.371667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:15.535105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140d62a1318d45d4966147326147f985'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:15.535764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140d62a1318d45d4966147326147f985'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:15.548055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140d62a1318d45d4966147326147f985'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:15.665875 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140d62a1318d45d4966147326147f985'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:15.678155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140d62a1318d45d4966147326147f985'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:15.690360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1345/2683] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:15 2022] DELETE /identity/v3/users/140d62a1318d45d4966147326147f985 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:16.142887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:16.142887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:16.157930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e77ecb-77b6-477c-a4a9-e6142a750be8 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:16.236231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:16.236231 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:16.236456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:16.236668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] PATH_INFO: `/v3/projects/f853166a973744ec8cd413755127b45f` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:16.237910 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f853166a973744ec8cd413755127b45f)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:16.239940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:16.263643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:16.304745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:16.306279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:16.321243 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94ad69-6b4a-4e1b-9b78-60445c84cd5c admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:16.326150 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d199e-f877-49e4-840f-8ff86a385659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:16.327074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d199e-f877-49e4-840f-8ff86a385659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:16.327354 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d199e-f877-49e4-840f-8ff86a385659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:16.327626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d199e-f877-49e4-840f-8ff86a385659 admin admin] PATH_INFO: `/v3/users/8dbf176cf3a74957868396435a05d7c8` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:16.328792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d199e-f877-49e4-840f-8ff86a385659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbf176cf3a74957868396435a05d7c8)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:16.330738 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d199e-f877-49e4-840f-8ff86a385659 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:16.346863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:16.384750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f853166a973744ec8cd413755127b45f', 'request_id': 'req-e1fb87ba-41d6-44ee-ac00-b7381549dd96'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:16.438726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f853166a973744ec8cd413755127b45f', 'request_id': 'req-e1fb87ba-41d6-44ee-ac00-b7381549dd96'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:16.444976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f853166a973744ec8cd413755127b45f', 'request_id': 'req-e1fb87ba-41d6-44ee-ac00-b7381549dd96'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:16.456183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] The token cache is being invalidate because project f853166a973744ec8cd413755127b45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:16.456469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:16.457089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-e1fb87ba-41d6-44ee-ac00-b7381549dd96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:16.458646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1339/2684] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:16 2022] DELETE /identity/v3/projects/f853166a973744ec8cd413755127b45f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:16.465487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dde235-841c-41d5-a002-f12cfef4a7b3 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:16.465778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dde235-841c-41d5-a002-f12cfef4a7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:16.466060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dde235-841c-41d5-a002-f12cfef4a7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:16.483761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-f8dde235-841c-41d5-a002-f12cfef4a7b3 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:16.484960 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f8dde235-841c-41d5-a002-f12cfef4a7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:16.531910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-c58d199e-f877-49e4-840f-8ff86a385659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbf176cf3a74957868396435a05d7c8'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:16.532621 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-c58d199e-f877-49e4-840f-8ff86a385659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbf176cf3a74957868396435a05d7c8'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:16.543228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1340/2685] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:16.548555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-c58d199e-f877-49e4-840f-8ff86a385659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbf176cf3a74957868396435a05d7c8'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:16.553439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740a16e-5c48-4aae-af37-ae3a921fbbae None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:16.553725 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740a16e-5c48-4aae-af37-ae3a921fbbae None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:16.554009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740a16e-5c48-4aae-af37-ae3a921fbbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:16.574194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-5740a16e-5c48-4aae-af37-ae3a921fbbae None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:16.575711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5740a16e-5c48-4aae-af37-ae3a921fbbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:16.583609 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1341/2686] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:16.592578 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740a16e-5c48-4aae-af37-ae3a921fbbae None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:16.601282 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740a16e-5c48-4aae-af37-ae3a921fbbae None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:16.605894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677152d-1fb2-4ea4-81bb-fb20841b7e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:16.606563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677152d-1fb2-4ea4-81bb-fb20841b7e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:16.607376 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677152d-1fb2-4ea4-81bb-fb20841b7e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:16.607649 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677152d-1fb2-4ea4-81bb-fb20841b7e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:16.608363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677152d-1fb2-4ea4-81bb-fb20841b7e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:54:16.608666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677152d-1fb2-4ea4-81bb-fb20841b7e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:16.610260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677152d-1fb2-4ea4-81bb-fb20841b7e26 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:16.621471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1342/2687] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:54:16.626317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677152d-1fb2-4ea4-81bb-fb20841b7e26 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:16.636063 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677152d-1fb2-4ea4-81bb-fb20841b7e26 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:16.641597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dda35-0c25-4d4b-9d90-95a90da48c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:16.641919 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-c58d199e-f877-49e4-840f-8ff86a385659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbf176cf3a74957868396435a05d7c8'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:16.644713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dda35-0c25-4d4b-9d90-95a90da48c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:16.644713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dda35-0c25-4d4b-9d90-95a90da48c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:16.644713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dda35-0c25-4d4b-9d90-95a90da48c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:16.644713 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dda35-0c25-4d4b-9d90-95a90da48c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:16.645327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dda35-0c25-4d4b-9d90-95a90da48c1d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:16.654120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-c58d199e-f877-49e4-840f-8ff86a385659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbf176cf3a74957868396435a05d7c8'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:16.661002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1346/2688] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:16 2022] DELETE /identity/v3/users/8dbf176cf3a74957868396435a05d7c8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:16.667917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4272723-f270-4d19-bd8c-c009ab155f3f None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:16.667917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4272723-f270-4d19-bd8c-c009ab155f3f None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:16.667917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4272723-f270-4d19-bd8c-c009ab155f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:16.684167 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-d4272723-f270-4d19-bd8c-c009ab155f3f None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:16.685364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d4272723-f270-4d19-bd8c-c009ab155f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:16.724516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1343/2689] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:16 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:16.729595 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dda35-0c25-4d4b-9d90-95a90da48c1d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:16.751329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1347/2690] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:16.757936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4272723-f270-4d19-bd8c-c009ab155f3f None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:16.759454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d4272723-f270-4d19-bd8c-c009ab155f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:16.791824 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dda35-0c25-4d4b-9d90-95a90da48c1d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:16.797304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab4e63-2c10-48cc-a795-81b0623f1726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:16.798012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4e63-2c10-48cc-a795-81b0623f1726 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:16.798326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4e63-2c10-48cc-a795-81b0623f1726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:16.798601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4e63-2c10-48cc-a795-81b0623f1726 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:16.799289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab4e63-2c10-48cc-a795-81b0623f1726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:16.801208 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab4e63-2c10-48cc-a795-81b0623f1726 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:16.828858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4272723-f270-4d19-bd8c-c009ab155f3f None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:16.871733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7126c50-f935-434b-ae62-dc3c21f461ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:16.872427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7126c50-f935-434b-ae62-dc3c21f461ed service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:16.872710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7126c50-f935-434b-ae62-dc3c21f461ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:16.872988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7126c50-f935-434b-ae62-dc3c21f461ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:16.882744 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7126c50-f935-434b-ae62-dc3c21f461ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:16.884182 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7126c50-f935-434b-ae62-dc3c21f461ed service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:16.893546 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1348/2691] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:16.959776 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1344/2692] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:16 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:16.961983 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7126c50-f935-434b-ae62-dc3c21f461ed service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:16.962703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:16.972941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7126c50-f935-434b-ae62-dc3c21f461ed service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:16.978729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398931e-f28a-437e-ab8d-12d355e6f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:16.979388 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398931e-f28a-437e-ab8d-12d355e6f0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:16.979675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398931e-f28a-437e-ab8d-12d355e6f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:16.979950 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398931e-f28a-437e-ab8d-12d355e6f0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:16.980667 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398931e-f28a-437e-ab8d-12d355e6f0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:16.982882 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398931e-f28a-437e-ab8d-12d355e6f0ee admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:16.993194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1349/2693] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:16.997399 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab4e63-2c10-48cc-a795-81b0623f1726 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:17.008116 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab4e63-2c10-48cc-a795-81b0623f1726 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:17.012670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350a68a-4154-4f05-ac4f-a6b6efe4759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:17.013821 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350a68a-4154-4f05-ac4f-a6b6efe4759a admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.014105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350a68a-4154-4f05-ac4f-a6b6efe4759a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.014414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350a68a-4154-4f05-ac4f-a6b6efe4759a admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.015142 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350a68a-4154-4f05-ac4f-a6b6efe4759a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:17.016741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350a68a-4154-4f05-ac4f-a6b6efe4759a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:17.026539 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1345/2694] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:17.031445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398931e-f28a-437e-ab8d-12d355e6f0ee admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:17.041416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398931e-f28a-437e-ab8d-12d355e6f0ee admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:17.046047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72770785-9fa9-4c51-94df-23bfa83abf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:17.046962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72770785-9fa9-4c51-94df-23bfa83abf5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.047243 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72770785-9fa9-4c51-94df-23bfa83abf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.047520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72770785-9fa9-4c51-94df-23bfa83abf5c admin admin] PATH_INFO: `/v3/projects/1f4d0864898f42b4809721a451f24f59/users/8324c6fa0fc9419391e8e6d80725bef4/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.062420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72770785-9fa9-4c51-94df-23bfa83abf5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4d0864898f42b4809721a451f24f59, user_id=8324c6fa0fc9419391e8e6d80725bef4, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:17.065176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72770785-9fa9-4c51-94df-23bfa83abf5c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:17.112305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:17.151823 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1350/2695] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:17 2022] PUT /identity/v3/projects/1f4d0864898f42b4809721a451f24f59/users/8324c6fa0fc9419391e8e6d80725bef4/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:17.163095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ce6f5-62d3-4ac6-a389-2a9382547b69 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.163615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ce6f5-62d3-4ac6-a389-2a9382547b69 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.163719 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ce6f5-62d3-4ac6-a389-2a9382547b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.193533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-d11ce6f5-62d3-4ac6-a389-2a9382547b69 None None] MFA Rules not processed for user `8324c6fa0fc9419391e8e6d80725bef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:17.194907 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d11ce6f5-62d3-4ac6-a389-2a9382547b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:17.278183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1346/2696] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:17.282812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72770785-9fa9-4c51-94df-23bfa83abf5c admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:17.333394 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ce6f5-62d3-4ac6-a389-2a9382547b69 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:17.334837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d11ce6f5-62d3-4ac6-a389-2a9382547b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:17.353881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72770785-9fa9-4c51-94df-23bfa83abf5c admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:17.360981 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3e83-f973-462c-9959-e2dd34226a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:17.361663 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3e83-f973-462c-9959-e2dd34226a66 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.361964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3e83-f973-462c-9959-e2dd34226a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.362225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3e83-f973-462c-9959-e2dd34226a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.362936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3e83-f973-462c-9959-e2dd34226a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:17.364883 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3e83-f973-462c-9959-e2dd34226a66 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:17.419887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ce6f5-62d3-4ac6-a389-2a9382547b69 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:17.424574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:17.425427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.425709 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.426099 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] PATH_INFO: `/v3/projects/a4a02a4e765c4d9ebd7c3f67a51e6392` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.427322 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a02a4e765c4d9ebd7c3f67a51e6392)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:17.429209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:17.439933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1351/2697] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:17 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:17.443953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3e83-f973-462c-9959-e2dd34226a66 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:17.508123 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3e83-f973-462c-9959-e2dd34226a66 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:17.513240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce1f28-fb48-4c8a-901b-dceeb98d6bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:17.513945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1f28-fb48-4c8a-901b-dceeb98d6bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.514181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1f28-fb48-4c8a-901b-dceeb98d6bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.514537 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1f28-fb48-4c8a-901b-dceeb98d6bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.515230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce1f28-fb48-4c8a-901b-dceeb98d6bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:17.517231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce1f28-fb48-4c8a-901b-dceeb98d6bb3 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:17.546254 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a02a4e765c4d9ebd7c3f67a51e6392', 'request_id': 'req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:17.618509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1352/2698] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:17 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:17.622835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce1f28-fb48-4c8a-901b-dceeb98d6bb3 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:17.624712 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a02a4e765c4d9ebd7c3f67a51e6392', 'request_id': 'req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:17.631503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a02a4e765c4d9ebd7c3f67a51e6392', 'request_id': 'req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:17.633427 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce1f28-fb48-4c8a-901b-dceeb98d6bb3 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:17.642905 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] The token cache is being invalidate because project a4a02a4e765c4d9ebd7c3f67a51e6392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:17.643200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:17.643845 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:17.645499 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1347/2699] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:17 2022] DELETE /identity/v3/projects/a4a02a4e765c4d9ebd7c3f67a51e6392 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:17.649597 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:17.651134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:17.657146 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:17.684625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:17.693204 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264229b-ae98-4d62-8902-974b570c4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:17.693914 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264229b-ae98-4d62-8902-974b570c4587 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.694199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264229b-ae98-4d62-8902-974b570c4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.694498 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264229b-ae98-4d62-8902-974b570c4587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.695232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264229b-ae98-4d62-8902-974b570c4587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:17.696963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264229b-ae98-4d62-8902-974b570c4587 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:17.707023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1353/2700] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:17.712413 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264229b-ae98-4d62-8902-974b570c4587 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:17.714126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e264229b-ae98-4d62-8902-974b570c4587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:17.721373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8979c60-7fa6-4e2f-a02d-fe0d3bc56b66 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:17.726328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:17.727111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264229b-ae98-4d62-8902-974b570c4587 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:17.727241 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.727472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.727749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] PATH_INFO: `/v3/users/85d6f88e853944aa8518b0eb67d1203e` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.728921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d6f88e853944aa8518b0eb67d1203e)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:17.731187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:17.732300 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6271ab0-1d6c-4931-9bfb-3a8bbdc7c18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:17.733193 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271ab0-1d6c-4931-9bfb-3a8bbdc7c18f admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.733566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271ab0-1d6c-4931-9bfb-3a8bbdc7c18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.733762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271ab0-1d6c-4931-9bfb-3a8bbdc7c18f admin admin] PATH_INFO: `/v3/projects/a4b368c9d9b24bab84dce33af9b5f089/users/17d3b310ab034843a616f656346381dd/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.749405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6271ab0-1d6c-4931-9bfb-3a8bbdc7c18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b368c9d9b24bab84dce33af9b5f089, user_id=17d3b310ab034843a616f656346381dd, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:17.752672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6271ab0-1d6c-4931-9bfb-3a8bbdc7c18f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:17.830660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1354/2701] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:17 2022] PUT /identity/v3/projects/a4b368c9d9b24bab84dce33af9b5f089/users/17d3b310ab034843a616f656346381dd/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:17.834434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6271ab0-1d6c-4931-9bfb-3a8bbdc7c18f admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:17.896171 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6271ab0-1d6c-4931-9bfb-3a8bbdc7c18f admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:17.901001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d967a-0fca-49fd-b76a-cd4c0b640461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:17.902654 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d967a-0fca-49fd-b76a-cd4c0b640461 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.902654 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d967a-0fca-49fd-b76a-cd4c0b640461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.902654 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d967a-0fca-49fd-b76a-cd4c0b640461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.902991 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d967a-0fca-49fd-b76a-cd4c0b640461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:17.904610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d967a-0fca-49fd-b76a-cd4c0b640461 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:17.914749 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1355/2702] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:17.918935 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d967a-0fca-49fd-b76a-cd4c0b640461 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:17.930206 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d967a-0fca-49fd-b76a-cd4c0b640461 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:17.935686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3464a-3a80-4eb3-838e-6709955e926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:17.936524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3464a-3a80-4eb3-838e-6709955e926c admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.936918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3464a-3a80-4eb3-838e-6709955e926c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.937202 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3464a-3a80-4eb3-838e-6709955e926c admin admin] PATH_INFO: `/v3/projects/a4b368c9d9b24bab84dce33af9b5f089/users/17d3b310ab034843a616f656346381dd/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.939242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3464a-3a80-4eb3-838e-6709955e926c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b368c9d9b24bab84dce33af9b5f089, user_id=17d3b310ab034843a616f656346381dd, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:17.941872 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3464a-3a80-4eb3-838e-6709955e926c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:17.952395 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1356/2703] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:17 2022] PUT /identity/v3/projects/a4b368c9d9b24bab84dce33af9b5f089/users/17d3b310ab034843a616f656346381dd/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:17.962895 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5e36b-0016-4b6f-a3a2-ed3a8960d42d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:17.963187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5e36b-0016-4b6f-a3a2-ed3a8960d42d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:17.963473 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5e36b-0016-4b6f-a3a2-ed3a8960d42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:17.964273 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d6f88e853944aa8518b0eb67d1203e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:17.964953 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d6f88e853944aa8518b0eb67d1203e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:17.990922 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-82c5e36b-0016-4b6f-a3a2-ed3a8960d42d None None] MFA Rules not processed for user `17d3b310ab034843a616f656346381dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:17.992135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-82c5e36b-0016-4b6f-a3a2-ed3a8960d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:18.030020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d6f88e853944aa8518b0eb67d1203e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:18.043201 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d6f88e853944aa8518b0eb67d1203e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:18.051008 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d6f88e853944aa8518b0eb67d1203e'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:18.057608 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1348/2704] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:17 2022] DELETE /identity/v3/users/85d6f88e853944aa8518b0eb67d1203e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:18.067102 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1357/2705] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:18.079460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:18.081014 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:18.147160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf10f39-69b1-40da-a60f-98faf02b38cb admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:18.151352 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b70ba-d2f0-4725-add5-e17651a23220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:18.154188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b70ba-d2f0-4725-add5-e17651a23220 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:18.154188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b70ba-d2f0-4725-add5-e17651a23220 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:18.154188 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b70ba-d2f0-4725-add5-e17651a23220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:18.155564 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-937b70ba-d2f0-4725-add5-e17651a23220 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:18.191737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:18.217102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b70ba-d2f0-4725-add5-e17651a23220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:18.218562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b70ba-d2f0-4725-add5-e17651a23220 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:18.227773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1349/2706] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:18.497052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5e36b-0016-4b6f-a3a2-ed3a8960d42d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:18.499175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-82c5e36b-0016-4b6f-a3a2-ed3a8960d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:18.517185 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:18.574058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5e36b-0016-4b6f-a3a2-ed3a8960d42d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:18.633162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:18.634046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:18.634369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:18.634650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] PATH_INFO: `/v3/projects/0ca7c09ee9594e9d89afc5dd088c2473` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:18.635861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca7c09ee9594e9d89afc5dd088c2473)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:18.637884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:18.739158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca7c09ee9594e9d89afc5dd088c2473', 'request_id': 'req-68e199d0-402f-4efd-a1ce-b91633014a1b'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:18.838460 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca7c09ee9594e9d89afc5dd088c2473', 'request_id': 'req-68e199d0-402f-4efd-a1ce-b91633014a1b'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:18.845341 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca7c09ee9594e9d89afc5dd088c2473', 'request_id': 'req-68e199d0-402f-4efd-a1ce-b91633014a1b'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:18.855802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] The token cache is being invalidate because project 0ca7c09ee9594e9d89afc5dd088c2473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:18.856093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:18.857217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:18.858810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1358/2707] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:18 2022] DELETE /identity/v3/projects/0ca7c09ee9594e9d89afc5dd088c2473 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:18.863165 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b70ba-d2f0-4725-add5-e17651a23220 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:18.874846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b70ba-d2f0-4725-add5-e17651a23220 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:18.932603 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3e50a-9252-429a-9301-cd240bfe74d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:18.933483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e50a-9252-429a-9301-cd240bfe74d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:18.933768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e50a-9252-429a-9301-cd240bfe74d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:18.934042 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e50a-9252-429a-9301-cd240bfe74d2 admin admin] PATH_INFO: `/v3/users/ee753600ad054cdea32fdeb6ba3c74b3` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:18.935322 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3e50a-9252-429a-9301-cd240bfe74d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee753600ad054cdea32fdeb6ba3c74b3)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:18.937255 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3e50a-9252-429a-9301-cd240bfe74d2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:19.163796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-f6c3e50a-9252-429a-9301-cd240bfe74d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee753600ad054cdea32fdeb6ba3c74b3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:19.164468 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-f6c3e50a-9252-429a-9301-cd240bfe74d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee753600ad054cdea32fdeb6ba3c74b3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:19.247213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-f6c3e50a-9252-429a-9301-cd240bfe74d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee753600ad054cdea32fdeb6ba3c74b3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:19.260576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-f6c3e50a-9252-429a-9301-cd240bfe74d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee753600ad054cdea32fdeb6ba3c74b3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:19.268268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-f6c3e50a-9252-429a-9301-cd240bfe74d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee753600ad054cdea32fdeb6ba3c74b3'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:19.274667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1350/2708] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:18 2022] DELETE /identity/v3/users/ee753600ad054cdea32fdeb6ba3c74b3 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:19.647557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:19.649026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:19.662661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e199d0-402f-4efd-a1ce-b91633014a1b admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:19.716234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:19.726010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:19.727022 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:19.730716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:19.730716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] PATH_INFO: `/v3/projects/e99a1914127c4b609b0a33f20926eb4f` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:19.730716 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99a1914127c4b609b0a33f20926eb4f)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:19.731053 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:19.877044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99a1914127c4b609b0a33f20926eb4f', 'request_id': 'req-d2900d94-b54a-4e36-b261-12ea63984f37'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:19.944490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99a1914127c4b609b0a33f20926eb4f', 'request_id': 'req-d2900d94-b54a-4e36-b261-12ea63984f37'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:19.953319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99a1914127c4b609b0a33f20926eb4f', 'request_id': 'req-d2900d94-b54a-4e36-b261-12ea63984f37'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:19.964009 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] The token cache is being invalidate because project e99a1914127c4b609b0a33f20926eb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:19.964295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:19.964935 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d2900d94-b54a-4e36-b261-12ea63984f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:19.967330 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1359/2709] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:19 2022] DELETE /identity/v3/projects/e99a1914127c4b609b0a33f20926eb4f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:19.975040 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbc910-f478-4348-9359-c4f4607f38e5 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:19.976939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbc910-f478-4348-9359-c4f4607f38e5 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:19.976939 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbc910-f478-4348-9359-c4f4607f38e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:19.994833 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-31fbc910-f478-4348-9359-c4f4607f38e5 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:19.998022 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-31fbc910-f478-4348-9359-c4f4607f38e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:20.051646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:20.063891 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1351/2710] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:20.073487 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83e5f-30d2-42a0-9396-55ba2f3b793e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:20.074453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83e5f-30d2-42a0-9396-55ba2f3b793e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:20.074453 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83e5f-30d2-42a0-9396-55ba2f3b793e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:20.094725 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-7dd83e5f-30d2-42a0-9396-55ba2f3b793e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:20.097410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7dd83e5f-30d2-42a0-9396-55ba2f3b793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:20.103967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1360/2711] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:20.108843 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbc910-f478-4348-9359-c4f4607f38e5 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:20.119256 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbc910-f478-4348-9359-c4f4607f38e5 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:20.125509 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeac622-b479-474b-bf00-29a1e866a5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:20.126312 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeac622-b479-474b-bf00-29a1e866a5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:20.126643 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeac622-b479-474b-bf00-29a1e866a5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:20.126963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeac622-b479-474b-bf00-29a1e866a5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:20.127751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeac622-b479-474b-bf00-29a1e866a5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:54:20.128058 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeac622-b479-474b-bf00-29a1e866a5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:20.129677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeac622-b479-474b-bf00-29a1e866a5e9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:20.143469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1352/2712] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:54:20.147624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd83e5f-30d2-42a0-9396-55ba2f3b793e None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:20.157244 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd83e5f-30d2-42a0-9396-55ba2f3b793e None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:20.161963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ba64e-88a0-4560-839e-16512a27d048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:20.162651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ba64e-88a0-4560-839e-16512a27d048 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:20.169626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ba64e-88a0-4560-839e-16512a27d048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:20.169626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ba64e-88a0-4560-839e-16512a27d048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:20.169626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ba64e-88a0-4560-839e-16512a27d048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:20.169626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ba64e-88a0-4560-839e-16512a27d048 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:20.277490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1361/2713] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:20 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:20.281345 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeac622-b479-474b-bf00-29a1e866a5e9 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:20.291865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeac622-b479-474b-bf00-29a1e866a5e9 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:20.349678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db18fe-4b87-4cab-981e-b59ba844cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:20.350394 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db18fe-4b87-4cab-981e-b59ba844cb3b admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:20.350684 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db18fe-4b87-4cab-981e-b59ba844cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:20.350966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db18fe-4b87-4cab-981e-b59ba844cb3b admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:20.351673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db18fe-4b87-4cab-981e-b59ba844cb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:20.353599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db18fe-4b87-4cab-981e-b59ba844cb3b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:20.454197 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1353/2714] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:20 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:20.458412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ba64e-88a0-4560-839e-16512a27d048 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:20.469650 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ba64e-88a0-4560-839e-16512a27d048 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:20.474543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b7d5d-f422-45f2-a532-0ef72cbe7839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:20.475217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7d5d-f422-45f2-a532-0ef72cbe7839 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:20.475503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7d5d-f422-45f2-a532-0ef72cbe7839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:20.475783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7d5d-f422-45f2-a532-0ef72cbe7839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:20.476520 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b7d5d-f422-45f2-a532-0ef72cbe7839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:20.478131 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b7d5d-f422-45f2-a532-0ef72cbe7839 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:20.496648 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1362/2715] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:20.497874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db18fe-4b87-4cab-981e-b59ba844cb3b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:20.508675 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db18fe-4b87-4cab-981e-b59ba844cb3b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:20.514106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c147812-8b73-4085-972e-70228a78825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:20.514896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c147812-8b73-4085-972e-70228a78825b admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:20.515158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c147812-8b73-4085-972e-70228a78825b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:20.515436 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c147812-8b73-4085-972e-70228a78825b admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:20.516194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c147812-8b73-4085-972e-70228a78825b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:20.517788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c147812-8b73-4085-972e-70228a78825b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:20.528932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1354/2716] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:20.532957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b7d5d-f422-45f2-a532-0ef72cbe7839 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:20.543980 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b7d5d-f422-45f2-a532-0ef72cbe7839 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:20.549165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd44fc-b9b6-4571-a989-f577b8b43bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:20.550122 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd44fc-b9b6-4571-a989-f577b8b43bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:20.550448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd44fc-b9b6-4571-a989-f577b8b43bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:20.550725 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd44fc-b9b6-4571-a989-f577b8b43bd5 admin admin] PATH_INFO: `/v3/projects/663e3f170d2545bf889296d9cf93bf97/users/c8ba43f9b9a341f0be2ab879dc55e8fd/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:20.565839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd44fc-b9b6-4571-a989-f577b8b43bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663e3f170d2545bf889296d9cf93bf97, user_id=c8ba43f9b9a341f0be2ab879dc55e8fd, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:20.570627 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd44fc-b9b6-4571-a989-f577b8b43bd5 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:20.687087 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1363/2717] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:20 2022] PUT /identity/v3/projects/663e3f170d2545bf889296d9cf93bf97/users/c8ba43f9b9a341f0be2ab879dc55e8fd/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:20.701050 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516778f5-841a-4191-bc5b-a844b6ba9f13 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:20.701366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516778f5-841a-4191-bc5b-a844b6ba9f13 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:20.701664 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516778f5-841a-4191-bc5b-a844b6ba9f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:20.729793 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-516778f5-841a-4191-bc5b-a844b6ba9f13 None None] MFA Rules not processed for user `c8ba43f9b9a341f0be2ab879dc55e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:20.731035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-516778f5-841a-4191-bc5b-a844b6ba9f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:20.799281 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1355/2718] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:20.811010 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd44fc-b9b6-4571-a989-f577b8b43bd5 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:20.812728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-44bd44fc-b9b6-4571-a989-f577b8b43bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:20.880021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd44fc-b9b6-4571-a989-f577b8b43bd5 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:20.883602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109340c1-1119-4555-b661-2826fe3b035a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:20.884240 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109340c1-1119-4555-b661-2826fe3b035a service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:20.884519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109340c1-1119-4555-b661-2826fe3b035a service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:20.884780 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109340c1-1119-4555-b661-2826fe3b035a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:20.893904 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109340c1-1119-4555-b661-2826fe3b035a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:20.895432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109340c1-1119-4555-b661-2826fe3b035a service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:20.905463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1364/2719] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:29.926460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516778f5-841a-4191-bc5b-a844b6ba9f13 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:29.942527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516778f5-841a-4191-bc5b-a844b6ba9f13 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:29.946451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabca2a3-aa4b-40c9-bcef-6eddbbc8db0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:29.947305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabca2a3-aa4b-40c9-bcef-6eddbbc8db0c service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:29.947707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabca2a3-aa4b-40c9-bcef-6eddbbc8db0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:29.947865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabca2a3-aa4b-40c9-bcef-6eddbbc8db0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:29.949906 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-aabca2a3-aa4b-40c9-bcef-6eddbbc8db0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:30.004559 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:30.019881 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabca2a3-aa4b-40c9-bcef-6eddbbc8db0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:30.021350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabca2a3-aa4b-40c9-bcef-6eddbbc8db0c service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:30.031836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1356/2720] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:30.900665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:35.123099 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109340c1-1119-4555-b661-2826fe3b035a service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:35.125675 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-109340c1-1119-4555-b661-2826fe3b035a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:35.191153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109340c1-1119-4555-b661-2826fe3b035a service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:35.196036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:35.196910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:35.197195 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:35.197474 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] PATH_INFO: `/v3/users/a4a61cfbc2cd4a229a345617e18148d2` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:35.198745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a61cfbc2cd4a229a345617e18148d2)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:35.201529 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:35.378013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a61cfbc2cd4a229a345617e18148d2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:35.378739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a61cfbc2cd4a229a345617e18148d2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:35.393433 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a61cfbc2cd4a229a345617e18148d2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:35.469442 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a61cfbc2cd4a229a345617e18148d2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:35.476899 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a61cfbc2cd4a229a345617e18148d2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:35.486348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1365/2721] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:35 2022] DELETE /identity/v3/users/a4a61cfbc2cd4a229a345617e18148d2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:35.489624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507557-46ad-4a12-a45f-c1007801f24b None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:35.490123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507557-46ad-4a12-a45f-c1007801f24b None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:35.490261 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507557-46ad-4a12-a45f-c1007801f24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:35.507753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-ae507557-46ad-4a12-a45f-c1007801f24b None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:35.508981 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ae507557-46ad-4a12-a45f-c1007801f24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:35.568980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1357/2722] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:35.579522 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:35.580943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:35.640000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bf669-64dc-43b6-adc3-6dbf2c66849e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:35.643517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf026f7-f808-4339-b460-482daaf23a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:35.644155 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf026f7-f808-4339-b460-482daaf23a7f service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:35.644434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf026f7-f808-4339-b460-482daaf23a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:35.644706 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf026f7-f808-4339-b460-482daaf23a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:35.653795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf026f7-f808-4339-b460-482daaf23a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:35.655903 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf026f7-f808-4339-b460-482daaf23a7f service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:35.665268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1366/2723] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:36.093731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507557-46ad-4a12-a45f-c1007801f24b None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:36.095178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ae507557-46ad-4a12-a45f-c1007801f24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:36.106974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507557-46ad-4a12-a45f-c1007801f24b None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:36.112202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:36.113195 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:36.113486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:36.113760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] PATH_INFO: `/v3/projects/a643734a7b59414c9ef4c27dad11d84e` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:36.114994 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a643734a7b59414c9ef4c27dad11d84e)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:36.116915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:36.229901 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a643734a7b59414c9ef4c27dad11d84e', 'request_id': 'req-a60cedcd-47d5-401e-95a8-eac6956e7ac5'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:36.309547 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a643734a7b59414c9ef4c27dad11d84e', 'request_id': 'req-a60cedcd-47d5-401e-95a8-eac6956e7ac5'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:36.316113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a643734a7b59414c9ef4c27dad11d84e', 'request_id': 'req-a60cedcd-47d5-401e-95a8-eac6956e7ac5'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:36.327554 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] The token cache is being invalidate because project a643734a7b59414c9ef4c27dad11d84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:36.327838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:36.328532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:36.330073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1358/2724] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:36 2022] DELETE /identity/v3/projects/a643734a7b59414c9ef4c27dad11d84e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:36.334059 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf026f7-f808-4339-b460-482daaf23a7f service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:36.344011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf026f7-f808-4339-b460-482daaf23a7f service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:36.362612 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:36.400470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3cc2a-2f71-49e3-a5b2-0deaa7d9f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:36.401270 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3cc2a-2f71-49e3-a5b2-0deaa7d9f53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:36.401557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3cc2a-2f71-49e3-a5b2-0deaa7d9f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:36.401835 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3cc2a-2f71-49e3-a5b2-0deaa7d9f53c admin admin] PATH_INFO: `/v3/users/a6a6b1a0ca5d4220a257148ebc262ee6` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:36.403051 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3cc2a-2f71-49e3-a5b2-0deaa7d9f53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a6b1a0ca5d4220a257148ebc262ee6)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:36.405116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3cc2a-2f71-49e3-a5b2-0deaa7d9f53c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:36.669531 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-43d3cc2a-2f71-49e3-a5b2-0deaa7d9f53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a6b1a0ca5d4220a257148ebc262ee6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:36.670137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-43d3cc2a-2f71-49e3-a5b2-0deaa7d9f53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a6b1a0ca5d4220a257148ebc262ee6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:36.683091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-43d3cc2a-2f71-49e3-a5b2-0deaa7d9f53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a6b1a0ca5d4220a257148ebc262ee6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:36.778295 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-43d3cc2a-2f71-49e3-a5b2-0deaa7d9f53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a6b1a0ca5d4220a257148ebc262ee6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:36.785757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-43d3cc2a-2f71-49e3-a5b2-0deaa7d9f53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a6b1a0ca5d4220a257148ebc262ee6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:36.791905 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1367/2725] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:36 2022] DELETE /identity/v3/users/a6a6b1a0ca5d4220a257148ebc262ee6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:37.237982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:37.237982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:37.250339 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cedcd-47d5-401e-95a8-eac6956e7ac5 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:37.308137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:37.309103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:37.309381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:37.309657 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] PATH_INFO: `/v3/projects/7655c8b0af7d400e813935756a6fcd4b` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:37.310853 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7655c8b0af7d400e813935756a6fcd4b)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:37.314122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:37.325889 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:37.421738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7655c8b0af7d400e813935756a6fcd4b', 'request_id': 'req-764f402b-0ff2-46e9-baa6-c2299e4ab013'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:37.486694 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7655c8b0af7d400e813935756a6fcd4b', 'request_id': 'req-764f402b-0ff2-46e9-baa6-c2299e4ab013'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:37.497719 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7655c8b0af7d400e813935756a6fcd4b', 'request_id': 'req-764f402b-0ff2-46e9-baa6-c2299e4ab013'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:37.504108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] The token cache is being invalidate because project 7655c8b0af7d400e813935756a6fcd4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:37.504395 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:37.505123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-764f402b-0ff2-46e9-baa6-c2299e4ab013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:37.506720 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1359/2726] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:37 2022] DELETE /identity/v3/projects/7655c8b0af7d400e813935756a6fcd4b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:37.511617 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95a8ad-950b-4ad1-bb60-3180b874958d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:37.512114 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95a8ad-950b-4ad1-bb60-3180b874958d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:37.512217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95a8ad-950b-4ad1-bb60-3180b874958d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:37.530560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-5d95a8ad-950b-4ad1-bb60-3180b874958d None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:37.531755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5d95a8ad-950b-4ad1-bb60-3180b874958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:37.590107 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1368/2727] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:37.598593 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92e0c4-e928-4445-9649-02d2b8b5c568 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:37.598883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92e0c4-e928-4445-9649-02d2b8b5c568 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:37.599158 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92e0c4-e928-4445-9649-02d2b8b5c568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:37.618577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-2b92e0c4-e928-4445-9649-02d2b8b5c568 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:37.619772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2b92e0c4-e928-4445-9649-02d2b8b5c568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:37.627787 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1360/2728] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:37.631861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95a8ad-950b-4ad1-bb60-3180b874958d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:37.642028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95a8ad-950b-4ad1-bb60-3180b874958d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:37.646600 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dfa9f-433c-4a5e-a192-8a30245f5fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:37.647245 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dfa9f-433c-4a5e-a192-8a30245f5fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:37.647526 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dfa9f-433c-4a5e-a192-8a30245f5fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:37.647798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dfa9f-433c-4a5e-a192-8a30245f5fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:37.648512 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dfa9f-433c-4a5e-a192-8a30245f5fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:54:37.648814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dfa9f-433c-4a5e-a192-8a30245f5fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:37.650426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dfa9f-433c-4a5e-a192-8a30245f5fc2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:37.662644 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1369/2729] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:54:37.666757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92e0c4-e928-4445-9649-02d2b8b5c568 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:37.676796 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92e0c4-e928-4445-9649-02d2b8b5c568 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:37.681832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6ce8c-bf6a-409e-91d1-dd924c945e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:37.682523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6ce8c-bf6a-409e-91d1-dd924c945e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:37.682800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6ce8c-bf6a-409e-91d1-dd924c945e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:37.683067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6ce8c-bf6a-409e-91d1-dd924c945e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:37.683757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6ce8c-bf6a-409e-91d1-dd924c945e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:37.685641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6ce8c-bf6a-409e-91d1-dd924c945e00 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:37.781916 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1361/2730] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:37 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:37.783129 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dfa9f-433c-4a5e-a192-8a30245f5fc2 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:37.795130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dfa9f-433c-4a5e-a192-8a30245f5fc2 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:37.827920 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:37.858672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5aaa1-5734-4d2f-bac7-7117c1aefd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:37.859394 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5aaa1-5734-4d2f-bac7-7117c1aefd30 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:37.859677 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5aaa1-5734-4d2f-bac7-7117c1aefd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:37.859955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5aaa1-5734-4d2f-bac7-7117c1aefd30 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:37.860641 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5aaa1-5734-4d2f-bac7-7117c1aefd30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:37.862626 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5aaa1-5734-4d2f-bac7-7117c1aefd30 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:37.941181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1370/2731] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:37 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:37.945479 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6ce8c-bf6a-409e-91d1-dd924c945e00 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:37.956731 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6ce8c-bf6a-409e-91d1-dd924c945e00 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:37.961555 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5eda54-7333-4757-a52d-286c388482c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:37.962360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eda54-7333-4757-a52d-286c388482c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:37.962648 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eda54-7333-4757-a52d-286c388482c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:37.962927 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eda54-7333-4757-a52d-286c388482c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:37.963662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5eda54-7333-4757-a52d-286c388482c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:37.965248 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5eda54-7333-4757-a52d-286c388482c4 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:37.976292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1362/2732] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:37.980363 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5aaa1-5734-4d2f-bac7-7117c1aefd30 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:37.990489 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5aaa1-5734-4d2f-bac7-7117c1aefd30 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:37.995147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d597-e047-4ff0-8250-408757c9d2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:37.995809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d597-e047-4ff0-8250-408757c9d2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:37.996094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d597-e047-4ff0-8250-408757c9d2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:37.996373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d597-e047-4ff0-8250-408757c9d2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:37.997139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514d597-e047-4ff0-8250-408757c9d2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:37.999258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514d597-e047-4ff0-8250-408757c9d2b4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:38.010074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1371/2733] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:38.015983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5eda54-7333-4757-a52d-286c388482c4 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:38.025923 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5eda54-7333-4757-a52d-286c388482c4 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:38.030775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69beda6-b176-4254-bd72-2bfd3e32db9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:38.032872 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69beda6-b176-4254-bd72-2bfd3e32db9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:38.036338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69beda6-b176-4254-bd72-2bfd3e32db9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:38.036338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69beda6-b176-4254-bd72-2bfd3e32db9c admin admin] PATH_INFO: `/v3/projects/a365750d84b040f0b01727806bdf9cb1/users/86c8fcfc32c44160b95af7f6a52a0aae/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:38.050321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69beda6-b176-4254-bd72-2bfd3e32db9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a365750d84b040f0b01727806bdf9cb1, user_id=86c8fcfc32c44160b95af7f6a52a0aae, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:38.053321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69beda6-b176-4254-bd72-2bfd3e32db9c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:38.153039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1363/2734] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:38 2022] PUT /identity/v3/projects/a365750d84b040f0b01727806bdf9cb1/users/86c8fcfc32c44160b95af7f6a52a0aae/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:38.163095 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea49f2-5132-4559-90dd-cfc7605ab5ec None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:38.163410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea49f2-5132-4559-90dd-cfc7605ab5ec None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:38.163688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea49f2-5132-4559-90dd-cfc7605ab5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:38.191012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-abea49f2-5132-4559-90dd-cfc7605ab5ec None None] MFA Rules not processed for user `86c8fcfc32c44160b95af7f6a52a0aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:38.192231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-abea49f2-5132-4559-90dd-cfc7605ab5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:38.256619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1372/2735] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:38.261268 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69beda6-b176-4254-bd72-2bfd3e32db9c admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:38.327234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69beda6-b176-4254-bd72-2bfd3e32db9c admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:38.332350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29a49f-e801-4053-9874-00f8b535eece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:38.333138 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a49f-e801-4053-9874-00f8b535eece admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:38.333427 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a49f-e801-4053-9874-00f8b535eece admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:38.337012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a49f-e801-4053-9874-00f8b535eece admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:38.337012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29a49f-e801-4053-9874-00f8b535eece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:38.337012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29a49f-e801-4053-9874-00f8b535eece admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:38.416592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1364/2736] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:38 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:38.421242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea49f2-5132-4559-90dd-cfc7605ab5ec None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:38.432439 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea49f2-5132-4559-90dd-cfc7605ab5ec None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:38.488535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7483b-5626-4931-9b69-68046672de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:38.489257 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7483b-5626-4931-9b69-68046672de95 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:38.489521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7483b-5626-4931-9b69-68046672de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:38.489800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7483b-5626-4931-9b69-68046672de95 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:38.490550 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7483b-5626-4931-9b69-68046672de95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:38.492482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7483b-5626-4931-9b69-68046672de95 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:38.596670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1373/2737] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:38 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:38.602321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29a49f-e801-4053-9874-00f8b535eece admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:38.613175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29a49f-e801-4053-9874-00f8b535eece admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:38.617978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d652a5e-b778-4ee2-b2ed-2756208c7fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:38.618665 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d652a5e-b778-4ee2-b2ed-2756208c7fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:38.618950 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d652a5e-b778-4ee2-b2ed-2756208c7fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:38.619227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d652a5e-b778-4ee2-b2ed-2756208c7fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:38.620016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d652a5e-b778-4ee2-b2ed-2756208c7fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:38.621601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d652a5e-b778-4ee2-b2ed-2756208c7fd6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:38.632976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1365/2738] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:38.636812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7483b-5626-4931-9b69-68046672de95 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:38.646831 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7483b-5626-4931-9b69-68046672de95 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:38.651836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9f320-86b2-489e-b320-ed04f4573498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:38.652498 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f320-86b2-489e-b320-ed04f4573498 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:38.652779 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f320-86b2-489e-b320-ed04f4573498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:38.653050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9f320-86b2-489e-b320-ed04f4573498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:38.653771 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9f320-86b2-489e-b320-ed04f4573498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:38.655377 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9f320-86b2-489e-b320-ed04f4573498 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:38.665434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1374/2739] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:38.669424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d652a5e-b778-4ee2-b2ed-2756208c7fd6 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:38.680028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d652a5e-b778-4ee2-b2ed-2756208c7fd6 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:38.684695 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579df7c-40ca-4c19-956d-16cb0f02d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:38.685624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579df7c-40ca-4c19-956d-16cb0f02d05d admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:38.686487 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579df7c-40ca-4c19-956d-16cb0f02d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:38.686775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579df7c-40ca-4c19-956d-16cb0f02d05d admin admin] PATH_INFO: `/v3/projects/e71538173b044b20a8251ce3e692a1ae/users/b5bc4c986f8448449757b87fcc2709b7/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:38.689778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:38.701645 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579df7c-40ca-4c19-956d-16cb0f02d05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71538173b044b20a8251ce3e692a1ae, user_id=b5bc4c986f8448449757b87fcc2709b7, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:38.704332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579df7c-40ca-4c19-956d-16cb0f02d05d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:38.766200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1366/2740] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:38 2022] PUT /identity/v3/projects/e71538173b044b20a8251ce3e692a1ae/users/b5bc4c986f8448449757b87fcc2709b7/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:38.776458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58edd0-a315-4023-95a7-0cf13588c958 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:38.776759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58edd0-a315-4023-95a7-0cf13588c958 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:38.777036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58edd0-a315-4023-95a7-0cf13588c958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:38.811783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ca58edd0-a315-4023-95a7-0cf13588c958 None None] MFA Rules not processed for user `b5bc4c986f8448449757b87fcc2709b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:38.811783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ca58edd0-a315-4023-95a7-0cf13588c958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:38.811783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:38.874991 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1375/2741] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:38.879879 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579df7c-40ca-4c19-956d-16cb0f02d05d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:38.941781 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579df7c-40ca-4c19-956d-16cb0f02d05d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:38.946572 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c5416-32af-40cd-b34f-5dc60e930fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:38.947225 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5416-32af-40cd-b34f-5dc60e930fec admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:38.947511 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5416-32af-40cd-b34f-5dc60e930fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:38.947773 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5416-32af-40cd-b34f-5dc60e930fec admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:38.948467 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c5416-32af-40cd-b34f-5dc60e930fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:38.950615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c5416-32af-40cd-b34f-5dc60e930fec admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:39.048198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1367/2742] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:38 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:39.052373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58edd0-a315-4023-95a7-0cf13588c958 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:39.063055 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58edd0-a315-4023-95a7-0cf13588c958 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:39.114370 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c5416-32af-40cd-b34f-5dc60e930fec admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:39.116084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e85c5416-32af-40cd-b34f-5dc60e930fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:39.120252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99f971-d96b-4021-a816-d38903d661b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:39.120998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99f971-d96b-4021-a816-d38903d661b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:39.121340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99f971-d96b-4021-a816-d38903d661b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:39.121619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99f971-d96b-4021-a816-d38903d661b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:39.122335 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99f971-d96b-4021-a816-d38903d661b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:39.124419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99f971-d96b-4021-a816-d38903d661b4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:39.131628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c5416-32af-40cd-b34f-5dc60e930fec admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:39.137025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c428937-cfa9-410f-a797-e85f553914ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:39.138027 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428937-cfa9-410f-a797-e85f553914ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:39.138434 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428937-cfa9-410f-a797-e85f553914ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:39.138718 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428937-cfa9-410f-a797-e85f553914ab admin admin] PATH_INFO: `/v3/users/8324c6fa0fc9419391e8e6d80725bef4` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:39.140526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c428937-cfa9-410f-a797-e85f553914ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8324c6fa0fc9419391e8e6d80725bef4)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:39.142631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c428937-cfa9-410f-a797-e85f553914ab admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:39.241318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1376/2743] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:39 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:39.245152 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99f971-d96b-4021-a816-d38903d661b4 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:39.254544 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99f971-d96b-4021-a816-d38903d661b4 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:39.259353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231cbd5-2c7c-4c06-af94-00f6209a6073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:39.260006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231cbd5-2c7c-4c06-af94-00f6209a6073 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:39.260291 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231cbd5-2c7c-4c06-af94-00f6209a6073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:39.260569 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231cbd5-2c7c-4c06-af94-00f6209a6073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:39.261294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231cbd5-2c7c-4c06-af94-00f6209a6073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:39.262933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231cbd5-2c7c-4c06-af94-00f6209a6073 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:39.273350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1377/2744] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:39.277318 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231cbd5-2c7c-4c06-af94-00f6209a6073 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:39.287348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231cbd5-2c7c-4c06-af94-00f6209a6073 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:39.292634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8373e-d558-4f53-91ff-2f8d17b5963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:39.293499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8373e-d558-4f53-91ff-2f8d17b5963e admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:39.293850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8373e-d558-4f53-91ff-2f8d17b5963e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:39.294126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8373e-d558-4f53-91ff-2f8d17b5963e admin admin] PATH_INFO: `/v3/projects/e079033dd6c44918aa34bb42f2f8993f/users/58bb68e2d9be45abb4f853b40691c026/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:39.308923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8373e-d558-4f53-91ff-2f8d17b5963e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e079033dd6c44918aa34bb42f2f8993f, user_id=58bb68e2d9be45abb4f853b40691c026, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:39.311703 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8373e-d558-4f53-91ff-2f8d17b5963e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:39.348936 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2c428937-cfa9-410f-a797-e85f553914ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8324c6fa0fc9419391e8e6d80725bef4'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:39.349692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2c428937-cfa9-410f-a797-e85f553914ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8324c6fa0fc9419391e8e6d80725bef4'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:39.429265 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1378/2745] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:39 2022] PUT /identity/v3/projects/e079033dd6c44918aa34bb42f2f8993f/users/58bb68e2d9be45abb4f853b40691c026/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:39.433135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8373e-d558-4f53-91ff-2f8d17b5963e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:39.435028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b1e8373e-d558-4f53-91ff-2f8d17b5963e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:39.435960 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2c428937-cfa9-410f-a797-e85f553914ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8324c6fa0fc9419391e8e6d80725bef4'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:39.449956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2c428937-cfa9-410f-a797-e85f553914ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8324c6fa0fc9419391e8e6d80725bef4'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:39.458895 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-2c428937-cfa9-410f-a797-e85f553914ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8324c6fa0fc9419391e8e6d80725bef4'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:39.465253 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1368/2746] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:39 2022] DELETE /identity/v3/users/8324c6fa0fc9419391e8e6d80725bef4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:39.470108 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a9cf-527a-4192-a567-c9fc61104d67 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:39.470424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a9cf-527a-4192-a567-c9fc61104d67 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:39.470703 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a9cf-527a-4192-a567-c9fc61104d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:39.487853 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-6a28a9cf-527a-4192-a567-c9fc61104d67 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:39.489054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6a28a9cf-527a-4192-a567-c9fc61104d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:39.506942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8373e-d558-4f53-91ff-2f8d17b5963e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:39.511262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:39.529036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:39.549180 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1369/2747] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:39.558934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28a9cf-527a-4192-a567-c9fc61104d67 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:39.560384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6a28a9cf-527a-4192-a567-c9fc61104d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:39.568577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53403ab-7985-45e7-9cb1-8f535da214f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:39.569310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53403ab-7985-45e7-9cb1-8f535da214f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:39.569591 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53403ab-7985-45e7-9cb1-8f535da214f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:39.569864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53403ab-7985-45e7-9cb1-8f535da214f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:39.570628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53403ab-7985-45e7-9cb1-8f535da214f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:39.572331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53403ab-7985-45e7-9cb1-8f535da214f8 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:39.583776 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1379/2748] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:39.589367 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53403ab-7985-45e7-9cb1-8f535da214f8 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:39.599841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53403ab-7985-45e7-9cb1-8f535da214f8 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:39.604824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497a43-4339-4d8a-8ff8-b2dbb4fb2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:39.605715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497a43-4339-4d8a-8ff8-b2dbb4fb2631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:39.606050 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497a43-4339-4d8a-8ff8-b2dbb4fb2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:39.606365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497a43-4339-4d8a-8ff8-b2dbb4fb2631 admin admin] PATH_INFO: `/v3/projects/e079033dd6c44918aa34bb42f2f8993f/users/58bb68e2d9be45abb4f853b40691c026/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:39.612907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497a43-4339-4d8a-8ff8-b2dbb4fb2631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e079033dd6c44918aa34bb42f2f8993f, user_id=58bb68e2d9be45abb4f853b40691c026, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:39.612907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497a43-4339-4d8a-8ff8-b2dbb4fb2631 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:39.625497 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28a9cf-527a-4192-a567-c9fc61104d67 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:39.641684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1380/2749] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:39 2022] PUT /identity/v3/projects/e079033dd6c44918aa34bb42f2f8993f/users/58bb68e2d9be45abb4f853b40691c026/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:39.644486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e0390-b61a-412c-a152-c7c4dbc6c99b None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:39.644791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e0390-b61a-412c-a152-c7c4dbc6c99b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:39.645074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e0390-b61a-412c-a152-c7c4dbc6c99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:39.673624 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-a37e0390-b61a-412c-a152-c7c4dbc6c99b None None] MFA Rules not processed for user `58bb68e2d9be45abb4f853b40691c026`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:39.675013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a37e0390-b61a-412c-a152-c7c4dbc6c99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:39.679298 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c34fb-f041-47af-b1ba-25d4ff44e339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:39.679954 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c34fb-f041-47af-b1ba-25d4ff44e339 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:39.680244 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c34fb-f041-47af-b1ba-25d4ff44e339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:39.680528 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c34fb-f041-47af-b1ba-25d4ff44e339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:39.740966 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c34fb-f041-47af-b1ba-25d4ff44e339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:39.742447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c34fb-f041-47af-b1ba-25d4ff44e339 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:39.743614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1381/2750] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:39.753328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1370/2751] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:39.756336 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e0390-b61a-412c-a152-c7c4dbc6c99b None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:39.757284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a37e0390-b61a-412c-a152-c7c4dbc6c99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:39.832706 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e0390-b61a-412c-a152-c7c4dbc6c99b None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:39.836376 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5eb05c-0574-49a5-b057-6cf812c0ddc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:39.837032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eb05c-0574-49a5-b057-6cf812c0ddc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:39.837314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eb05c-0574-49a5-b057-6cf812c0ddc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:39.837588 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eb05c-0574-49a5-b057-6cf812c0ddc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:39.839469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3c5eb05c-0574-49a5-b057-6cf812c0ddc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:39.879345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:39.908097 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5eb05c-0574-49a5-b057-6cf812c0ddc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:39.909541 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5eb05c-0574-49a5-b057-6cf812c0ddc0 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:39.918806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1382/2752] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:40.177402 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c34fb-f041-47af-b1ba-25d4ff44e339 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:40.179708 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-831c34fb-f041-47af-b1ba-25d4ff44e339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:40.196344 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c34fb-f041-47af-b1ba-25d4ff44e339 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:40.202378 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:40.203995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:40.203995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:40.203995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] PATH_INFO: `/v3/projects/1f4d0864898f42b4809721a451f24f59` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:40.205667 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4d0864898f42b4809721a451f24f59)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:40.207914 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:40.352306 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:40.355940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4d0864898f42b4809721a451f24f59', 'request_id': 'req-522556eb-9882-4a6e-bb6c-ef39713f4ea0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:40.441410 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4d0864898f42b4809721a451f24f59', 'request_id': 'req-522556eb-9882-4a6e-bb6c-ef39713f4ea0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:40.447414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4d0864898f42b4809721a451f24f59', 'request_id': 'req-522556eb-9882-4a6e-bb6c-ef39713f4ea0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:40.458799 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] The token cache is being invalidate because project 1f4d0864898f42b4809721a451f24f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:40.459090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:40.459738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:40.461277 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1371/2753] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:40 2022] DELETE /identity/v3/projects/1f4d0864898f42b4809721a451f24f59 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:40.465371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5eb05c-0574-49a5-b057-6cf812c0ddc0 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:40.476678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5eb05c-0574-49a5-b057-6cf812c0ddc0 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:40.532816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caa2d3-2a66-4582-90c4-b95e482d74d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:40.533728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa2d3-2a66-4582-90c4-b95e482d74d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:40.534006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa2d3-2a66-4582-90c4-b95e482d74d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:40.534303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa2d3-2a66-4582-90c4-b95e482d74d2 admin admin] PATH_INFO: `/v3/users/17d3b310ab034843a616f656346381dd` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:40.535471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caa2d3-2a66-4582-90c4-b95e482d74d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d3b310ab034843a616f656346381dd)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:40.537377 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caa2d3-2a66-4582-90c4-b95e482d74d2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:40.773034 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-88caa2d3-2a66-4582-90c4-b95e482d74d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d3b310ab034843a616f656346381dd'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:40.773720 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-88caa2d3-2a66-4582-90c4-b95e482d74d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d3b310ab034843a616f656346381dd'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:40.786506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-88caa2d3-2a66-4582-90c4-b95e482d74d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d3b310ab034843a616f656346381dd'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:40.923879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-88caa2d3-2a66-4582-90c4-b95e482d74d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d3b310ab034843a616f656346381dd'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:40.931348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-88caa2d3-2a66-4582-90c4-b95e482d74d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d3b310ab034843a616f656346381dd'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:40.938158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1383/2754] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:40 2022] DELETE /identity/v3/users/17d3b310ab034843a616f656346381dd => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:41.347678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:41.349423 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:41.371838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522556eb-9882-4a6e-bb6c-ef39713f4ea0 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:41.435605 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:41.436476 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:41.436777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:41.437059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] PATH_INFO: `/v3/projects/a4b368c9d9b24bab84dce33af9b5f089` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:41.438262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b368c9d9b24bab84dce33af9b5f089)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:41.440280 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:41.564128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b368c9d9b24bab84dce33af9b5f089', 'request_id': 'req-b727abad-7f37-4a09-9b7b-1805f5935f69'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:41.706640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b368c9d9b24bab84dce33af9b5f089', 'request_id': 'req-b727abad-7f37-4a09-9b7b-1805f5935f69'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:41.712755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b368c9d9b24bab84dce33af9b5f089', 'request_id': 'req-b727abad-7f37-4a09-9b7b-1805f5935f69'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:41.724562 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] The token cache is being invalidate because project a4b368c9d9b24bab84dce33af9b5f089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:41.724847 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:41.725483 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-b727abad-7f37-4a09-9b7b-1805f5935f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:41.727220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1372/2755] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:41 2022] DELETE /identity/v3/projects/a4b368c9d9b24bab84dce33af9b5f089 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:41.733119 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0aabf-ebd7-498a-a73e-2422ecb77f87 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:41.733515 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0aabf-ebd7-498a-a73e-2422ecb77f87 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:41.734482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0aabf-ebd7-498a-a73e-2422ecb77f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:41.751692 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-93b0aabf-ebd7-498a-a73e-2422ecb77f87 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:41.752881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-93b0aabf-ebd7-498a-a73e-2422ecb77f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:41.798864 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:41.813714 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1384/2756] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:41.822061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4515-f2b2-4666-a23e-b1c515ae2a66 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:41.822327 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4515-f2b2-4666-a23e-b1c515ae2a66 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:41.822611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4515-f2b2-4666-a23e-b1c515ae2a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:41.840720 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-9dfd4515-f2b2-4666-a23e-b1c515ae2a66 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:41.843546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-9dfd4515-f2b2-4666-a23e-b1c515ae2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:41.852285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1373/2757] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:41.856468 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0aabf-ebd7-498a-a73e-2422ecb77f87 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:41.867665 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0aabf-ebd7-498a-a73e-2422ecb77f87 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:41.872333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6ee8b-cb15-4400-a5a7-eb92183beeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:41.872982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6ee8b-cb15-4400-a5a7-eb92183beeea admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:41.873263 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6ee8b-cb15-4400-a5a7-eb92183beeea admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:41.873538 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6ee8b-cb15-4400-a5a7-eb92183beeea admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:41.874558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6ee8b-cb15-4400-a5a7-eb92183beeea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:54:41.874867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6ee8b-cb15-4400-a5a7-eb92183beeea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:41.876432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6ee8b-cb15-4400-a5a7-eb92183beeea admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:41.888349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1385/2758] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:54:41.892711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd4515-f2b2-4666-a23e-b1c515ae2a66 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:41.901678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd4515-f2b2-4666-a23e-b1c515ae2a66 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:41.906759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c1852-574f-4ae1-845e-be3390a8d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:41.907405 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c1852-574f-4ae1-845e-be3390a8d23d admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:41.907672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c1852-574f-4ae1-845e-be3390a8d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:41.907944 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c1852-574f-4ae1-845e-be3390a8d23d admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:41.908631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c1852-574f-4ae1-845e-be3390a8d23d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:41.910523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c1852-574f-4ae1-845e-be3390a8d23d admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:41.985478 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1374/2759] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:41 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:41.989589 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6ee8b-cb15-4400-a5a7-eb92183beeea admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:41.999519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6ee8b-cb15-4400-a5a7-eb92183beeea admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:42.055995 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50737332-a226-4281-a480-a77b24d2747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:42.056661 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50737332-a226-4281-a480-a77b24d2747f admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:42.056945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50737332-a226-4281-a480-a77b24d2747f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:42.057241 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50737332-a226-4281-a480-a77b24d2747f admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:42.057923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50737332-a226-4281-a480-a77b24d2747f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:42.059845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50737332-a226-4281-a480-a77b24d2747f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:42.138483 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1386/2760] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:41 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:42.143504 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c1852-574f-4ae1-845e-be3390a8d23d admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:42.154131 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c1852-574f-4ae1-845e-be3390a8d23d admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:42.159636 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c4df3-5627-4358-9420-5618e0daa740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:42.160289 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c4df3-5627-4358-9420-5618e0daa740 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:42.160573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c4df3-5627-4358-9420-5618e0daa740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:42.160850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c4df3-5627-4358-9420-5618e0daa740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:42.161573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c4df3-5627-4358-9420-5618e0daa740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:42.163230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c4df3-5627-4358-9420-5618e0daa740 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:42.173541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1375/2761] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:42.177533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50737332-a226-4281-a480-a77b24d2747f admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:42.187480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50737332-a226-4281-a480-a77b24d2747f admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:42.197712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e4b51-fd32-43a3-b578-b27f76d31706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:42.197712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e4b51-fd32-43a3-b578-b27f76d31706 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:42.197712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e4b51-fd32-43a3-b578-b27f76d31706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:42.197712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e4b51-fd32-43a3-b578-b27f76d31706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:42.198125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e4b51-fd32-43a3-b578-b27f76d31706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:42.198125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e4b51-fd32-43a3-b578-b27f76d31706 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:42.206179 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1387/2762] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:42.210172 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c4df3-5627-4358-9420-5618e0daa740 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:42.220498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c4df3-5627-4358-9420-5618e0daa740 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:42.225026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3fcd4-bd02-46fb-8390-2138f4d9110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:42.225898 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3fcd4-bd02-46fb-8390-2138f4d9110b admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:42.226183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3fcd4-bd02-46fb-8390-2138f4d9110b admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:42.226496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3fcd4-bd02-46fb-8390-2138f4d9110b admin admin] PATH_INFO: `/v3/projects/d57d2a75c7b3422ab2aad596b2c7a026/users/34fec417f43d49fcac252f1f2dc53287/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:42.240668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3fcd4-bd02-46fb-8390-2138f4d9110b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57d2a75c7b3422ab2aad596b2c7a026, user_id=34fec417f43d49fcac252f1f2dc53287, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:42.243323 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3fcd4-bd02-46fb-8390-2138f4d9110b admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:42.315278 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:42.320547 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1376/2763] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:42 2022] PUT /identity/v3/projects/d57d2a75c7b3422ab2aad596b2c7a026/users/34fec417f43d49fcac252f1f2dc53287/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:42.332505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4415b-68a7-4edf-82f3-aff285d6b6be None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:42.332796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4415b-68a7-4edf-82f3-aff285d6b6be None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:42.333074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4415b-68a7-4edf-82f3-aff285d6b6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:42.360259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-12f4415b-68a7-4edf-82f3-aff285d6b6be None None] MFA Rules not processed for user `34fec417f43d49fcac252f1f2dc53287`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:42.361501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-12f4415b-68a7-4edf-82f3-aff285d6b6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:42.425073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1388/2764] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:42.435841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3fcd4-bd02-46fb-8390-2138f4d9110b admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:42.437989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e4f3fcd4-bd02-46fb-8390-2138f4d9110b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:42.493216 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3fcd4-bd02-46fb-8390-2138f4d9110b admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:42.496886 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8996ada-0434-43e6-8f02-004c5d98a35c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:42.497527 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8996ada-0434-43e6-8f02-004c5d98a35c service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:42.497810 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8996ada-0434-43e6-8f02-004c5d98a35c service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:42.498082 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8996ada-0434-43e6-8f02-004c5d98a35c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:42.506935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8996ada-0434-43e6-8f02-004c5d98a35c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:42.508432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8996ada-0434-43e6-8f02-004c5d98a35c service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:42.517788 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1377/2765] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:44.029754 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4415b-68a7-4edf-82f3-aff285d6b6be None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:44.031713 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-12f4415b-68a7-4edf-82f3-aff285d6b6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:44.044925 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4415b-68a7-4edf-82f3-aff285d6b6be None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:44.049088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241392eb-3ec1-4ab3-ac62-a55a02168dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:44.049734 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241392eb-3ec1-4ab3-ac62-a55a02168dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:44.050013 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241392eb-3ec1-4ab3-ac62-a55a02168dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:44.051148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241392eb-3ec1-4ab3-ac62-a55a02168dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:44.053250 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-241392eb-3ec1-4ab3-ac62-a55a02168dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:44.098632 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:44.117510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241392eb-3ec1-4ab3-ac62-a55a02168dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:44.118984 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241392eb-3ec1-4ab3-ac62-a55a02168dc2 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:44.128309 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1389/2766] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:46.000670 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8996ada-0434-43e6-8f02-004c5d98a35c service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:46.009324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8996ada-0434-43e6-8f02-004c5d98a35c service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:46.012930 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfaf2d-3113-453f-9614-85f5b48d9b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:46.013565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfaf2d-3113-453f-9614-85f5b48d9b43 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:46.013846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfaf2d-3113-453f-9614-85f5b48d9b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:46.014120 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfaf2d-3113-453f-9614-85f5b48d9b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:46.016372 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b7cfaf2d-3113-453f-9614-85f5b48d9b43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:46.081668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfaf2d-3113-453f-9614-85f5b48d9b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:46.083184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfaf2d-3113-453f-9614-85f5b48d9b43 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:46.092744 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1378/2767] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:52.821594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241392eb-3ec1-4ab3-ac62-a55a02168dc2 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:52.822999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-241392eb-3ec1-4ab3-ac62-a55a02168dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:52.878645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241392eb-3ec1-4ab3-ac62-a55a02168dc2 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:52.882194 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd89093-4acf-4d48-85cf-b25e30bdcce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:52.882867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd89093-4acf-4d48-85cf-b25e30bdcce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:52.883147 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd89093-4acf-4d48-85cf-b25e30bdcce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:52.883424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd89093-4acf-4d48-85cf-b25e30bdcce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:52.885162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-fcd89093-4acf-4d48-85cf-b25e30bdcce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:52.942552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd89093-4acf-4d48-85cf-b25e30bdcce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:52.944027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd89093-4acf-4d48-85cf-b25e30bdcce0 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:52.953610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1390/2768] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:54.419263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfaf2d-3113-453f-9614-85f5b48d9b43 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:54.421422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b7cfaf2d-3113-453f-9614-85f5b48d9b43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:54.502330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfaf2d-3113-453f-9614-85f5b48d9b43 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:54.507206 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c361cd4-ff57-47ed-a032-bbbfbc9ed2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:54.508729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c361cd4-ff57-47ed-a032-bbbfbc9ed2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:54.508729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c361cd4-ff57-47ed-a032-bbbfbc9ed2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:54.508990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c361cd4-ff57-47ed-a032-bbbfbc9ed2e9 admin admin] PATH_INFO: `/v3/users/c8ba43f9b9a341f0be2ab879dc55e8fd` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:54.510432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c361cd4-ff57-47ed-a032-bbbfbc9ed2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ba43f9b9a341f0be2ab879dc55e8fd)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:54.512480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c361cd4-ff57-47ed-a032-bbbfbc9ed2e9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:54.858565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:54.867463 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8c361cd4-ff57-47ed-a032-bbbfbc9ed2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ba43f9b9a341f0be2ab879dc55e8fd'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:54.868264 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8c361cd4-ff57-47ed-a032-bbbfbc9ed2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ba43f9b9a341f0be2ab879dc55e8fd'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:54.941050 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8c361cd4-ff57-47ed-a032-bbbfbc9ed2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ba43f9b9a341f0be2ab879dc55e8fd'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:54.958683 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd89093-4acf-4d48-85cf-b25e30bdcce0 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:54.960091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8c361cd4-ff57-47ed-a032-bbbfbc9ed2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ba43f9b9a341f0be2ab879dc55e8fd'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:54.967832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-8c361cd4-ff57-47ed-a032-bbbfbc9ed2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ba43f9b9a341f0be2ab879dc55e8fd'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:54.971850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd89093-4acf-4d48-85cf-b25e30bdcce0 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:54.974439 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1379/2769] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:54 2022] DELETE /identity/v3/users/c8ba43f9b9a341f0be2ab879dc55e8fd => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:54.979145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b44b8-fbd5-4934-a7a1-0a29b6ab35d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:54.979347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c399-d445-4a8e-9566-f8d7128594e5 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:54.979919 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c399-d445-4a8e-9566-f8d7128594e5 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:54.980048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b44b8-fbd5-4934-a7a1-0a29b6ab35d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:54.980141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c399-d445-4a8e-9566-f8d7128594e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:54.980299 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b44b8-fbd5-4934-a7a1-0a29b6ab35d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:54.980789 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b44b8-fbd5-4934-a7a1-0a29b6ab35d8 admin admin] PATH_INFO: `/v3/users/34fec417f43d49fcac252f1f2dc53287` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:54.982011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b44b8-fbd5-4934-a7a1-0a29b6ab35d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34fec417f43d49fcac252f1f2dc53287)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:54.984492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b44b8-fbd5-4934-a7a1-0a29b6ab35d8 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:55.004300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-33c8c399-d445-4a8e-9566-f8d7128594e5 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:55.005627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-33c8c399-d445-4a8e-9566-f8d7128594e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:55.077646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1380/2770] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:55.087104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c399-d445-4a8e-9566-f8d7128594e5 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:55.088626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-33c8c399-d445-4a8e-9566-f8d7128594e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:55.146724 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c399-d445-4a8e-9566-f8d7128594e5 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:55.150419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727375f4-e679-4277-83b8-596b70e802fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:55.151073 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727375f4-e679-4277-83b8-596b70e802fe service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:55.151356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727375f4-e679-4277-83b8-596b70e802fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:55.151638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727375f4-e679-4277-83b8-596b70e802fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:55.160235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2f4b44b8-fbd5-4934-a7a1-0a29b6ab35d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34fec417f43d49fcac252f1f2dc53287'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:55.160889 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2f4b44b8-fbd5-4934-a7a1-0a29b6ab35d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34fec417f43d49fcac252f1f2dc53287'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:55.163349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727375f4-e679-4277-83b8-596b70e802fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:55.163349 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727375f4-e679-4277-83b8-596b70e802fe service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:55.172947 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1381/2771] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:55.173243 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2f4b44b8-fbd5-4934-a7a1-0a29b6ab35d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34fec417f43d49fcac252f1f2dc53287'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:55.173814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727375f4-e679-4277-83b8-596b70e802fe service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:55.175223 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-727375f4-e679-4277-83b8-596b70e802fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:55.188189 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727375f4-e679-4277-83b8-596b70e802fe service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:55.192829 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:55.193692 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:55.194031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:55.194340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] PATH_INFO: `/v3/users/86c8fcfc32c44160b95af7f6a52a0aae` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:55.195563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c8fcfc32c44160b95af7f6a52a0aae)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:55.197467 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:55.251839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2f4b44b8-fbd5-4934-a7a1-0a29b6ab35d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34fec417f43d49fcac252f1f2dc53287'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:55.261658 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2f4b44b8-fbd5-4934-a7a1-0a29b6ab35d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34fec417f43d49fcac252f1f2dc53287'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:55.268813 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1391/2772] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:54 2022] DELETE /identity/v3/users/34fec417f43d49fcac252f1f2dc53287 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:55.272908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd19c-6045-4ad8-90c2-ecf81f39fe88 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:55.273197 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd19c-6045-4ad8-90c2-ecf81f39fe88 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:55.273475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd19c-6045-4ad8-90c2-ecf81f39fe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:55.293982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9c2dd19c-6045-4ad8-90c2-ecf81f39fe88 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:55.295255 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9c2dd19c-6045-4ad8-90c2-ecf81f39fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:55.300614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:55.377276 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1392/2773] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:55.384238 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dd19c-6045-4ad8-90c2-ecf81f39fe88 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:55.386143 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9c2dd19c-6045-4ad8-90c2-ecf81f39fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:55.433980 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c8fcfc32c44160b95af7f6a52a0aae'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:55.434672 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c8fcfc32c44160b95af7f6a52a0aae'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:55.440409 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:55.461305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dd19c-6045-4ad8-90c2-ecf81f39fe88 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:55.465159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462976f7-e313-44cd-8e02-63fab15ef706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:55.465816 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462976f7-e313-44cd-8e02-63fab15ef706 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:55.466104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462976f7-e313-44cd-8e02-63fab15ef706 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:55.466410 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462976f7-e313-44cd-8e02-63fab15ef706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:55.469637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-462976f7-e313-44cd-8e02-63fab15ef706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:55.483439 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462976f7-e313-44cd-8e02-63fab15ef706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:55.485894 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462976f7-e313-44cd-8e02-63fab15ef706 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:55.504234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1393/2774] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:55.544218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c8fcfc32c44160b95af7f6a52a0aae'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:55.558876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c8fcfc32c44160b95af7f6a52a0aae'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:55.565857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c8fcfc32c44160b95af7f6a52a0aae'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:55.571957 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1382/2775] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:55 2022] DELETE /identity/v3/users/86c8fcfc32c44160b95af7f6a52a0aae => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:55.578175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6dff7-4a7a-4203-804f-d92adbdd4575 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:55.578175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6dff7-4a7a-4203-804f-d92adbdd4575 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:55.578175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6dff7-4a7a-4203-804f-d92adbdd4575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:55.595552 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-fcf6dff7-4a7a-4203-804f-d92adbdd4575 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:55.596852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-fcf6dff7-4a7a-4203-804f-d92adbdd4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:55.664739 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:55.667054 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1394/2776] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:55.667328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:55.679536 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6dff7-4a7a-4203-804f-d92adbdd4575 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:55.681068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-fcf6dff7-4a7a-4203-804f-d92adbdd4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:55.684070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667ab3-6ea2-4e85-b04e-9a555997bccb admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:55.695059 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:55.696457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:55.696827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:55.697176 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] PATH_INFO: `/v3/projects/663e3f170d2545bf889296d9cf93bf97` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:55.699055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663e3f170d2545bf889296d9cf93bf97)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:55.710639 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:55.757088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6dff7-4a7a-4203-804f-d92adbdd4575 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:55.760765 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79b232-f01e-4741-af12-5fc66241da66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:55.761412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b232-f01e-4741-af12-5fc66241da66 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:55.761694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b232-f01e-4741-af12-5fc66241da66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:55.762009 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b232-f01e-4741-af12-5fc66241da66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:55.770324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:55.774005 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79b232-f01e-4741-af12-5fc66241da66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:55.775619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79b232-f01e-4741-af12-5fc66241da66 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:55.786634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1395/2777] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:55.799933 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79b232-f01e-4741-af12-5fc66241da66 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:55.802044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7a79b232-f01e-4741-af12-5fc66241da66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:55.884672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79b232-f01e-4741-af12-5fc66241da66 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:55.894521 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663e3f170d2545bf889296d9cf93bf97', 'request_id': 'req-fcb1b167-0507-464c-967b-e108763782d0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:55.974424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2c5b8-98e0-4742-b323-c0fe1fa98180 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:55.975695 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2c5b8-98e0-4742-b323-c0fe1fa98180 service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:55.976324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2c5b8-98e0-4742-b323-c0fe1fa98180 service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:55.976785 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2c5b8-98e0-4742-b323-c0fe1fa98180 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:55.978992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c2b2c5b8-98e0-4742-b323-c0fe1fa98180 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:55.991553 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2c5b8-98e0-4742-b323-c0fe1fa98180 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:55.993161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2c5b8-98e0-4742-b323-c0fe1fa98180 service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:56.004148 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1396/2778] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:56.015839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663e3f170d2545bf889296d9cf93bf97', 'request_id': 'req-fcb1b167-0507-464c-967b-e108763782d0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.023066 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663e3f170d2545bf889296d9cf93bf97', 'request_id': 'req-fcb1b167-0507-464c-967b-e108763782d0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.035171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] The token cache is being invalidate because project 663e3f170d2545bf889296d9cf93bf97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:56.035457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.036128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.038055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1383/2779] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:55 2022] DELETE /identity/v3/projects/663e3f170d2545bf889296d9cf93bf97 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:56.042769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be1729-5080-4dff-bce0-071937f4e727 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.043060 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be1729-5080-4dff-bce0-071937f4e727 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.043369 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be1729-5080-4dff-bce0-071937f4e727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.064372 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-27be1729-5080-4dff-bce0-071937f4e727 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:56.065601 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-27be1729-5080-4dff-bce0-071937f4e727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:56.133505 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1397/2780] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:56.142090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:56.144974 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:56.169497 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1b167-0507-464c-967b-e108763782d0 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:56.175329 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:56.177640 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.178274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.178775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] PATH_INFO: `/v3/projects/d57d2a75c7b3422ab2aad596b2c7a026` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.180606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57d2a75c7b3422ab2aad596b2c7a026)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:56.184937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:56.201235 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3d988-6e78-4c9e-8515-8c8427a30283 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.201450 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3d988-6e78-4c9e-8515-8c8427a30283 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.201712 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3d988-6e78-4c9e-8515-8c8427a30283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.222523 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-daa3d988-6e78-4c9e-8515-8c8427a30283 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:56.223852 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-daa3d988-6e78-4c9e-8515-8c8427a30283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:56.235513 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1398/2781] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:56.236769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3d988-6e78-4c9e-8515-8c8427a30283 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:56.246979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3d988-6e78-4c9e-8515-8c8427a30283 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:56.252533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ad025-9a51-4a5d-b853-42237b6533cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:56.253315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ad025-9a51-4a5d-b853-42237b6533cd admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.253662 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ad025-9a51-4a5d-b853-42237b6533cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.254025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ad025-9a51-4a5d-b853-42237b6533cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.254913 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ad025-9a51-4a5d-b853-42237b6533cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:54:56.255286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ad025-9a51-4a5d-b853-42237b6533cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:56.257021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ad025-9a51-4a5d-b853-42237b6533cd admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:56.275276 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1399/2782] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:54:56.276475 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ad025-9a51-4a5d-b853-42237b6533cd admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:56.287562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ad025-9a51-4a5d-b853-42237b6533cd admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:56.292588 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c26ae-e6c0-423b-9276-777b32dcac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:56.295792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c26ae-e6c0-423b-9276-777b32dcac60 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.295792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c26ae-e6c0-423b-9276-777b32dcac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.295792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c26ae-e6c0-423b-9276-777b32dcac60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.295792 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c26ae-e6c0-423b-9276-777b32dcac60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:56.297348 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c26ae-e6c0-423b-9276-777b32dcac60 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:56.302173 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:56.381112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1400/2783] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:56 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:56.381953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c26ae-e6c0-423b-9276-777b32dcac60 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:56.383602 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-551c26ae-e6c0-423b-9276-777b32dcac60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:56.418285 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57d2a75c7b3422ab2aad596b2c7a026', 'request_id': 'req-78b9732d-1713-4f58-8034-9025828d1b2f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.448605 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c26ae-e6c0-423b-9276-777b32dcac60 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:56.488925 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57d2a75c7b3422ab2aad596b2c7a026', 'request_id': 'req-78b9732d-1713-4f58-8034-9025828d1b2f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.494871 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57d2a75c7b3422ab2aad596b2c7a026', 'request_id': 'req-78b9732d-1713-4f58-8034-9025828d1b2f'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.505469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:56.506462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.506814 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.507158 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] PATH_INFO: `/v3/projects/a365750d84b040f0b01727806bdf9cb1` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.507500 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] The token cache is being invalidate because project d57d2a75c7b3422ab2aad596b2c7a026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:56.507839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.508589 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.508760 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a365750d84b040f0b01727806bdf9cb1)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:56.510271 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1384/2784] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:56 2022] DELETE /identity/v3/projects/d57d2a75c7b3422ab2aad596b2c7a026 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:56.510968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:56.514138 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:56.515497 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:56.528134 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9732d-1713-4f58-8034-9025828d1b2f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:56.532801 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a84ab-9007-4d48-a16f-e5c75a978070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:56.533526 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a84ab-9007-4d48-a16f-e5c75a978070 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.534107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a84ab-9007-4d48-a16f-e5c75a978070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.534107 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a84ab-9007-4d48-a16f-e5c75a978070 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.535136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a84ab-9007-4d48-a16f-e5c75a978070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:56.536662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a84ab-9007-4d48-a16f-e5c75a978070 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:56.666103 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a365750d84b040f0b01727806bdf9cb1', 'request_id': 'req-24676468-a5e3-4056-87fd-a01ebadfb8e4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.684831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1385/2785] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:56 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:56.686398 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be863616-729e-4a81-a4b1-a7c700e29907 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.689343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be863616-729e-4a81-a4b1-a7c700e29907 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.689343 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be863616-729e-4a81-a4b1-a7c700e29907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.704888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-be863616-729e-4a81-a4b1-a7c700e29907 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:56.706067 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-be863616-729e-4a81-a4b1-a7c700e29907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:56.717660 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=79,keystone:DELETE=16,keystone:INSERT=5 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:56.755597 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a365750d84b040f0b01727806bdf9cb1', 'request_id': 'req-24676468-a5e3-4056-87fd-a01ebadfb8e4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.763415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a365750d84b040f0b01727806bdf9cb1', 'request_id': 'req-24676468-a5e3-4056-87fd-a01ebadfb8e4'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.764741 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1386/2786] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:56.765000 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be863616-729e-4a81-a4b1-a7c700e29907 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:56.774934 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be863616-729e-4a81-a4b1-a7c700e29907 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:56.780165 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2200a-a983-4908-a949-cc2d9884699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:56.781461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2200a-a983-4908-a949-cc2d9884699f admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.781610 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] The token cache is being invalidate because project a365750d84b040f0b01727806bdf9cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:56.781737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.781941 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2200a-a983-4908-a949-cc2d9884699f admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.782565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2200a-a983-4908-a949-cc2d9884699f admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.783334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2200a-a983-4908-a949-cc2d9884699f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:56.784361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-24676468-a5e3-4056-87fd-a01ebadfb8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:56.785037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2200a-a983-4908-a949-cc2d9884699f admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:56.786287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1401/2787] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:56 2022] DELETE /identity/v3/projects/a365750d84b040f0b01727806bdf9cb1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:56.787435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8663c-4587-4220-906c-74a8ae5995ac None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.787727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8663c-4587-4220-906c-74a8ae5995ac None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.788005 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8663c-4587-4220-906c-74a8ae5995ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.800355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1387/2788] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:56.801252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2200a-a983-4908-a949-cc2d9884699f admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:56.803084 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8ed2200a-a983-4908-a949-cc2d9884699f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:56.816484 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2200a-a983-4908-a949-cc2d9884699f admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:56.817998 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-71a8663c-4587-4220-906c-74a8ae5995ac None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:56.819237 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-71a8663c-4587-4220-906c-74a8ae5995ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:56.821598 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f16be1-2ba4-4b1a-a221-89df61c738a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:56.822529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16be1-2ba4-4b1a-a221-89df61c738a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.825691 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16be1-2ba4-4b1a-a221-89df61c738a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.825691 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16be1-2ba4-4b1a-a221-89df61c738a1 admin admin] PATH_INFO: `/v3/users/b5bc4c986f8448449757b87fcc2709b7` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.825691 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f16be1-2ba4-4b1a-a221-89df61c738a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5bc4c986f8448449757b87fcc2709b7)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:56.826646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f16be1-2ba4-4b1a-a221-89df61c738a1 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:56.828521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1402/2789] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:56.829416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8663c-4587-4220-906c-74a8ae5995ac None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:56.830767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-71a8663c-4587-4220-906c-74a8ae5995ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:56.845399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8663c-4587-4220-906c-74a8ae5995ac None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:56.849834 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5223f71-4ca2-413e-baeb-3e689084c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:56.850607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5223f71-4ca2-413e-baeb-3e689084c545 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.850962 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5223f71-4ca2-413e-baeb-3e689084c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.851305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5223f71-4ca2-413e-baeb-3e689084c545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.852159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5223f71-4ca2-413e-baeb-3e689084c545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:56.853898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5223f71-4ca2-413e-baeb-3e689084c545 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:56.865025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1403/2790] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:56.869041 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5223f71-4ca2-413e-baeb-3e689084c545 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:56.875566 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5223f71-4ca2-413e-baeb-3e689084c545 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:56.880237 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3999e-7c17-4509-b732-9f58b0f0cd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:56.880888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3999e-7c17-4509-b732-9f58b0f0cd56 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.881170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3999e-7c17-4509-b732-9f58b0f0cd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.881445 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3999e-7c17-4509-b732-9f58b0f0cd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.882156 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3999e-7c17-4509-b732-9f58b0f0cd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:54:56.882565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3999e-7c17-4509-b732-9f58b0f0cd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:56.884201 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3999e-7c17-4509-b732-9f58b0f0cd56 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:56.885822 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:56.896705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1404/2791] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:54:56.897519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3999e-7c17-4509-b732-9f58b0f0cd56 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:56.907820 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3999e-7c17-4509-b732-9f58b0f0cd56 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:56.912454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5a417-66b4-4359-b535-68dc2b2fd8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:56.913303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5a417-66b4-4359-b535-68dc2b2fd8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:56.913583 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5a417-66b4-4359-b535-68dc2b2fd8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:56.913857 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5a417-66b4-4359-b535-68dc2b2fd8e0 admin admin] PATH_INFO: `/v3/projects/297205f931c34ecc9bf4cd7f68fa8306/users/06134303869e41919507b35823bc61fe/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:56.929030 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5a417-66b4-4359-b535-68dc2b2fd8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297205f931c34ecc9bf4cd7f68fa8306, user_id=06134303869e41919507b35823bc61fe, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:56.931944 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5a417-66b4-4359-b535-68dc2b2fd8e0 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:57.026733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1405/2792] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:56 2022] PUT /identity/v3/projects/297205f931c34ecc9bf4cd7f68fa8306/users/06134303869e41919507b35823bc61fe/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:57.027556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5a417-66b4-4359-b535-68dc2b2fd8e0 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:57.039311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-55f16be1-2ba4-4b1a-a221-89df61c738a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5bc4c986f8448449757b87fcc2709b7'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:57.040060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-55f16be1-2ba4-4b1a-a221-89df61c738a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5bc4c986f8448449757b87fcc2709b7'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:57.099782 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5a417-66b4-4359-b535-68dc2b2fd8e0 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:57.104614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e97c1-460e-4cb1-8c47-6715c16b9b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:57.105280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e97c1-460e-4cb1-8c47-6715c16b9b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:57.105565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e97c1-460e-4cb1-8c47-6715c16b9b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:57.105840 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e97c1-460e-4cb1-8c47-6715c16b9b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:57.106581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e97c1-460e-4cb1-8c47-6715c16b9b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:57.108492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e97c1-460e-4cb1-8c47-6715c16b9b8e admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:57.131722 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-55f16be1-2ba4-4b1a-a221-89df61c738a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5bc4c986f8448449757b87fcc2709b7'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:57.147295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-55f16be1-2ba4-4b1a-a221-89df61c738a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5bc4c986f8448449757b87fcc2709b7'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:57.154599 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-55f16be1-2ba4-4b1a-a221-89df61c738a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5bc4c986f8448449757b87fcc2709b7'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:57.161446 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1388/2793] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:56 2022] DELETE /identity/v3/users/b5bc4c986f8448449757b87fcc2709b7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:57.162551 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ffa8d-cbe5-4e41-8d70-36d4487aefef None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:57.162842 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ffa8d-cbe5-4e41-8d70-36d4487aefef None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:57.163251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ffa8d-cbe5-4e41-8d70-36d4487aefef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:57.190632 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-960ffa8d-cbe5-4e41-8d70-36d4487aefef None None] MFA Rules not processed for user `06134303869e41919507b35823bc61fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:57.191829 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-960ffa8d-cbe5-4e41-8d70-36d4487aefef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:57.214076 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1406/2794] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:57 2022] POST /identity/v3/projects => generated 397 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:57.219694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e97c1-460e-4cb1-8c47-6715c16b9b8e admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:57.221788 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-356e97c1-460e-4cb1-8c47-6715c16b9b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:57.265929 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1389/2795] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:57.277301 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ffa8d-cbe5-4e41-8d70-36d4487aefef None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:57.278661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-960ffa8d-cbe5-4e41-8d70-36d4487aefef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:57.289664 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:57.295432 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e97c1-460e-4cb1-8c47-6715c16b9b8e admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:57.300540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51584573-6740-47e0-8c6f-ca5396bad9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:57.301245 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51584573-6740-47e0-8c6f-ca5396bad9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:57.301533 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51584573-6740-47e0-8c6f-ca5396bad9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:57.301811 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51584573-6740-47e0-8c6f-ca5396bad9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:57.302548 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51584573-6740-47e0-8c6f-ca5396bad9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:57.304484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51584573-6740-47e0-8c6f-ca5396bad9d9 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:57.335541 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ffa8d-cbe5-4e41-8d70-36d4487aefef None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:57.382286 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1407/2796] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:57 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:54:57.386289 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51584573-6740-47e0-8c6f-ca5396bad9d9 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:57.394360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd070d-607a-43c9-b8bd-04d835277487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:57.395041 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd070d-607a-43c9-b8bd-04d835277487 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:57.395328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd070d-607a-43c9-b8bd-04d835277487 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:57.395611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd070d-607a-43c9-b8bd-04d835277487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:57.400928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51584573-6740-47e0-8c6f-ca5396bad9d9 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:57.408607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacc393-9cdd-4c37-9d21-7cad1808f25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:57.409308 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacc393-9cdd-4c37-9d21-7cad1808f25a admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:57.409686 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacc393-9cdd-4c37-9d21-7cad1808f25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:57.409990 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacc393-9cdd-4c37-9d21-7cad1808f25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:57.410845 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacc393-9cdd-4c37-9d21-7cad1808f25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:57.412999 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacc393-9cdd-4c37-9d21-7cad1808f25a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:57.427931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1408/2797] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:57.429217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacc393-9cdd-4c37-9d21-7cad1808f25a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:57.441127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacc393-9cdd-4c37-9d21-7cad1808f25a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:57.446737 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508bfb8-5fbf-4e5b-81ed-576cb700199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:57.447491 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508bfb8-5fbf-4e5b-81ed-576cb700199c admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:57.447854 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508bfb8-5fbf-4e5b-81ed-576cb700199c admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:57.448217 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508bfb8-5fbf-4e5b-81ed-576cb700199c admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:57.449017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508bfb8-5fbf-4e5b-81ed-576cb700199c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:57.451061 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508bfb8-5fbf-4e5b-81ed-576cb700199c admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:57.463260 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd070d-607a-43c9-b8bd-04d835277487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:57.464506 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1409/2798] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:57.466661 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd070d-607a-43c9-b8bd-04d835277487 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:57.470361 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508bfb8-5fbf-4e5b-81ed-576cb700199c admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:57.476832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1390/2799] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:54:57.480970 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508bfb8-5fbf-4e5b-81ed-576cb700199c admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:57.488701 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d14bc-c9de-47ad-a0f4-66cefdcd91a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:57.488701 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d14bc-c9de-47ad-a0f4-66cefdcd91a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:57.488701 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d14bc-c9de-47ad-a0f4-66cefdcd91a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:57.488701 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d14bc-c9de-47ad-a0f4-66cefdcd91a8 admin admin] PATH_INFO: `/v3/projects/7744debb704746bba344b8315f549ed2/users/fb083a09a9ea4c3bacfd0644192dd0cd/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:57.504553 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d14bc-c9de-47ad-a0f4-66cefdcd91a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7744debb704746bba344b8315f549ed2, user_id=fb083a09a9ea4c3bacfd0644192dd0cd, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:57.507225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d14bc-c9de-47ad-a0f4-66cefdcd91a8 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:57.570091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:57.585955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1410/2800] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:57 2022] PUT /identity/v3/projects/7744debb704746bba344b8315f549ed2/users/fb083a09a9ea4c3bacfd0644192dd0cd/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:57.587894 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8839b2e-4460-4947-a745-85897142f598 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:57.588371 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8839b2e-4460-4947-a745-85897142f598 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:57.588594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8839b2e-4460-4947-a745-85897142f598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:57.616682 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d14bc-c9de-47ad-a0f4-66cefdcd91a8 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:57.619531 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-f8839b2e-4460-4947-a745-85897142f598 None None] MFA Rules not processed for user `fb083a09a9ea4c3bacfd0644192dd0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:57.620135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1e1d14bc-c9de-47ad-a0f4-66cefdcd91a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:57.621360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f8839b2e-4460-4947-a745-85897142f598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:57.686586 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d14bc-c9de-47ad-a0f4-66cefdcd91a8 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:57.690601 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1391/2801] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:57.692101 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:57.693067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:57.693277 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:57.693548 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] PATH_INFO: `/v3/projects/e71538173b044b20a8251ce3e692a1ae` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:57.694881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71538173b044b20a8251ce3e692a1ae)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:57.696803 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:57.703845 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8839b2e-4460-4947-a745-85897142f598 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:57.705507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f8839b2e-4460-4947-a745-85897142f598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:57.761472 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8839b2e-4460-4947-a745-85897142f598 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:57.765840 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3248c-a9f4-4c84-a615-62b4ee96333a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:57.766529 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3248c-a9f4-4c84-a615-62b4ee96333a service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:57.766816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3248c-a9f4-4c84-a615-62b4ee96333a service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:57.767094 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3248c-a9f4-4c84-a615-62b4ee96333a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:57.775466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3248c-a9f4-4c84-a615-62b4ee96333a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:57.776888 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3248c-a9f4-4c84-a615-62b4ee96333a service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:57.785913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1392/2802] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:54:57.855989 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71538173b044b20a8251ce3e692a1ae', 'request_id': 'req-6abc6e72-2602-4014-8ef0-e2d0c2f33105'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:57.960412 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71538173b044b20a8251ce3e692a1ae', 'request_id': 'req-6abc6e72-2602-4014-8ef0-e2d0c2f33105'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:57.967502 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71538173b044b20a8251ce3e692a1ae', 'request_id': 'req-6abc6e72-2602-4014-8ef0-e2d0c2f33105'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:57.977655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] The token cache is being invalidate because project e71538173b044b20a8251ce3e692a1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:57.977940 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:57.978595 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:57.980154 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1411/2803] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:57 2022] DELETE /identity/v3/projects/e71538173b044b20a8251ce3e692a1ae => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:57.984668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3248c-a9f4-4c84-a615-62b4ee96333a service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:57.995644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3248c-a9f4-4c84-a615-62b4ee96333a service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:58.051455 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b17ce-bcef-431a-939b-f1f09c5021b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:58.052330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b17ce-bcef-431a-939b-f1f09c5021b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:58.052615 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b17ce-bcef-431a-939b-f1f09c5021b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:58.052892 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b17ce-bcef-431a-939b-f1f09c5021b8 admin admin] PATH_INFO: `/v3/users/58bb68e2d9be45abb4f853b40691c026` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:58.054118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b17ce-bcef-431a-939b-f1f09c5021b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58bb68e2d9be45abb4f853b40691c026)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:58.055991 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b17ce-bcef-431a-939b-f1f09c5021b8 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:58.127386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=100 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:58.294169 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-058b17ce-bcef-431a-939b-f1f09c5021b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58bb68e2d9be45abb4f853b40691c026'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:58.295445 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-058b17ce-bcef-431a-939b-f1f09c5021b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58bb68e2d9be45abb4f853b40691c026'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:58.389486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-058b17ce-bcef-431a-939b-f1f09c5021b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58bb68e2d9be45abb4f853b40691c026'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:58.401996 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-058b17ce-bcef-431a-939b-f1f09c5021b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58bb68e2d9be45abb4f853b40691c026'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:58.409535 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-058b17ce-bcef-431a-939b-f1f09c5021b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58bb68e2d9be45abb4f853b40691c026'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:58.415490 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1393/2804] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:57 2022] DELETE /identity/v3/users/58bb68e2d9be45abb4f853b40691c026 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:58.871268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:58.872932 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:58.903762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6e72-2602-4014-8ef0-e2d0c2f33105 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:58.963623 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:58.964490 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:58.964773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:58.965049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] PATH_INFO: `/v3/projects/e079033dd6c44918aa34bb42f2f8993f` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:58.966232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e079033dd6c44918aa34bb42f2f8993f)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:58.968192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:59.063128 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:59.075580 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e079033dd6c44918aa34bb42f2f8993f', 'request_id': 'req-2e9d46cf-26c1-472d-b57f-5de7cd937352'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:59.143458 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e079033dd6c44918aa34bb42f2f8993f', 'request_id': 'req-2e9d46cf-26c1-472d-b57f-5de7cd937352'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:59.150110 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e079033dd6c44918aa34bb42f2f8993f', 'request_id': 'req-2e9d46cf-26c1-472d-b57f-5de7cd937352'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:59.167481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] The token cache is being invalidate because project e079033dd6c44918aa34bb42f2f8993f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:54:59.167481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:59.167481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:59.167481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1412/2805] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:54:58 2022] DELETE /identity/v3/projects/e079033dd6c44918aa34bb42f2f8993f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:54:59.168760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73562ee6-dcbb-4b58-a5e2-1e6cf8102df3 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:59.169204 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73562ee6-dcbb-4b58-a5e2-1e6cf8102df3 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:59.169300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73562ee6-dcbb-4b58-a5e2-1e6cf8102df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:59.186767 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-73562ee6-dcbb-4b58-a5e2-1e6cf8102df3 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:59.188481 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-73562ee6-dcbb-4b58-a5e2-1e6cf8102df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:59.203547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:59.204941 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:59.217036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:59.250575 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1394/2806] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:54:59.258477 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf2d29-6763-4059-ab5e-2edc91176088 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:59.258951 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf2d29-6763-4059-ab5e-2edc91176088 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:59.259263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf2d29-6763-4059-ab5e-2edc91176088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:59.275296 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d46cf-26c1-472d-b57f-5de7cd937352 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:59.278105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-e2cf2d29-6763-4059-ab5e-2edc91176088 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:59.279333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e2cf2d29-6763-4059-ab5e-2edc91176088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:59.280153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597a22b-e9a2-4ea1-8d30-b0461cde658f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:59.281097 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597a22b-e9a2-4ea1-8d30-b0461cde658f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:59.281387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597a22b-e9a2-4ea1-8d30-b0461cde658f admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:59.281747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597a22b-e9a2-4ea1-8d30-b0461cde658f admin admin] PATH_INFO: `/v3/users/eb3fdd1fdd8042ae996331fde4874547` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:59.283012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597a22b-e9a2-4ea1-8d30-b0461cde658f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3fdd1fdd8042ae996331fde4874547)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:59.285188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597a22b-e9a2-4ea1-8d30-b0461cde658f admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:59.288218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1395/2807] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:59.292452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf2d29-6763-4059-ab5e-2edc91176088 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:59.302516 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf2d29-6763-4059-ab5e-2edc91176088 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:59.309236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f084fc-071c-4cde-a5be-eb67f7fd8bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:59.310362 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f084fc-071c-4cde-a5be-eb67f7fd8bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:59.310362 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f084fc-071c-4cde-a5be-eb67f7fd8bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:59.310566 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f084fc-071c-4cde-a5be-eb67f7fd8bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:59.311272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f084fc-071c-4cde-a5be-eb67f7fd8bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:54:59.312546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f084fc-071c-4cde-a5be-eb67f7fd8bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:59.314038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f084fc-071c-4cde-a5be-eb67f7fd8bd2 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:59.326141 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1396/2808] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 06:54:59.336221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f084fc-071c-4cde-a5be-eb67f7fd8bd2 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:59.345844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f084fc-071c-4cde-a5be-eb67f7fd8bd2 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:59.350806 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cc30d-b88b-47ef-8d09-7be7dc539cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:59.351550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cc30d-b88b-47ef-8d09-7be7dc539cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:59.351933 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cc30d-b88b-47ef-8d09-7be7dc539cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:59.352330 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cc30d-b88b-47ef-8d09-7be7dc539cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:59.353234 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106cc30d-b88b-47ef-8d09-7be7dc539cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:59.355326 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106cc30d-b88b-47ef-8d09-7be7dc539cf9 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:59.494194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1397/2809] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:54:59 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:59.498443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cc30d-b88b-47ef-8d09-7be7dc539cf9 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:59.530089 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5597a22b-e9a2-4ea1-8d30-b0461cde658f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3fdd1fdd8042ae996331fde4874547'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:59.531718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5597a22b-e9a2-4ea1-8d30-b0461cde658f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3fdd1fdd8042ae996331fde4874547'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:59.545189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5597a22b-e9a2-4ea1-8d30-b0461cde658f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3fdd1fdd8042ae996331fde4874547'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:59.562617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cc30d-b88b-47ef-8d09-7be7dc539cf9 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:59.567850 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8820a78-5a73-4128-a6bc-2b5cd5b973b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:59.568438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820a78-5a73-4128-a6bc-2b5cd5b973b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:59.568723 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820a78-5a73-4128-a6bc-2b5cd5b973b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:59.568999 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820a78-5a73-4128-a6bc-2b5cd5b973b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:59.569685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8820a78-5a73-4128-a6bc-2b5cd5b973b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:59.571624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8820a78-5a73-4128-a6bc-2b5cd5b973b6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:59.657715 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5597a22b-e9a2-4ea1-8d30-b0461cde658f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3fdd1fdd8042ae996331fde4874547'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:59.665399 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-5597a22b-e9a2-4ea1-8d30-b0461cde658f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3fdd1fdd8042ae996331fde4874547'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:54:59.672333 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1413/2810] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:54:59 2022] DELETE /identity/v3/users/eb3fdd1fdd8042ae996331fde4874547 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:54:59.676898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e1a9b-d131-4d98-8ac1-f0dce086f3dc None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:59.677360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e1a9b-d131-4d98-8ac1-f0dce086f3dc None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:59.677697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e1a9b-d131-4d98-8ac1-f0dce086f3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:59.689183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1398/2811] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:54:59 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:54:59.690269 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8820a78-5a73-4128-a6bc-2b5cd5b973b6 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:59.691969 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-e8820a78-5a73-4128-a6bc-2b5cd5b973b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:59.701582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-623e1a9b-d131-4d98-8ac1-f0dce086f3dc None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:54:59.702850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-623e1a9b-d131-4d98-8ac1-f0dce086f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:59.705311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8820a78-5a73-4128-a6bc-2b5cd5b973b6 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:59.741934 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:59.768671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1414/2812] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:54:59.771836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c785b-1262-4d31-90b3-2d1c749ba50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:59.772658 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c785b-1262-4d31-90b3-2d1c749ba50a admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:59.773087 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c785b-1262-4d31-90b3-2d1c749ba50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:59.773474 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c785b-1262-4d31-90b3-2d1c749ba50a admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:59.774212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c785b-1262-4d31-90b3-2d1c749ba50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:59.775836 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c785b-1262-4d31-90b3-2d1c749ba50a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:59.778139 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e1a9b-d131-4d98-8ac1-f0dce086f3dc None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:59.779553 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-623e1a9b-d131-4d98-8ac1-f0dce086f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:54:59.786735 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1399/2813] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:54:59.792866 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c785b-1262-4d31-90b3-2d1c749ba50a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:59.803049 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c785b-1262-4d31-90b3-2d1c749ba50a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:59.807715 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503909e-1c65-4bda-8a5c-b65f15a05ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:59.808295 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503909e-1c65-4bda-8a5c-b65f15a05ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:59.808580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503909e-1c65-4bda-8a5c-b65f15a05ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:59.808855 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503909e-1c65-4bda-8a5c-b65f15a05ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:59.809568 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503909e-1c65-4bda-8a5c-b65f15a05ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:59.811210 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503909e-1c65-4bda-8a5c-b65f15a05ae6 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:59.821350 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1400/2814] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 06:54:59.825194 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503909e-1c65-4bda-8a5c-b65f15a05ae6 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:54:59.831818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:54:59.836089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503909e-1c65-4bda-8a5c-b65f15a05ae6 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:59.841747 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e1a9b-d131-4d98-8ac1-f0dce086f3dc None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:54:59.842592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ef659-219b-4bcd-9c8f-b9c0899c4677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:59.844102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef659-219b-4bcd-9c8f-b9c0899c4677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:59.850225 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822e5b7-2d05-443d-a51f-5070bb449c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:54:59.850582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef659-219b-4bcd-9c8f-b9c0899c4677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:59.850582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef659-219b-4bcd-9c8f-b9c0899c4677 admin admin] PATH_INFO: `/v3/projects/c674add339db4b3095b101825ee2654e/users/97e50253ceb84116a7195b68599ec377/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:59.850795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822e5b7-2d05-443d-a51f-5070bb449c06 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:54:59.850795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822e5b7-2d05-443d-a51f-5070bb449c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:54:59.850795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822e5b7-2d05-443d-a51f-5070bb449c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:54:59.858324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822e5b7-2d05-443d-a51f-5070bb449c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:59.860440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822e5b7-2d05-443d-a51f-5070bb449c06 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:59.862940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ef659-219b-4bcd-9c8f-b9c0899c4677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c674add339db4b3095b101825ee2654e, user_id=97e50253ceb84116a7195b68599ec377, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:54:59.865607 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ef659-219b-4bcd-9c8f-b9c0899c4677 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:54:59.870342 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1415/2815] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:55:00.004272 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1401/2816] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:54:59 2022] PUT /identity/v3/projects/c674add339db4b3095b101825ee2654e/users/97e50253ceb84116a7195b68599ec377/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:55:00.016861 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa18fe-c0dd-49c3-acbd-fc1729786d5b None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:00.017357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa18fe-c0dd-49c3-acbd-fc1729786d5b None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:00.017625 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa18fe-c0dd-49c3-acbd-fc1729786d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:00.036349 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-85fa18fe-c0dd-49c3-acbd-fc1729786d5b None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:00.037571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-85fa18fe-c0dd-49c3-acbd-fc1729786d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:00.098156 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1416/2817] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:55:00.107760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ef659-219b-4bcd-9c8f-b9c0899c4677 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:00.109453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ad8ef659-219b-4bcd-9c8f-b9c0899c4677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:00.185355 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ef659-219b-4bcd-9c8f-b9c0899c4677 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:00.189184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650b60e-7d6c-4c53-a48f-5a3f5298c737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:00.189844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650b60e-7d6c-4c53-a48f-5a3f5298c737 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:00.190118 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650b60e-7d6c-4c53-a48f-5a3f5298c737 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:00.190635 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650b60e-7d6c-4c53-a48f-5a3f5298c737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:00.200186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650b60e-7d6c-4c53-a48f-5a3f5298c737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:00.204221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650b60e-7d6c-4c53-a48f-5a3f5298c737 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:00.213082 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1402/2818] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:55:00.394660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa18fe-c0dd-49c3-acbd-fc1729786d5b None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:00.396322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-85fa18fe-c0dd-49c3-acbd-fc1729786d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:00.416032 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa18fe-c0dd-49c3-acbd-fc1729786d5b None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:00.421535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:00.422583 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:00.422992 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:00.431938 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] PATH_INFO: `/v3/projects/89b9b90b4997406c9cf5915349f38d71` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:00.433409 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b9b90b4997406c9cf5915349f38d71)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:00.435825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:00.599310 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b9b90b4997406c9cf5915349f38d71', 'request_id': 'req-c7642613-8570-47a8-9382-d8ab8b0f23d9'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:00.697979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b9b90b4997406c9cf5915349f38d71', 'request_id': 'req-c7642613-8570-47a8-9382-d8ab8b0f23d9'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:00.706448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b9b90b4997406c9cf5915349f38d71', 'request_id': 'req-c7642613-8570-47a8-9382-d8ab8b0f23d9'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:00.717472 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] The token cache is being invalidate because project 89b9b90b4997406c9cf5915349f38d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:55:00.717757 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:00.718439 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-c7642613-8570-47a8-9382-d8ab8b0f23d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:00.720026 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1417/2819] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:55:00 2022] DELETE /identity/v3/projects/89b9b90b4997406c9cf5915349f38d71 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:55:00.724945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc815eee-517c-4988-884a-0e880c2d8d82 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:00.725221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc815eee-517c-4988-884a-0e880c2d8d82 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:00.725501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc815eee-517c-4988-884a-0e880c2d8d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:00.743081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-dc815eee-517c-4988-884a-0e880c2d8d82 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:00.747678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-dc815eee-517c-4988-884a-0e880c2d8d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:00.805924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1403/2820] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:00.814271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce752c2c-b16b-45dd-b7a0-1597563f90fd None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:00.815037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce752c2c-b16b-45dd-b7a0-1597563f90fd None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:00.815037 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce752c2c-b16b-45dd-b7a0-1597563f90fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:00.822175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:00.833656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-ce752c2c-b16b-45dd-b7a0-1597563f90fd None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:00.836199 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-ce752c2c-b16b-45dd-b7a0-1597563f90fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:00.848902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1418/2821] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:00.850186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc815eee-517c-4988-884a-0e880c2d8d82 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:00.860711 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc815eee-517c-4988-884a-0e880c2d8d82 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:00.865832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ba542-8dff-4395-822e-a5617ce41f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:00.866533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ba542-8dff-4395-822e-a5617ce41f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:00.866834 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ba542-8dff-4395-822e-a5617ce41f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:00.867105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ba542-8dff-4395-822e-a5617ce41f45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:00.871830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ba542-8dff-4395-822e-a5617ce41f45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:55:00.872211 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ba542-8dff-4395-822e-a5617ce41f45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:00.875956 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ba542-8dff-4395-822e-a5617ce41f45 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:00.891283 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1404/2822] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:55:00.895719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce752c2c-b16b-45dd-b7a0-1597563f90fd None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:00.905558 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce752c2c-b16b-45dd-b7a0-1597563f90fd None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:00.919104 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfa54c-76dc-4ae2-8d02-ff4ef9d1626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:00.919790 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfa54c-76dc-4ae2-8d02-ff4ef9d1626d admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:00.920073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfa54c-76dc-4ae2-8d02-ff4ef9d1626d admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:00.920347 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfa54c-76dc-4ae2-8d02-ff4ef9d1626d admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:00.921607 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfa54c-76dc-4ae2-8d02-ff4ef9d1626d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:00.923582 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfa54c-76dc-4ae2-8d02-ff4ef9d1626d admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:01.044796 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1419/2823] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:55:00 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:55:01.046979 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ba542-8dff-4395-822e-a5617ce41f45 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:01.057026 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ba542-8dff-4395-822e-a5617ce41f45 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:01.115841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6ac94-1c7d-43d3-840f-4c9259f23917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:01.116540 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6ac94-1c7d-43d3-840f-4c9259f23917 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:01.116815 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6ac94-1c7d-43d3-840f-4c9259f23917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:01.117089 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6ac94-1c7d-43d3-840f-4c9259f23917 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:01.117774 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6ac94-1c7d-43d3-840f-4c9259f23917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:01.119719 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6ac94-1c7d-43d3-840f-4c9259f23917 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:01.170512 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:01.176159 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1405/2824] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:55:01 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:55:01.180708 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfa54c-76dc-4ae2-8d02-ff4ef9d1626d admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:01.192953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfa54c-76dc-4ae2-8d02-ff4ef9d1626d admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:01.199259 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f1f6d-8ec0-4755-bb12-d5b889f57f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:01.203664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f1f6d-8ec0-4755-bb12-d5b889f57f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:01.203664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f1f6d-8ec0-4755-bb12-d5b889f57f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:01.203664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f1f6d-8ec0-4755-bb12-d5b889f57f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:01.203664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f1f6d-8ec0-4755-bb12-d5b889f57f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:01.203664 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f1f6d-8ec0-4755-bb12-d5b889f57f13 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:01.214463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1420/2825] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:55:01.223425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6ac94-1c7d-43d3-840f-4c9259f23917 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:01.234677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6ac94-1c7d-43d3-840f-4c9259f23917 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:01.239361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e2617-fbfb-458a-96dd-d5197f0f0555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:01.240017 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2617-fbfb-458a-96dd-d5197f0f0555 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:01.240304 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2617-fbfb-458a-96dd-d5197f0f0555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:01.240581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2617-fbfb-458a-96dd-d5197f0f0555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:01.241311 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e2617-fbfb-458a-96dd-d5197f0f0555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:01.242963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e2617-fbfb-458a-96dd-d5197f0f0555 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:01.252759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1406/2826] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:55:01.256773 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f1f6d-8ec0-4755-bb12-d5b889f57f13 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:01.266660 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f1f6d-8ec0-4755-bb12-d5b889f57f13 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:01.271385 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9cb45-b6c5-46d2-a390-0b00b5b8fc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:01.272316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9cb45-b6c5-46d2-a390-0b00b5b8fc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:01.272547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9cb45-b6c5-46d2-a390-0b00b5b8fc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:01.272824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9cb45-b6c5-46d2-a390-0b00b5b8fc77 admin admin] PATH_INFO: `/v3/projects/6d56696ac1474643a26518062433e747/users/31079c3701f74672a2bfd859888ed537/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:01.289753 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9cb45-b6c5-46d2-a390-0b00b5b8fc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d56696ac1474643a26518062433e747, user_id=31079c3701f74672a2bfd859888ed537, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:01.290701 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9cb45-b6c5-46d2-a390-0b00b5b8fc77 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:01.369853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1421/2827] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:55:01 2022] PUT /identity/v3/projects/6d56696ac1474643a26518062433e747/users/31079c3701f74672a2bfd859888ed537/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:55:01.380164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a47be6-c142-4a3f-8eb0-e686b2c94628 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:01.380482 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a47be6-c142-4a3f-8eb0-e686b2c94628 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:01.380763 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a47be6-c142-4a3f-8eb0-e686b2c94628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:01.407581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-d2a47be6-c142-4a3f-8eb0-e686b2c94628 None None] MFA Rules not processed for user `31079c3701f74672a2bfd859888ed537`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:01.408839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d2a47be6-c142-4a3f-8eb0-e686b2c94628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:01.472671 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1407/2828] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:01.483325 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9cb45-b6c5-46d2-a390-0b00b5b8fc77 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:01.485656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-45f9cb45-b6c5-46d2-a390-0b00b5b8fc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:01.562978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9cb45-b6c5-46d2-a390-0b00b5b8fc77 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:01.566750 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37351c-fc7b-4f69-bcf1-348414ac72f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:01.567497 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37351c-fc7b-4f69-bcf1-348414ac72f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:01.567784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37351c-fc7b-4f69-bcf1-348414ac72f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:01.568063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37351c-fc7b-4f69-bcf1-348414ac72f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:01.577271 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37351c-fc7b-4f69-bcf1-348414ac72f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:01.579735 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37351c-fc7b-4f69-bcf1-348414ac72f7 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:01.589241 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1422/2829] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:55:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:55:01.594536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502081-c73c-4a90-825b-f98ccb8e65e7 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:01.594827 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502081-c73c-4a90-825b-f98ccb8e65e7 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:01.595105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502081-c73c-4a90-825b-f98ccb8e65e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:01.624495 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-2d502081-c73c-4a90-825b-f98ccb8e65e7 None None] MFA Rules not processed for user `97e50253ceb84116a7195b68599ec377`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:01.625789 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-2d502081-c73c-4a90-825b-f98ccb8e65e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:01.698408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1408/2830] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:01.710071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37351c-fc7b-4f69-bcf1-348414ac72f7 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:01.713997 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1a37351c-fc7b-4f69-bcf1-348414ac72f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:01.729011 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37351c-fc7b-4f69-bcf1-348414ac72f7 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:01.734881 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e179ab-8a39-4d1d-b7a5-a89a3acaac93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:01.735540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e179ab-8a39-4d1d-b7a5-a89a3acaac93 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:01.735824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e179ab-8a39-4d1d-b7a5-a89a3acaac93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:01.736231 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e179ab-8a39-4d1d-b7a5-a89a3acaac93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:01.746178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e179ab-8a39-4d1d-b7a5-a89a3acaac93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:01.747800 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e179ab-8a39-4d1d-b7a5-a89a3acaac93 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:01.759462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1423/2831] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:55:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:55:09.903413 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8bf6a-7f8c-43ab-a240-4477917d2e39 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:09.904031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8bf6a-7f8c-43ab-a240-4477917d2e39 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:09.904031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8bf6a-7f8c-43ab-a240-4477917d2e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:09.921954 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-15f8bf6a-7f8c-43ab-a240-4477917d2e39 None None] MFA Rules not processed for user `97e50253ceb84116a7195b68599ec377`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:09.923783 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-15f8bf6a-7f8c-43ab-a240-4477917d2e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:09.930729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1409/2832] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:11.753974 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:14.919729 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e179ab-8a39-4d1d-b7a5-a89a3acaac93 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:14.921209 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-54e179ab-8a39-4d1d-b7a5-a89a3acaac93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:15.006001 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e179ab-8a39-4d1d-b7a5-a89a3acaac93 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:15.009669 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbb6f6-ef2e-4878-b2cc-042074406feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:15.010419 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbb6f6-ef2e-4878-b2cc-042074406feb service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:15.010702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbb6f6-ef2e-4878-b2cc-042074406feb service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:15.010976 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbb6f6-ef2e-4878-b2cc-042074406feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:15.012897 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-5dfbb6f6-ef2e-4878-b2cc-042074406feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:15.076736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbb6f6-ef2e-4878-b2cc-042074406feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:15.078088 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbb6f6-ef2e-4878-b2cc-042074406feb service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:15.090072 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1424/2833] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:55:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:55:16.001332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8bf6a-7f8c-43ab-a240-4477917d2e39 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:16.003592 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-15f8bf6a-7f8c-43ab-a240-4477917d2e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:16.018432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8bf6a-7f8c-43ab-a240-4477917d2e39 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:16.023417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:16.026523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:16.026523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:16.026523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] PATH_INFO: `/v3/users/fb083a09a9ea4c3bacfd0644192dd0cd` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:16.026523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb083a09a9ea4c3bacfd0644192dd0cd)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:16.028243 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:16.303421 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb083a09a9ea4c3bacfd0644192dd0cd'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:16.304115 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb083a09a9ea4c3bacfd0644192dd0cd'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:16.406035 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb083a09a9ea4c3bacfd0644192dd0cd'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:16.409862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:16.422668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb083a09a9ea4c3bacfd0644192dd0cd'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:16.433998 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb083a09a9ea4c3bacfd0644192dd0cd'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:16.441938 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1410/2834] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:55:16 2022] DELETE /identity/v3/users/fb083a09a9ea4c3bacfd0644192dd0cd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:55:16.459120 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce271-4396-4085-9ce9-d718998df43a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:16.459741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce271-4396-4085-9ce9-d718998df43a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:16.459741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce271-4396-4085-9ce9-d718998df43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:16.479943 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9e9ce271-4396-4085-9ce9-d718998df43a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:16.481495 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9e9ce271-4396-4085-9ce9-d718998df43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:16.577982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1425/2835] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:16.587701 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:16.589397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:16.647557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02770387-a5b8-4310-992c-20edff38d782 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:16.651232 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d8084-dfda-4130-bac5-0de96ad13ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:16.651876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d8084-dfda-4130-bac5-0de96ad13ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:16.652156 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d8084-dfda-4130-bac5-0de96ad13ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:16.652429 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d8084-dfda-4130-bac5-0de96ad13ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:16.663734 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d8084-dfda-4130-bac5-0de96ad13ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:16.665251 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d8084-dfda-4130-bac5-0de96ad13ba4 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:16.675095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1411/2836] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:55:17.150105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce271-4396-4085-9ce9-d718998df43a None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:17.151957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9e9ce271-4396-4085-9ce9-d718998df43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:17.169083 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce271-4396-4085-9ce9-d718998df43a None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:17.174824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:17.176268 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:17.176656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:17.177028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] PATH_INFO: `/v3/projects/7744debb704746bba344b8315f549ed2` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:17.178449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7744debb704746bba344b8315f549ed2)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:17.180810 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:17.318565 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:17.323719 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7744debb704746bba344b8315f549ed2', 'request_id': 'req-bb648c7c-19e8-4378-9b02-b72b246f04ca'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:17.395017 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7744debb704746bba344b8315f549ed2', 'request_id': 'req-bb648c7c-19e8-4378-9b02-b72b246f04ca'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:17.402177 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7744debb704746bba344b8315f549ed2', 'request_id': 'req-bb648c7c-19e8-4378-9b02-b72b246f04ca'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:17.412698 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] The token cache is being invalidate because project 7744debb704746bba344b8315f549ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:55:17.413044 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:17.413718 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-bb648c7c-19e8-4378-9b02-b72b246f04ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:17.415331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1426/2837] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:55:17 2022] DELETE /identity/v3/projects/7744debb704746bba344b8315f549ed2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:55:17.420502 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7e533-a4a8-4f7f-903e-04870dda0c7c None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:17.421012 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7e533-a4a8-4f7f-903e-04870dda0c7c None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:17.421136 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7e533-a4a8-4f7f-903e-04870dda0c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:17.440533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-c6a7e533-a4a8-4f7f-903e-04870dda0c7c None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:17.442617 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c6a7e533-a4a8-4f7f-903e-04870dda0c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:17.503704 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1412/2838] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:55:17.511417 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a61b7a-c1e5-46ee-89ba-abf41995eb21 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:17.511907 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a61b7a-c1e5-46ee-89ba-abf41995eb21 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:17.512065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a61b7a-c1e5-46ee-89ba-abf41995eb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:17.536404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-b1a61b7a-c1e5-46ee-89ba-abf41995eb21 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:17.537571 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b1a61b7a-c1e5-46ee-89ba-abf41995eb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:17.545766 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1427/2839] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:17.551583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7e533-a4a8-4f7f-903e-04870dda0c7c None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:17.561496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7e533-a4a8-4f7f-903e-04870dda0c7c None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:17.566857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a7858-1762-47c5-bc6f-638824366949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:17.570751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a7858-1762-47c5-bc6f-638824366949 admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:17.570751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a7858-1762-47c5-bc6f-638824366949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:17.570751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a7858-1762-47c5-bc6f-638824366949 admin admin] PATH_INFO: `/v3/domains` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:17.570751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a7858-1762-47c5-bc6f-638824366949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 06:55:17.570751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a7858-1762-47c5-bc6f-638824366949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:17.570751 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a7858-1762-47c5-bc6f-638824366949 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:17.583546 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1413/2840] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Jun 8 06:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 06:55:17.588112 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a61b7a-c1e5-46ee-89ba-abf41995eb21 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:17.601637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a61b7a-c1e5-46ee-89ba-abf41995eb21 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:17.606393 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23531ac-d82a-4e1d-8700-41a1c71310e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:17.607105 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23531ac-d82a-4e1d-8700-41a1c71310e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:17.607521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23531ac-d82a-4e1d-8700-41a1c71310e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:17.607793 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23531ac-d82a-4e1d-8700-41a1c71310e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:17.608509 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23531ac-d82a-4e1d-8700-41a1c71310e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:17.610467 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23531ac-d82a-4e1d-8700-41a1c71310e1 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:17.711722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1428/2841] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:55:17 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:55:17.717880 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a7858-1762-47c5-bc6f-638824366949 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:17.728558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a7858-1762-47c5-bc6f-638824366949 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:17.789170 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7364c-f71b-4902-8012-bccb8e2ad262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:17.789772 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7364c-f71b-4902-8012-bccb8e2ad262 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:17.790055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7364c-f71b-4902-8012-bccb8e2ad262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:17.790361 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7364c-f71b-4902-8012-bccb8e2ad262 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:17.791052 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7364c-f71b-4902-8012-bccb8e2ad262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:17.792968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7364c-f71b-4902-8012-bccb8e2ad262 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:17.805428 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:17.891976 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1414/2842] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:55:17 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 06:55:17.896071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23531ac-d82a-4e1d-8700-41a1c71310e1 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:17.906572 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23531ac-d82a-4e1d-8700-41a1c71310e1 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:17.912959 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1eba-4aee-4e19-acb6-30b08f4e2058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:17.913710 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1eba-4aee-4e19-acb6-30b08f4e2058 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:17.914003 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1eba-4aee-4e19-acb6-30b08f4e2058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:17.914315 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1eba-4aee-4e19-acb6-30b08f4e2058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:17.915052 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1eba-4aee-4e19-acb6-30b08f4e2058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:17.916791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1eba-4aee-4e19-acb6-30b08f4e2058 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:17.928510 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1429/2843] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:55:17.932565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7364c-f71b-4902-8012-bccb8e2ad262 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:17.942778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7364c-f71b-4902-8012-bccb8e2ad262 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:17.947458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c958999-c258-445d-a36a-90b1ee2d0b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:17.950761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c958999-c258-445d-a36a-90b1ee2d0b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:17.950761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c958999-c258-445d-a36a-90b1ee2d0b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:17.950761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c958999-c258-445d-a36a-90b1ee2d0b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:17.950761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c958999-c258-445d-a36a-90b1ee2d0b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:17.951300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c958999-c258-445d-a36a-90b1ee2d0b2c admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:17.962545 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1415/2844] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:55:17.966447 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1eba-4aee-4e19-acb6-30b08f4e2058 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:17.977551 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1eba-4aee-4e19-acb6-30b08f4e2058 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:17.982434 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6422cd8-9d95-4433-b803-62a761b6dc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:17.983327 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6422cd8-9d95-4433-b803-62a761b6dc91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:17.983608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6422cd8-9d95-4433-b803-62a761b6dc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:17.983884 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6422cd8-9d95-4433-b803-62a761b6dc91 admin admin] PATH_INFO: `/v3/projects/1bb9151baf674b6c8bb7946ac1479252/users/5a40f2ce6f8f4015aa2c634713753d47/roles/5c89d9dc8b0949b98573064d572f981a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:17.999180 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6422cd8-9d95-4433-b803-62a761b6dc91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb9151baf674b6c8bb7946ac1479252, user_id=5a40f2ce6f8f4015aa2c634713753d47, role_id=5c89d9dc8b0949b98573064d572f981a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:18.002416 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6422cd8-9d95-4433-b803-62a761b6dc91 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:18.090084 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1430/2845] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:55:17 2022] PUT /identity/v3/projects/1bb9151baf674b6c8bb7946ac1479252/users/5a40f2ce6f8f4015aa2c634713753d47/roles/5c89d9dc8b0949b98573064d572f981a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:55:18.101988 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf3983-f0e8-463a-92d0-ba2b79c9c58a None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:18.102299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf3983-f0e8-463a-92d0-ba2b79c9c58a None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:18.102577 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf3983-f0e8-463a-92d0-ba2b79c9c58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:18.124164 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-91bf3983-f0e8-463a-92d0-ba2b79c9c58a None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:18.130653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-91bf3983-f0e8-463a-92d0-ba2b79c9c58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:18.206569 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1416/2846] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:18.215965 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6422cd8-9d95-4433-b803-62a761b6dc91 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:18.226767 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-a6422cd8-9d95-4433-b803-62a761b6dc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:18.346795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6422cd8-9d95-4433-b803-62a761b6dc91 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:18.352177 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd98a59-d1f0-4c1a-b579-d935ed5be4cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:18.354192 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98a59-d1f0-4c1a-b579-d935ed5be4cd service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:18.354746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98a59-d1f0-4c1a-b579-d935ed5be4cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:18.355094 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98a59-d1f0-4c1a-b579-d935ed5be4cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:18.379314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd98a59-d1f0-4c1a-b579-d935ed5be4cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:18.379736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd98a59-d1f0-4c1a-b579-d935ed5be4cd service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:18.400454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1431/2847] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:55:25.306533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf3983-f0e8-463a-92d0-ba2b79c9c58a None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:25.308522 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-91bf3983-f0e8-463a-92d0-ba2b79c9c58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:25.326782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf3983-f0e8-463a-92d0-ba2b79c9c58a None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:25.335209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:25.336386 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:25.337324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:25.337778 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] PATH_INFO: `/v3/users/c8b81a82cf634d579f796edd0d637686` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:25.342207 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b81a82cf634d579f796edd0d637686)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:25.346011 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:25.539859 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880e60-02d6-491c-ac60-96ffb94b87f1 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:25.540739 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880e60-02d6-491c-ac60-96ffb94b87f1 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:25.541188 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880e60-02d6-491c-ac60-96ffb94b87f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:25.575893 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-7e880e60-02d6-491c-ac60-96ffb94b87f1 None None] MFA Rules not processed for user `5a40f2ce6f8f4015aa2c634713753d47`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:25.577415 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7e880e60-02d6-491c-ac60-96ffb94b87f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:25.589906 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b81a82cf634d579f796edd0d637686'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:25.591003 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b81a82cf634d579f796edd0d637686'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:25.652979 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1432/2848] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:55:25.657324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e880e60-02d6-491c-ac60-96ffb94b87f1 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:25.659159 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-7e880e60-02d6-491c-ac60-96ffb94b87f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:25.667555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:25.674548 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e880e60-02d6-491c-ac60-96ffb94b87f1 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:25.679966 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31b659-7e89-4831-b94b-e6bd72a745e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:25.680674 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31b659-7e89-4831-b94b-e6bd72a745e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:25.680991 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31b659-7e89-4831-b94b-e6bd72a745e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:25.681242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31b659-7e89-4831-b94b-e6bd72a745e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:25.681968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31b659-7e89-4831-b94b-e6bd72a745e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:25.684142 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31b659-7e89-4831-b94b-e6bd72a745e7 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:25.712631 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b81a82cf634d579f796edd0d637686'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:25.725926 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b81a82cf634d579f796edd0d637686'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:25.734292 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b81a82cf634d579f796edd0d637686'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:25.747391 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1417/2849] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:55:25 2022] DELETE /identity/v3/users/c8b81a82cf634d579f796edd0d637686 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:55:25.770888 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1433/2850] 10.222.0.40 () {60 vars in 1152 bytes} [Wed Jun 8 06:55:25 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:55:25.775235 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:25.835381 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:25.840721 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5ad81-b7c4-4b9f-9705-53faae822939 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:25.895220 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590715ec-6e55-4d77-a132-113ba086c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:25.895898 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590715ec-6e55-4d77-a132-113ba086c055 admin admin] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:25.896184 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590715ec-6e55-4d77-a132-113ba086c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:25.896462 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590715ec-6e55-4d77-a132-113ba086c055 admin admin] PATH_INFO: `/v3/users` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:25.897150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590715ec-6e55-4d77-a132-113ba086c055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:25.899092 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590715ec-6e55-4d77-a132-113ba086c055 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:25.983808 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1418/2851] 10.222.0.40 () {60 vars in 1143 bytes} [Wed Jun 8 06:55:25 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 06:55:25.988613 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31b659-7e89-4831-b94b-e6bd72a745e7 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:25.999554 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31b659-7e89-4831-b94b-e6bd72a745e7 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:26.012305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e8122-80ff-49a9-9252-c447001ca8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:26.012305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8122-80ff-49a9-9252-c447001ca8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:26.012305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8122-80ff-49a9-9252-c447001ca8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:26.012305 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8122-80ff-49a9-9252-c447001ca8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:26.012622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e8122-80ff-49a9-9252-c447001ca8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:26.012622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e8122-80ff-49a9-9252-c447001ca8d0 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:26.015374 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590715ec-6e55-4d77-a132-113ba086c055 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:26.017276 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-590715ec-6e55-4d77-a132-113ba086c055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:26.019706 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1434/2852] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:55:26.025449 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e8122-80ff-49a9-9252-c447001ca8d0 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:26.031100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590715ec-6e55-4d77-a132-113ba086c055 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:26.036679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:26.037549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:26.037831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:26.040784 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] PATH_INFO: `/v3/projects/40eb388cd72843fbb288020f33cd73f3` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:26.041350 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e8122-80ff-49a9-9252-c447001ca8d0 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:26.041544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=40eb388cd72843fbb288020f33cd73f3)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:26.041544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:26.045190 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9252e-e54c-4a6f-afe6-478166728dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:26.046116 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9252e-e54c-4a6f-afe6-478166728dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:26.046424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9252e-e54c-4a6f-afe6-478166728dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:26.046697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9252e-e54c-4a6f-afe6-478166728dc6 admin admin] PATH_INFO: `/v3/projects/06d262db2e9b41418be20bcf4861771e/users/b108855148df469dab60a7b92649e294/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:26.062400 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9252e-e54c-4a6f-afe6-478166728dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d262db2e9b41418be20bcf4861771e, user_id=b108855148df469dab60a7b92649e294, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:26.065128 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9252e-e54c-4a6f-afe6-478166728dc6 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:26.175339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1435/2853] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:55:26 2022] PUT /identity/v3/projects/06d262db2e9b41418be20bcf4861771e/users/b108855148df469dab60a7b92649e294/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:55:26.176446 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9252e-e54c-4a6f-afe6-478166728dc6 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:26.193166 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40eb388cd72843fbb288020f33cd73f3', 'request_id': 'req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:26.260918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9252e-e54c-4a6f-afe6-478166728dc6 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:26.274697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40eb388cd72843fbb288020f33cd73f3', 'request_id': 'req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:26.283779 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40eb388cd72843fbb288020f33cd73f3', 'request_id': 'req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:26.302664 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] The token cache is being invalidate because project 40eb388cd72843fbb288020f33cd73f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:55:26.302949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:26.303759 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:26.305406 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1419/2854] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:55:26 2022] DELETE /identity/v3/projects/40eb388cd72843fbb288020f33cd73f3 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:55:26.309131 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:26.310567 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:26.325697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fc452-1bef-478a-8294-117946f72336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:26.326496 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc452-1bef-478a-8294-117946f72336 admin admin] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:26.326890 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc452-1bef-478a-8294-117946f72336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:26.327232 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc452-1bef-478a-8294-117946f72336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:26.328058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fc452-1bef-478a-8294-117946f72336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:26.330345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fc452-1bef-478a-8294-117946f72336 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:26.340191 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1436/2855] 10.222.0.40 () {58 vars in 1121 bytes} [Wed Jun 8 06:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 06:55:26.346469 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fc452-1bef-478a-8294-117946f72336 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:26.347023 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-149fc452-1bef-478a-8294-117946f72336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:26.359048 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fc452-1bef-478a-8294-117946f72336 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:26.365219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b4b11-ac4d-4279-bc3b-6037b0bf5ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:26.366287 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b4b11-ac4d-4279-bc3b-6037b0bf5ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:26.366681 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b4b11-ac4d-4279-bc3b-6037b0bf5ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:26.366964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b4b11-ac4d-4279-bc3b-6037b0bf5ebe admin admin] PATH_INFO: `/v3/projects/06d262db2e9b41418be20bcf4861771e/users/b108855148df469dab60a7b92649e294/roles/ac92b450c3944b7293c9140d40a45c00` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:26.369178 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b4b11-ac4d-4279-bc3b-6037b0bf5ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d262db2e9b41418be20bcf4861771e, user_id=b108855148df469dab60a7b92649e294, role_id=ac92b450c3944b7293c9140d40a45c00)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:26.371866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b4b11-ac4d-4279-bc3b-6037b0bf5ebe admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:26.379581 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb01b8-7ba8-4d59-989d-ebea0a68b9ab admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:26.383184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1437/2856] 10.222.0.40 () {60 vars in 1482 bytes} [Wed Jun 8 06:55:26 2022] PUT /identity/v3/projects/06d262db2e9b41418be20bcf4861771e/users/b108855148df469dab60a7b92649e294/roles/ac92b450c3944b7293c9140d40a45c00 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:55:26.436077 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:26.436896 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:26.437183 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:26.437460 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] PATH_INFO: `/v3/users/9633327de3db4d5092bc65d03b5c8901` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:26.438758 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9633327de3db4d5092bc65d03b5c8901)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:26.440921 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:26.639342 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9633327de3db4d5092bc65d03b5c8901'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:26.640060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9633327de3db4d5092bc65d03b5c8901'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:26.805912 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9633327de3db4d5092bc65d03b5c8901'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:26.822038 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9633327de3db4d5092bc65d03b5c8901'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:26.829215 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9633327de3db4d5092bc65d03b5c8901'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:26.837005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1420/2857] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:55:26 2022] DELETE /identity/v3/users/9633327de3db4d5092bc65d03b5c8901 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 06:55:26.907533 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:27.130910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b4b11-ac4d-4279-bc3b-6037b0bf5ebe admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:27.130910 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-564b4b11-ac4d-4279-bc3b-6037b0bf5ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:27.143634 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b4b11-ac4d-4279-bc3b-6037b0bf5ebe admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:27.185951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:27.352346 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:27.353481 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:27.353839 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:27.354181 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] PATH_INFO: `/v3/projects/5f77ee5abf974fc0a334c5d12127694b` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:27.355530 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f77ee5abf974fc0a334c5d12127694b)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:27.357575 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:27.497189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f77ee5abf974fc0a334c5d12127694b', 'request_id': 'req-d1054b74-2295-4759-8bb0-6dc912b82f71'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:27.574929 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f77ee5abf974fc0a334c5d12127694b', 'request_id': 'req-d1054b74-2295-4759-8bb0-6dc912b82f71'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:27.584230 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f77ee5abf974fc0a334c5d12127694b', 'request_id': 'req-d1054b74-2295-4759-8bb0-6dc912b82f71'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:27.607076 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] The token cache is being invalidate because project 5f77ee5abf974fc0a334c5d12127694b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:55:27.607373 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:27.610672 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-d1054b74-2295-4759-8bb0-6dc912b82f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:27.626272 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1438/2858] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:55:27 2022] DELETE /identity/v3/projects/5f77ee5abf974fc0a334c5d12127694b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:55:31.887558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:31.889091 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:31.902693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f48f-398b-428d-88e4-5689dddb06e7 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:31.971782 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:31.973047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:31.973518 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:31.974101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] PATH_INFO: `/v3/users/31079c3701f74672a2bfd859888ed537` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:31.975517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=31079c3701f74672a2bfd859888ed537)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:31.977828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:32.201346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:32.206001 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31079c3701f74672a2bfd859888ed537'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:32.206630 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31079c3701f74672a2bfd859888ed537'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:32.283706 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31079c3701f74672a2bfd859888ed537'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:32.302841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31079c3701f74672a2bfd859888ed537'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:32.311716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31079c3701f74672a2bfd859888ed537'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:32.319286 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1421/2859] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:55:31 2022] DELETE /identity/v3/users/31079c3701f74672a2bfd859888ed537 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:55:32.326842 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3bf1-f0b6-41e2-908a-d7d19c393e8e None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:32.327406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3bf1-f0b6-41e2-908a-d7d19c393e8e None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:32.327406 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3bf1-f0b6-41e2-908a-d7d19c393e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:32.350918 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-0b4c3bf1-f0b6-41e2-908a-d7d19c393e8e None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:32.352165 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0b4c3bf1-f0b6-41e2-908a-d7d19c393e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:32.436651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1439/2860] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:32.444106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:32.445922 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:32.531837 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9741487-936c-4e91-a63a-858547a26daf admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:32.536466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69382216-e915-46a7-8f92-e1695e1980bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:32.543178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69382216-e915-46a7-8f92-e1695e1980bd service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:32.543178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69382216-e915-46a7-8f92-e1695e1980bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:32.543178 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69382216-e915-46a7-8f92-e1695e1980bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:32.562892 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69382216-e915-46a7-8f92-e1695e1980bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:32.564299 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69382216-e915-46a7-8f92-e1695e1980bd service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:32.575928 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1422/2861] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:55:32.896169 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4e470-8867-4a5b-b791-fb9c56f1a53a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:32.896169 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4e470-8867-4a5b-b791-fb9c56f1a53a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:32.896688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4e470-8867-4a5b-b791-fb9c56f1a53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:32.930795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-c7b4e470-8867-4a5b-b791-fb9c56f1a53a None None] MFA Rules not processed for user `b108855148df469dab60a7b92649e294`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:32.932728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c7b4e470-8867-4a5b-b791-fb9c56f1a53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:33.002175 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:33.023307 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1440/2862] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:33.036036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69382216-e915-46a7-8f92-e1695e1980bd service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:33.037332 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-69382216-e915-46a7-8f92-e1695e1980bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:33.082951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4e470-8867-4a5b-b791-fb9c56f1a53a None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:33.084562 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c7b4e470-8867-4a5b-b791-fb9c56f1a53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:33.102911 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4e470-8867-4a5b-b791-fb9c56f1a53a None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:33.109174 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69382216-e915-46a7-8f92-e1695e1980bd service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:33.109370 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:33.110355 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:33.111404 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:33.111795 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] PATH_INFO: `/v3/projects/6d56696ac1474643a26518062433e747` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:33.114000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d56696ac1474643a26518062433e747)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:33.115034 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc784f-18fa-47fe-8b3d-c6253903c4fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5498a6912a08408d9ea30920faceee7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:33.115697 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc784f-18fa-47fe-8b3d-c6253903c4fd service glance] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:33.115972 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc784f-18fa-47fe-8b3d-c6253903c4fd service glance] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:33.116265 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc784f-18fa-47fe-8b3d-c6253903c4fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:33.116909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:33.118228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-51bc784f-18fa-47fe-8b3d-c6253903c4fd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:33.200989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc784f-18fa-47fe-8b3d-c6253903c4fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:33.202552 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc784f-18fa-47fe-8b3d-c6253903c4fd service glance] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:33.212582 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1423/2863] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:55:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:55:33.283882 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc784f-18fa-47fe-8b3d-c6253903c4fd service glance] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:33.285456 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-51bc784f-18fa-47fe-8b3d-c6253903c4fd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:33.286594 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d56696ac1474643a26518062433e747', 'request_id': 'req-9d40c0f3-710e-4ec9-914b-f18063c3dddb'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:33.315031 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:33.357013 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc784f-18fa-47fe-8b3d-c6253903c4fd service glance] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:33.368678 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d56696ac1474643a26518062433e747', 'request_id': 'req-9d40c0f3-710e-4ec9-914b-f18063c3dddb'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:33.377936 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d56696ac1474643a26518062433e747', 'request_id': 'req-9d40c0f3-710e-4ec9-914b-f18063c3dddb'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:33.391508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] The token cache is being invalidate because project 6d56696ac1474643a26518062433e747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:55:33.392065 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:33.392759 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-9d40c0f3-710e-4ec9-914b-f18063c3dddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:55:33.394471 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1441/2864] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:55:33 2022] DELETE /identity/v3/projects/6d56696ac1474643a26518062433e747 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:55:33.431536 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50057131-a152-4de7-bfeb-ac90b79f97ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:33.433738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50057131-a152-4de7-bfeb-ac90b79f97ac service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:33.433738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50057131-a152-4de7-bfeb-ac90b79f97ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:33.433738 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50057131-a152-4de7-bfeb-ac90b79f97ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:33.436037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-50057131-a152-4de7-bfeb-ac90b79f97ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:33.499007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fbc5c-3514-47fb-885f-4c51e599b502 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:33.500653 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fbc5c-3514-47fb-885f-4c51e599b502 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:33.501331 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fbc5c-3514-47fb-885f-4c51e599b502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:33.549752 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-3c8fbc5c-3514-47fb-885f-4c51e599b502 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:33.554952 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3c8fbc5c-3514-47fb-885f-4c51e599b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:33.572662 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50057131-a152-4de7-bfeb-ac90b79f97ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:33.574213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50057131-a152-4de7-bfeb-ac90b79f97ac service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:33.598915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1424/2865] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:55:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 06:55:33.705680 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1442/2866] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:55:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:55:33.868101 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50057131-a152-4de7-bfeb-ac90b79f97ac service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:33.869200 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-50057131-a152-4de7-bfeb-ac90b79f97ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:33.992666 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50057131-a152-4de7-bfeb-ac90b79f97ac service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:33.997928 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2b127-beb6-4d78-ae43-39196ba854b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:33.998443 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2b127-beb6-4d78-ae43-39196ba854b8 service swift] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:33.998755 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2b127-beb6-4d78-ae43-39196ba854b8 service swift] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:33.999025 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2b127-beb6-4d78-ae43-39196ba854b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:34.007384 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2b127-beb6-4d78-ae43-39196ba854b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:34.012915 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2b127-beb6-4d78-ae43-39196ba854b8 service swift] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:34.023464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1425/2867] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:55:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:55:42.566891 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d521f-81ab-4dcb-81b5-1b04e792186a None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:42.567440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d521f-81ab-4dcb-81b5-1b04e792186a None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:42.567440 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d521f-81ab-4dcb-81b5-1b04e792186a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:42.586224 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-0c7d521f-81ab-4dcb-81b5-1b04e792186a None None] MFA Rules not processed for user `3574d4eb86234460889a586a4a6acbd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:42.587517 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0c7d521f-81ab-4dcb-81b5-1b04e792186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:42.594850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1443/2868] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:44.015187 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=92 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:44.744558 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41477-5b67-4835-ae6e-0248703a3a71 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:44.744846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41477-5b67-4835-ae6e-0248703a3a71 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:44.745123 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41477-5b67-4835-ae6e-0248703a3a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:44.762844 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-44a41477-5b67-4835-ae6e-0248703a3a71 None None] MFA Rules not processed for user `5a40f2ce6f8f4015aa2c634713753d47`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:44.764075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-44a41477-5b67-4835-ae6e-0248703a3a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:44.825732 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1426/2869] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:55:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:48.645516 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2bb7a-1ee1-48cd-9229-262a9621b2db None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:48.646484 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2bb7a-1ee1-48cd-9229-262a9621b2db None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:48.646833 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2bb7a-1ee1-48cd-9229-262a9621b2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:48.666637 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-afe2bb7a-1ee1-48cd-9229-262a9621b2db None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:55:48.667945 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-afe2bb7a-1ee1-48cd-9229-262a9621b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:48.683791 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1444/2870] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jun 8 06:55:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 06:55:48.693369 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41477-5b67-4835-ae6e-0248703a3a71 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:48.708033 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41477-5b67-4835-ae6e-0248703a3a71 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:48.714480 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f367d-c9a5-4370-bb33-64908f8a2a48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:48.716070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f367d-c9a5-4370-bb33-64908f8a2a48 service swift] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:48.716677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f367d-c9a5-4370-bb33-64908f8a2a48 service swift] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:48.717131 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f367d-c9a5-4370-bb33-64908f8a2a48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:48.729358 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f367d-c9a5-4370-bb33-64908f8a2a48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:48.731090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f367d-c9a5-4370-bb33-64908f8a2a48 service swift] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:55:48.741611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1427/2871] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 06:55:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 06:55:58.660917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:58.738590 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=31 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:55:59.893174 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2bb7a-1ee1-48cd-9229-262a9621b2db None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:55:59.895486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-afe2bb7a-1ee1-48cd-9229-262a9621b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:55:59.963923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2bb7a-1ee1-48cd-9229-262a9621b2db None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:55:59.968528 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:55:59.970005 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:55:59.973503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:55:59.973503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] PATH_INFO: `/v3/users/06134303869e41919507b35823bc61fe` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:55:59.973503 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06134303869e41919507b35823bc61fe)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:55:59.973957 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:56:00.164902 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06134303869e41919507b35823bc61fe'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:56:00.165608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06134303869e41919507b35823bc61fe'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:56:00.178508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06134303869e41919507b35823bc61fe'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:56:00.248067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06134303869e41919507b35823bc61fe'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:56:00.257374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06134303869e41919507b35823bc61fe'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:56:00.264924 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1445/2872] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 06:55:59 2022] DELETE /identity/v3/users/06134303869e41919507b35823bc61fe => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:56:00.270161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd026394-a19a-4a0b-b71e-5a71a22975d9 None None] REQUEST_METHOD: `POST` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:56:00.270706 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd026394-a19a-4a0b-b71e-5a71a22975d9 None None] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:56:00.270965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd026394-a19a-4a0b-b71e-5a71a22975d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:56:00.290571 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.auth.core [None req-cd026394-a19a-4a0b-b71e-5a71a22975d9 None None] MFA Rules not processed for user `d3b20259d4d74838a9e50d6db7cf7a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 06:56:00.292086 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-cd026394-a19a-4a0b-b71e-5a71a22975d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:56:00.351606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1428/2873] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 06:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 06:56:00.361818 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:56:00.363264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:56:00.421028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193b03b-bdf4-4e7a-85c2-a01cbd7abf4a admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:56:00.424863 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa444e89-7d17-4428-98a9-d1ac650614d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:56:00.425540 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444e89-7d17-4428-98a9-d1ac650614d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:56:00.425819 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444e89-7d17-4428-98a9-d1ac650614d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:56:00.426092 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444e89-7d17-4428-98a9-d1ac650614d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:56:00.435671 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa444e89-7d17-4428-98a9-d1ac650614d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:56:00.437098 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa444e89-7d17-4428-98a9-d1ac650614d2 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:56:00.447294 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1446/2874] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:56:00.876242 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd026394-a19a-4a0b-b71e-5a71a22975d9 None None] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:56:00.877614 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-cd026394-a19a-4a0b-b71e-5a71a22975d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:56:00.904451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd026394-a19a-4a0b-b71e-5a71a22975d9 None None] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:56:00.914155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:56:00.914155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:56:00.914155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:56:00.914155 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] PATH_INFO: `/v3/projects/297205f931c34ecc9bf4cd7f68fa8306` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:56:00.914945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=297205f931c34ecc9bf4cd7f68fa8306)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:56:00.914945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:56:01.044414 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297205f931c34ecc9bf4cd7f68fa8306', 'request_id': 'req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:56:01.137209 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297205f931c34ecc9bf4cd7f68fa8306', 'request_id': 'req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:56:01.143646 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297205f931c34ecc9bf4cd7f68fa8306', 'request_id': 'req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:56:01.155485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] The token cache is being invalidate because project 297205f931c34ecc9bf4cd7f68fa8306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 06:56:01.155775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:56:01.156469 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 06:56:01.158574 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1429/2875] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 06:56:00 2022] DELETE /identity/v3/projects/297205f931c34ecc9bf4cd7f68fa8306 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 06:56:10.443090 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:56:11.152464 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:56:12.740717 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa444e89-7d17-4428-98a9-d1ac650614d2 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:56:12.742135 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-fa444e89-7d17-4428-98a9-d1ac650614d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:56:12.753145 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa444e89-7d17-4428-98a9-d1ac650614d2 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:56:12.800614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224c4f7-520b-4801-b32c-1b675eba3c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:56:12.801253 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224c4f7-520b-4801-b32c-1b675eba3c7a service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:56:12.801536 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224c4f7-520b-4801-b32c-1b675eba3c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:56:12.801806 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224c4f7-520b-4801-b32c-1b675eba3c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:56:12.803555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c224c4f7-520b-4801-b32c-1b675eba3c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:56:12.865056 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224c4f7-520b-4801-b32c-1b675eba3c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:56:12.866499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224c4f7-520b-4801-b32c-1b675eba3c7a service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:56:12.875972 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1447/2876] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:56:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:56:22.871606 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=50 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:57:08.726624 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:57:08.728163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:57:08.741057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8530e8-f9e5-4ce9-b9ba-b81813f1b292 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:57:08.744689 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfdd72-2599-466b-8fe2-001396ced19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:57:08.745333 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfdd72-2599-466b-8fe2-001396ced19e service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:57:08.745618 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfdd72-2599-466b-8fe2-001396ced19e service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:57:08.745924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfdd72-2599-466b-8fe2-001396ced19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:57:08.747861 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-0bcfdd72-2599-466b-8fe2-001396ced19e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:57:08.757514 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfdd72-2599-466b-8fe2-001396ced19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:57:08.759016 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfdd72-2599-466b-8fe2-001396ced19e service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:57:08.766986 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1430/2877] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:57:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:57:10.658866 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224c4f7-520b-4801-b32c-1b675eba3c7a service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:57:10.667462 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224c4f7-520b-4801-b32c-1b675eba3c7a service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:57:10.671111 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c564c8a-55ff-4286-9777-c3c546b12920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:57:10.671748 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564c8a-55ff-4286-9777-c3c546b12920 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:57:10.672030 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564c8a-55ff-4286-9777-c3c546b12920 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:57:10.672306 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564c8a-55ff-4286-9777-c3c546b12920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:57:10.674074 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-3c564c8a-55ff-4286-9777-c3c546b12920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:57:10.743426 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c564c8a-55ff-4286-9777-c3c546b12920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:57:10.744768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c564c8a-55ff-4286-9777-c3c546b12920 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:57:10.755556 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1448/2878] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:57:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:57:10.883882 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfdd72-2599-466b-8fe2-001396ced19e service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:57:10.893105 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfdd72-2599-466b-8fe2-001396ced19e service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:57:10.896633 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b38dd6-2a47-4d8c-b259-e91461d2e90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:57:10.897262 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38dd6-2a47-4d8c-b259-e91461d2e90a service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:57:10.897544 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38dd6-2a47-4d8c-b259-e91461d2e90a service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:57:10.897817 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38dd6-2a47-4d8c-b259-e91461d2e90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:57:10.899621 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-36b38dd6-2a47-4d8c-b259-e91461d2e90a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:57:10.961748 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b38dd6-2a47-4d8c-b259-e91461d2e90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:57:10.963202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b38dd6-2a47-4d8c-b259-e91461d2e90a service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:57:10.972685 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1431/2879] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:57:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:57:18.960841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c564c8a-55ff-4286-9777-c3c546b12920 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:57:18.969384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c564c8a-55ff-4286-9777-c3c546b12920 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:57:18.973655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b4ce-9470-4196-a11b-31a7b08cfbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:57:18.974312 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b4ce-9470-4196-a11b-31a7b08cfbbb service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:57:18.974598 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b4ce-9470-4196-a11b-31a7b08cfbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:57:18.974873 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b4ce-9470-4196-a11b-31a7b08cfbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:57:18.976738 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0022b4ce-9470-4196-a11b-31a7b08cfbbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:57:18.990187 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b4ce-9470-4196-a11b-31a7b08cfbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:57:18.991228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b4ce-9470-4196-a11b-31a7b08cfbbb service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:57:19.003340 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1449/2880] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:57:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:57:20.968357 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=36 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:57:28.997375 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=40 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:57:46.827036 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b38dd6-2a47-4d8c-b259-e91461d2e90a service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:57:46.829238 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-36b38dd6-2a47-4d8c-b259-e91461d2e90a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:57:46.851945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b38dd6-2a47-4d8c-b259-e91461d2e90a service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:57:46.858937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a836e-b948-4895-b834-6a63efbb7841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:57:46.858937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a836e-b948-4895-b834-6a63efbb7841 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:57:46.858937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a836e-b948-4895-b834-6a63efbb7841 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:57:46.858937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a836e-b948-4895-b834-6a63efbb7841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:57:46.860583 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f48a836e-b948-4895-b834-6a63efbb7841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:57:46.873760 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a836e-b948-4895-b834-6a63efbb7841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:57:46.876887 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a836e-b948-4895-b834-6a63efbb7841 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:57:46.888832 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1432/2881] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:57:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:57:49.631750 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b4ce-9470-4196-a11b-31a7b08cfbbb service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 06:57:49.643733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b4ce-9470-4196-a11b-31a7b08cfbbb service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 06:57:49.649245 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdc0ea-cd93-43f7-914d-eaf931fa0322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 06:57:49.649926 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdc0ea-cd93-43f7-914d-eaf931fa0322 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 06:57:49.650215 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdc0ea-cd93-43f7-914d-eaf931fa0322 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 06:57:49.650587 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdc0ea-cd93-43f7-914d-eaf931fa0322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 06:57:49.652320 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-dabdc0ea-cd93-43f7-914d-eaf931fa0322 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 06:57:49.665630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdc0ea-cd93-43f7-914d-eaf931fa0322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 06:57:49.667183 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdc0ea-cd93-43f7-914d-eaf931fa0322 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 06:57:49.677787 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1450/2882] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 06:57:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 06:57:56.883768 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 06:57:59.673275 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=6 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:00:01.749340 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a836e-b948-4895-b834-6a63efbb7841 service nova] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:00:01.750775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f48a836e-b948-4895-b834-6a63efbb7841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:00:01.886673 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a836e-b948-4895-b834-6a63efbb7841 service nova] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:00:01.891812 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbbdcc-bc9c-41eb-b3b2-90dd4a130703 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:00:01.892461 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbbdcc-bc9c-41eb-b3b2-90dd4a130703 service placement] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:00:01.892742 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbbdcc-bc9c-41eb-b3b2-90dd4a130703 service placement] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:00:01.893018 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbbdcc-bc9c-41eb-b3b2-90dd4a130703 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:00:01.894820 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-67fbbdcc-bc9c-41eb-b3b2-90dd4a130703 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:00:01.906859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbbdcc-bc9c-41eb-b3b2-90dd4a130703 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:00:01.908432 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbbdcc-bc9c-41eb-b3b2-90dd4a130703 service placement] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:00:01.918324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1433/2883] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:00:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:00:10.853968 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdc0ea-cd93-43f7-914d-eaf931fa0322 service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:00:10.855420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-dabdc0ea-cd93-43f7-914d-eaf931fa0322 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:00:10.967028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdc0ea-cd93-43f7-914d-eaf931fa0322 service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:00:10.970616 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b133-ea81-4f06-aa2b-c0073be38bab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:00:10.971262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b133-ea81-4f06-aa2b-c0073be38bab service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:00:10.971543 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b133-ea81-4f06-aa2b-c0073be38bab service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:00:10.971819 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b133-ea81-4f06-aa2b-c0073be38bab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:00:10.973587 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4034b133-ea81-4f06-aa2b-c0073be38bab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:00:11.030418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034b133-ea81-4f06-aa2b-c0073be38bab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:00:11.031841 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034b133-ea81-4f06-aa2b-c0073be38bab service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:00:11.040679 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1451/2884] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:00:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:00:11.914009 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=63 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:00:21.036642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=70 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:00:32.910228 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbbdcc-bc9c-41eb-b3b2-90dd4a130703 service placement] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:00:32.940846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbbdcc-bc9c-41eb-b3b2-90dd4a130703 service placement] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:00:32.946167 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174bc60-c02d-48a2-8ce7-0b9f9d913b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:00:32.946828 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174bc60-c02d-48a2-8ce7-0b9f9d913b75 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:00:32.947109 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174bc60-c02d-48a2-8ce7-0b9f9d913b75 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:00:32.947382 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174bc60-c02d-48a2-8ce7-0b9f9d913b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:00:32.949754 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5174bc60-c02d-48a2-8ce7-0b9f9d913b75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:00:33.005175 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174bc60-c02d-48a2-8ce7-0b9f9d913b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:00:33.006775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174bc60-c02d-48a2-8ce7-0b9f9d913b75 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:00:33.016128 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1434/2885] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:00:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:00:34.710174 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b133-ea81-4f06-aa2b-c0073be38bab service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:00:34.711581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4034b133-ea81-4f06-aa2b-c0073be38bab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:00:34.739988 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b133-ea81-4f06-aa2b-c0073be38bab service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:00:34.745384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de9b2-5529-4f9c-8220-be8edc9cf0ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:00:34.746043 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de9b2-5529-4f9c-8220-be8edc9cf0ca service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:00:34.746358 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de9b2-5529-4f9c-8220-be8edc9cf0ca service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:00:34.746633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de9b2-5529-4f9c-8220-be8edc9cf0ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:00:34.748326 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e16de9b2-5529-4f9c-8220-be8edc9cf0ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:00:34.825386 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de9b2-5529-4f9c-8220-be8edc9cf0ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:00:34.827263 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de9b2-5529-4f9c-8220-be8edc9cf0ca service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:00:34.845689 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1452/2886] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:00:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:00:43.011505 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=35 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:00:44.843103 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=46 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:02:10.369926 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174bc60-c02d-48a2-8ce7-0b9f9d913b75 service nova] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:02:10.388486 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174bc60-c02d-48a2-8ce7-0b9f9d913b75 service nova] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:02:10.392173 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3478f-8788-4edf-ac78-2ccbba0cdca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:02:10.392757 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3478f-8788-4edf-ac78-2ccbba0cdca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:02:10.393045 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3478f-8788-4edf-ac78-2ccbba0cdca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:02:10.393319 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3478f-8788-4edf-ac78-2ccbba0cdca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:02:10.404094 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3478f-8788-4edf-ac78-2ccbba0cdca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:02:10.405508 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3478f-8788-4edf-ac78-2ccbba0cdca3 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:02:10.417057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1435/2887] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:02:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:02:20.411517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=10 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:02:21.390702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de9b2-5529-4f9c-8220-be8edc9cf0ca service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:02:21.400160 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de9b2-5529-4f9c-8220-be8edc9cf0ca service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:02:21.403733 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5237b-c50d-42f3-8b91-8cb0d20a91ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:02:21.404366 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5237b-c50d-42f3-8b91-8cb0d20a91ab service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:02:21.404655 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5237b-c50d-42f3-8b91-8cb0d20a91ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:02:21.404928 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5237b-c50d-42f3-8b91-8cb0d20a91ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:02:21.415849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5237b-c50d-42f3-8b91-8cb0d20a91ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:02:21.417258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5237b-c50d-42f3-8b91-8cb0d20a91ab service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:02:21.428073 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1453/2888] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:02:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:02:31.423252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=6 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:03:03.420627 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3478f-8788-4edf-ac78-2ccbba0cdca3 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:03:03.430126 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3478f-8788-4edf-ac78-2ccbba0cdca3 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:03:03.433848 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938da827-fc1e-4311-b667-056f357df3e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:03:03.434530 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938da827-fc1e-4311-b667-056f357df3e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:03:03.434841 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938da827-fc1e-4311-b667-056f357df3e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:03:03.435154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938da827-fc1e-4311-b667-056f357df3e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:03:03.442501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938da827-fc1e-4311-b667-056f357df3e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:03:03.444457 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938da827-fc1e-4311-b667-056f357df3e0 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:03:03.452683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1436/2889] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:03:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:03:13.448852 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:05:06.318576 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5237b-c50d-42f3-8b91-8cb0d20a91ab service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:05:06.319960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-42e5237b-c50d-42f3-8b91-8cb0d20a91ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:05:06.335916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5237b-c50d-42f3-8b91-8cb0d20a91ab service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:05:06.341762 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dfdc1-2cd1-4a79-b847-1cc8cbff80d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:05:06.342454 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dfdc1-2cd1-4a79-b847-1cc8cbff80d8 service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:05:06.342741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dfdc1-2cd1-4a79-b847-1cc8cbff80d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:05:06.343021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dfdc1-2cd1-4a79-b847-1cc8cbff80d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:05:06.352684 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dfdc1-2cd1-4a79-b847-1cc8cbff80d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:05:06.354262 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dfdc1-2cd1-4a79-b847-1cc8cbff80d8 service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:05:06.364876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1454/2890] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:05:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:05:16.359946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=6 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:05:50.200650 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938da827-fc1e-4311-b667-056f357df3e0 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:05:50.202122 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-938da827-fc1e-4311-b667-056f357df3e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:05:50.214137 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938da827-fc1e-4311-b667-056f357df3e0 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:05:50.218110 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81724d7b-f665-4a9a-a172-269f7da89bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:05:50.219471 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81724d7b-f665-4a9a-a172-269f7da89bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:05:50.221940 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81724d7b-f665-4a9a-a172-269f7da89bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:05:50.222600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81724d7b-f665-4a9a-a172-269f7da89bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:05:50.231104 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81724d7b-f665-4a9a-a172-269f7da89bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:05:50.232507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81724d7b-f665-4a9a-a172-269f7da89bb7 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:05:50.262212 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1437/2891] 10.222.0.40 () {60 vars in 1396 bytes} [Wed Jun 8 07:05:50 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:05:50.362802 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dfdc1-2cd1-4a79-b847-1cc8cbff80d8 service placement] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:05:50.372754 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dfdc1-2cd1-4a79-b847-1cc8cbff80d8 service placement] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:05:50.376347 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d233123-74a0-48d4-9864-b87bf163b53e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:05:50.377085 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233123-74a0-48d4-9864-b87bf163b53e service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:05:50.377371 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233123-74a0-48d4-9864-b87bf163b53e service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:05:50.377645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233123-74a0-48d4-9864-b87bf163b53e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:05:50.386063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d233123-74a0-48d4-9864-b87bf163b53e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:05:50.387628 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d233123-74a0-48d4-9864-b87bf163b53e service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:05:50.414630 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1455/2892] 10.222.0.40 () {60 vars in 1396 bytes} [Wed Jun 8 07:05:50 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:05:50.457989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81724d7b-f665-4a9a-a172-269f7da89bb7 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:05:50.466532 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81724d7b-f665-4a9a-a172-269f7da89bb7 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:05:50.471924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ade6a-ae02-416f-b252-b900ed54c3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:05:50.471924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ade6a-ae02-416f-b252-b900ed54c3ed service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:05:50.471924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ade6a-ae02-416f-b252-b900ed54c3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:05:50.471924 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ade6a-ae02-416f-b252-b900ed54c3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:05:50.480699 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ade6a-ae02-416f-b252-b900ed54c3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:05:50.482102 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ade6a-ae02-416f-b252-b900ed54c3ed service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:05:50.492990 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1438/2893] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:05:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:06:00.412002 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=13 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:06:00.486975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=19 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:07:50.658622 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d233123-74a0-48d4-9864-b87bf163b53e service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:07:50.667264 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d233123-74a0-48d4-9864-b87bf163b53e service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:07:50.670862 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722c970-9ca7-4920-b917-245af69582a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:07:50.671514 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c970-9ca7-4920-b917-245af69582a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:07:50.671793 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c970-9ca7-4920-b917-245af69582a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:07:50.672109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c970-9ca7-4920-b917-245af69582a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:07:50.673946 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d722c970-9ca7-4920-b917-245af69582a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:07:50.746049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722c970-9ca7-4920-b917-245af69582a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:07:50.747508 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722c970-9ca7-4920-b917-245af69582a1 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:07:50.758689 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1456/2894] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:07:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:07:50.805218 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ade6a-ae02-416f-b252-b900ed54c3ed service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:07:50.815028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ade6a-ae02-416f-b252-b900ed54c3ed service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:07:50.819100 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2325c-faa9-4a36-8cb8-a1e3793e5671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:07:50.819743 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2325c-faa9-4a36-8cb8-a1e3793e5671 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:07:50.820028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2325c-faa9-4a36-8cb8-a1e3793e5671 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:07:50.820307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2325c-faa9-4a36-8cb8-a1e3793e5671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:07:50.823466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-bae2325c-faa9-4a36-8cb8-a1e3793e5671 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:07:50.837716 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2325c-faa9-4a36-8cb8-a1e3793e5671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:07:50.839669 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2325c-faa9-4a36-8cb8-a1e3793e5671 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:07:50.850995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1439/2895] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:07:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:08:00.754418 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=34 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:08:00.845822 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:08:10.081117 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722c970-9ca7-4920-b917-245af69582a1 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:08:10.082783 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d722c970-9ca7-4920-b917-245af69582a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:08:10.149876 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722c970-9ca7-4920-b917-245af69582a1 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:08:10.154162 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb07a8-9a55-4438-a619-b6940d241a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:08:10.154849 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb07a8-9a55-4438-a619-b6940d241a34 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:08:10.155133 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb07a8-9a55-4438-a619-b6940d241a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:08:10.155435 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb07a8-9a55-4438-a619-b6940d241a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:08:10.157364 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0fbb07a8-9a55-4438-a619-b6940d241a34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:08:10.166952 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb07a8-9a55-4438-a619-b6940d241a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:08:10.168949 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb07a8-9a55-4438-a619-b6940d241a34 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:08:10.176963 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1457/2896] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:08:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:08:20.173322 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=31 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:10:11.705515 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2325c-faa9-4a36-8cb8-a1e3793e5671 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:10:11.815198 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2325c-faa9-4a36-8cb8-a1e3793e5671 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:10:11.820143 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb2a3e-14b2-4fec-b0c2-882bf5f362ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:10:11.820785 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb2a3e-14b2-4fec-b0c2-882bf5f362ca service placement] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:10:11.821065 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb2a3e-14b2-4fec-b0c2-882bf5f362ca service placement] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:10:11.821338 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb2a3e-14b2-4fec-b0c2-882bf5f362ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:10:11.823214 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-f1cb2a3e-14b2-4fec-b0c2-882bf5f362ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:10:11.855600 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb2a3e-14b2-4fec-b0c2-882bf5f362ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:10:11.857749 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb2a3e-14b2-4fec-b0c2-882bf5f362ca service placement] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:10:11.867573 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1440/2897] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:10:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:10:21.863347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=63 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:10:50.537451 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb07a8-9a55-4438-a619-b6940d241a34 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:10:50.539021 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0fbb07a8-9a55-4438-a619-b6940d241a34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:10:50.641850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb07a8-9a55-4438-a619-b6940d241a34 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:10:50.646448 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c185e1-a462-4f82-abc2-8c75c3b961fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:10:50.647093 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c185e1-a462-4f82-abc2-8c75c3b961fc service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:10:50.647374 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c185e1-a462-4f82-abc2-8c75c3b961fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:10:50.647647 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c185e1-a462-4f82-abc2-8c75c3b961fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:10:50.649518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-53c185e1-a462-4f82-abc2-8c75c3b961fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:10:50.718208 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c185e1-a462-4f82-abc2-8c75c3b961fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:10:50.719656 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c185e1-a462-4f82-abc2-8c75c3b961fc service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:10:50.728329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1458/2898] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:10:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:10:50.775081 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb2a3e-14b2-4fec-b0c2-882bf5f362ca service placement] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:10:50.784417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb2a3e-14b2-4fec-b0c2-882bf5f362ca service placement] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:10:50.787868 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ac725-b057-4ed1-8a0f-da7f2f423fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:10:50.788513 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ac725-b057-4ed1-8a0f-da7f2f423fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:10:50.788794 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ac725-b057-4ed1-8a0f-da7f2f423fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:10:50.789070 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ac725-b057-4ed1-8a0f-da7f2f423fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:10:50.791279 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-837ac725-b057-4ed1-8a0f-da7f2f423fc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:10:50.860263 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ac725-b057-4ed1-8a0f-da7f2f423fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:10:50.861688 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ac725-b057-4ed1-8a0f-da7f2f423fc2 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:10:50.870405 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1441/2899] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:10:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:10:50.918670 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c185e1-a462-4f82-abc2-8c75c3b961fc service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:10:50.927025 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c185e1-a462-4f82-abc2-8c75c3b961fc service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:10:50.930724 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b60199-e8a3-41bc-bdd2-3effecdc59c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:10:50.931242 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b60199-e8a3-41bc-bdd2-3effecdc59c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:10:50.931518 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b60199-e8a3-41bc-bdd2-3effecdc59c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:10:50.931789 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b60199-e8a3-41bc-bdd2-3effecdc59c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:10:50.933619 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c0b60199-e8a3-41bc-bdd2-3effecdc59c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:10:50.988549 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:10:51.013756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b60199-e8a3-41bc-bdd2-3effecdc59c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:10:51.015220 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b60199-e8a3-41bc-bdd2-3effecdc59c7 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:10:51.033482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1459/2900] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:10:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:11:00.866447 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=33 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:11:01.030794 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=16 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:13:09.804452 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ac725-b057-4ed1-8a0f-da7f2f423fc2 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:13:09.824150 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ac725-b057-4ed1-8a0f-da7f2f423fc2 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:13:09.827677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d25d1c-f119-4542-88ea-5928c7deacb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:13:09.828321 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d25d1c-f119-4542-88ea-5928c7deacb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:13:09.828586 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d25d1c-f119-4542-88ea-5928c7deacb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:13:09.828862 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d25d1c-f119-4542-88ea-5928c7deacb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:13:09.836048 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d25d1c-f119-4542-88ea-5928c7deacb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:13:09.837440 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d25d1c-f119-4542-88ea-5928c7deacb8 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:13:09.845230 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1442/2901] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:13:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:13:19.841728 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=10 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:13:51.412915 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b60199-e8a3-41bc-bdd2-3effecdc59c7 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:13:51.423033 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b60199-e8a3-41bc-bdd2-3effecdc59c7 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:13:51.426639 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c21de1-1659-4e8d-998a-5bb246caf5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:13:51.427288 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c21de1-1659-4e8d-998a-5bb246caf5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:13:51.427574 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c21de1-1659-4e8d-998a-5bb246caf5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:13:51.427850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c21de1-1659-4e8d-998a-5bb246caf5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:13:51.445040 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c21de1-1659-4e8d-998a-5bb246caf5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:13:51.446535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c21de1-1659-4e8d-998a-5bb246caf5e2 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:13:51.468815 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1460/2902] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:13:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:13:52.638154 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d25d1c-f119-4542-88ea-5928c7deacb8 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:13:52.646677 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d25d1c-f119-4542-88ea-5928c7deacb8 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:13:52.650165 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e35d2-a1c5-4027-b660-e1f05438b34a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:13:52.650823 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e35d2-a1c5-4027-b660-e1f05438b34a service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:13:52.651106 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e35d2-a1c5-4027-b660-e1f05438b34a service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:13:52.651377 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e35d2-a1c5-4027-b660-e1f05438b34a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:13:52.661408 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e35d2-a1c5-4027-b660-e1f05438b34a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:13:52.662846 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e35d2-a1c5-4027-b660-e1f05438b34a service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:13:52.673937 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1443/2903] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:13:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:13:53.472642 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c21de1-1659-4e8d-998a-5bb246caf5e2 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:13:53.474219 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-c4c21de1-1659-4e8d-998a-5bb246caf5e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:13:53.502338 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c21de1-1659-4e8d-998a-5bb246caf5e2 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:13:53.508168 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aed653-db45-4eec-a6bb-8e084747e467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:13:53.508960 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aed653-db45-4eec-a6bb-8e084747e467 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:13:53.509284 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aed653-db45-4eec-a6bb-8e084747e467 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:13:53.509608 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aed653-db45-4eec-a6bb-8e084747e467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:13:53.512141 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d3aed653-db45-4eec-a6bb-8e084747e467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:13:53.524858 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aed653-db45-4eec-a6bb-8e084747e467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:13:53.526707 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aed653-db45-4eec-a6bb-8e084747e467 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:13:53.537324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1461/2904] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:13:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:14:02.669193 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:14:03.532804 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=24 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:15:17.677517 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e35d2-a1c5-4027-b660-e1f05438b34a service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:15:17.679095 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-4c2e35d2-a1c5-4027-b660-e1f05438b34a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:15:17.693288 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e35d2-a1c5-4027-b660-e1f05438b34a service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:15:17.699028 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4e08b-a787-4170-8f93-d32ed4cc6b1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:15:17.699668 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4e08b-a787-4170-8f93-d32ed4cc6b1b service placement] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:15:17.699949 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4e08b-a787-4170-8f93-d32ed4cc6b1b service placement] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:15:17.700247 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4e08b-a787-4170-8f93-d32ed4cc6b1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:15:17.708730 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4e08b-a787-4170-8f93-d32ed4cc6b1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:15:17.710346 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4e08b-a787-4170-8f93-d32ed4cc6b1b service placement] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:15:17.723227 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1444/2905] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:15:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:15:27.716503 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:15:50.443535 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aed653-db45-4eec-a6bb-8e084747e467 service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:15:50.445345 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d3aed653-db45-4eec-a6bb-8e084747e467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:15:50.459218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aed653-db45-4eec-a6bb-8e084747e467 service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:15:50.464850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1830a-9ddf-46d2-87c2-0e8fb87d0307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:15:50.465488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1830a-9ddf-46d2-87c2-0e8fb87d0307 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:15:50.465775 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1830a-9ddf-46d2-87c2-0e8fb87d0307 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:15:50.466058 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1830a-9ddf-46d2-87c2-0e8fb87d0307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:15:50.473919 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1830a-9ddf-46d2-87c2-0e8fb87d0307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:15:50.475614 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1830a-9ddf-46d2-87c2-0e8fb87d0307 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:15:50.503176 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1462/2906] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:15:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:15:51.046060 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4e08b-a787-4170-8f93-d32ed4cc6b1b service placement] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:15:51.057977 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4e08b-a787-4170-8f93-d32ed4cc6b1b service placement] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:15:51.063375 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8349c-9801-40f2-966d-1429ca849763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:15:51.064006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8349c-9801-40f2-966d-1429ca849763 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:15:51.064286 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8349c-9801-40f2-966d-1429ca849763 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:15:51.064557 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8349c-9801-40f2-966d-1429ca849763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:15:51.072390 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8349c-9801-40f2-966d-1429ca849763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:15:51.073935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8349c-9801-40f2-966d-1429ca849763 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:15:51.100356 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1445/2907] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:15:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:15:53.677365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1830a-9ddf-46d2-87c2-0e8fb87d0307 service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:15:53.678901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0cc1830a-9ddf-46d2-87c2-0e8fb87d0307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:15:53.691644 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1830a-9ddf-46d2-87c2-0e8fb87d0307 service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:15:53.695258 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7916b-8eb2-4c49-9775-1a0e758d9117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:15:53.695898 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7916b-8eb2-4c49-9775-1a0e758d9117 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:15:53.696184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7916b-8eb2-4c49-9775-1a0e758d9117 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:15:53.696461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7916b-8eb2-4c49-9775-1a0e758d9117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:15:53.705234 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7916b-8eb2-4c49-9775-1a0e758d9117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:15:53.706685 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7916b-8eb2-4c49-9775-1a0e758d9117 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:15:53.715570 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1463/2908] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:15:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:15:54.868103 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8349c-9801-40f2-966d-1429ca849763 service nova] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:15:54.880803 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8349c-9801-40f2-966d-1429ca849763 service nova] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:15:54.887148 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beaffe-726b-4b31-bb54-bc82ff5d71e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:15:54.887975 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beaffe-726b-4b31-bb54-bc82ff5d71e2 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:15:54.888363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beaffe-726b-4b31-bb54-bc82ff5d71e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:15:54.888737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beaffe-726b-4b31-bb54-bc82ff5d71e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:15:54.890917 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c5beaffe-726b-4b31-bb54-bc82ff5d71e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:15:54.905813 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5beaffe-726b-4b31-bb54-bc82ff5d71e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:15:54.907761 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5beaffe-726b-4b31-bb54-bc82ff5d71e2 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:15:54.920638 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1446/2909] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:15:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:16:03.711422 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=19 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:16:04.916186 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=19 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:18:51.384127 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7916b-8eb2-4c49-9775-1a0e758d9117 service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:18:51.386186 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-afa7916b-8eb2-4c49-9775-1a0e758d9117 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:18:51.453339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7916b-8eb2-4c49-9775-1a0e758d9117 service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:18:51.456942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1915b62-a3ab-4c93-bc45-7cb70a13f684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:18:51.457577 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1915b62-a3ab-4c93-bc45-7cb70a13f684 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:18:51.457856 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1915b62-a3ab-4c93-bc45-7cb70a13f684 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:18:51.458125 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1915b62-a3ab-4c93-bc45-7cb70a13f684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:18:51.459984 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b1915b62-a3ab-4c93-bc45-7cb70a13f684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:18:51.526124 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1915b62-a3ab-4c93-bc45-7cb70a13f684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:18:51.527493 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1915b62-a3ab-4c93-bc45-7cb70a13f684 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:18:51.538066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1464/2910] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:18:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:18:52.112876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beaffe-726b-4b31-bb54-bc82ff5d71e2 service nova] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:18:52.127345 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beaffe-726b-4b31-bb54-bc82ff5d71e2 service nova] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:18:52.131055 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d34a-fc6e-46b1-8978-7672b9e3f916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:18:52.131995 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d34a-fc6e-46b1-8978-7672b9e3f916 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:18:52.132345 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d34a-fc6e-46b1-8978-7672b9e3f916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:18:52.132684 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d34a-fc6e-46b1-8978-7672b9e3f916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:18:52.134693 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8b80d34a-fc6e-46b1-8978-7672b9e3f916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:18:52.148935 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80d34a-fc6e-46b1-8978-7672b9e3f916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:18:52.150963 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80d34a-fc6e-46b1-8978-7672b9e3f916 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:18:52.162191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1447/2911] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:18:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:19:01.533313 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=59 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:19:02.157139 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:19:52.163768 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a730790-68b9-4630-87dc-af9ddb96d3d2 None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:19:52.164248 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a730790-68b9-4630-87dc-af9ddb96d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:19:52.164339 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a730790-68b9-4630-87dc-af9ddb96d3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:19:52.222860 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-9a730790-68b9-4630-87dc-af9ddb96d3d2 None None] MFA Rules not processed for user `e9f15c6bec2c4ed99834b2edf1e59947`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 07:19:52.224063 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-9a730790-68b9-4630-87dc-af9ddb96d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:19:52.286298 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1465/2912] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jun 8 07:19:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 07:19:52.327020 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d34a-fc6e-46b1-8978-7672b9e3f916 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:19:52.328405 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-8b80d34a-fc6e-46b1-8978-7672b9e3f916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:19:52.414839 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d34a-fc6e-46b1-8978-7672b9e3f916 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:19:52.419797 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947306a-17bb-4577-bfba-48b85cf401af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2130fd9eb8464e95a4fb24083c36427a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:19:52.420438 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947306a-17bb-4577-bfba-48b85cf401af service swift] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:19:52.420725 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947306a-17bb-4577-bfba-48b85cf401af service swift] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:19:52.421004 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947306a-17bb-4577-bfba-48b85cf401af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:19:52.428968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947306a-17bb-4577-bfba-48b85cf401af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:19:52.431079 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947306a-17bb-4577-bfba-48b85cf401af service swift] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:19:52.438968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1448/2913] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jun 8 07:19:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 07:19:53.501815 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a730790-68b9-4630-87dc-af9ddb96d3d2 None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:19:53.512360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a730790-68b9-4630-87dc-af9ddb96d3d2 None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:19:53.516000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958b9b3-760f-470a-b496-7ad7d521b413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:19:53.516649 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b9b3-760f-470a-b496-7ad7d521b413 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:19:53.516931 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b9b3-760f-470a-b496-7ad7d521b413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:19:53.517205 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b9b3-760f-470a-b496-7ad7d521b413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:19:53.519016 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0958b9b3-760f-470a-b496-7ad7d521b413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:19:53.601916 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958b9b3-760f-470a-b496-7ad7d521b413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:19:53.603365 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958b9b3-760f-470a-b496-7ad7d521b413 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:19:53.621721 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1466/2914] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:19:55.487865 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947306a-17bb-4577-bfba-48b85cf401af service swift] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:19:55.500252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947306a-17bb-4577-bfba-48b85cf401af service swift] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:19:55.505679 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb9170-a943-44c4-87a7-8909c893b68c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:19:55.506348 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb9170-a943-44c4-87a7-8909c893b68c service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:19:55.506629 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb9170-a943-44c4-87a7-8909c893b68c service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:19:55.506903 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb9170-a943-44c4-87a7-8909c893b68c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:19:55.520831 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb9170-a943-44c4-87a7-8909c893b68c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:19:55.522804 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb9170-a943-44c4-87a7-8909c893b68c service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:19:55.536213 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1449/2915] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:19:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:19:57.503218 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958b9b3-760f-470a-b496-7ad7d521b413 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:19:57.504809 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0958b9b3-760f-470a-b496-7ad7d521b413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:19:57.520136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958b9b3-760f-470a-b496-7ad7d521b413 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:19:57.525777 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452d473-5f6a-4adb-8e3b-d1e34e9a44df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:19:57.526459 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452d473-5f6a-4adb-8e3b-d1e34e9a44df service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:19:57.526746 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452d473-5f6a-4adb-8e3b-d1e34e9a44df service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:19:57.527027 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452d473-5f6a-4adb-8e3b-d1e34e9a44df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:19:57.528798 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b452d473-5f6a-4adb-8e3b-d1e34e9a44df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:19:57.541071 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452d473-5f6a-4adb-8e3b-d1e34e9a44df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:19:57.542727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452d473-5f6a-4adb-8e3b-d1e34e9a44df service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:19:57.553029 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1467/2916] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:19:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:20:01.181883 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb9170-a943-44c4-87a7-8909c893b68c service nova] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:20:01.193363 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb9170-a943-44c4-87a7-8909c893b68c service nova] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:20:01.199453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfebd04-9e30-4c90-b6b7-fe52a06de61b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:20:01.200171 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfebd04-9e30-4c90-b6b7-fe52a06de61b service placement] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:20:01.200458 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfebd04-9e30-4c90-b6b7-fe52a06de61b service placement] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:20:01.200736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfebd04-9e30-4c90-b6b7-fe52a06de61b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:20:01.202531 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-ddfebd04-9e30-4c90-b6b7-fe52a06de61b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:20:01.214489 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfebd04-9e30-4c90-b6b7-fe52a06de61b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:20:01.216072 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfebd04-9e30-4c90-b6b7-fe52a06de61b service placement] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:20:01.226177 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1450/2917] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:20:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:20:01.288280 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452d473-5f6a-4adb-8e3b-d1e34e9a44df service placement] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:20:01.290189 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-b452d473-5f6a-4adb-8e3b-d1e34e9a44df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:20:01.304228 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452d473-5f6a-4adb-8e3b-d1e34e9a44df service placement] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:20:01.308880 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:20:01.309727 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:20:01.310007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:20:01.310314 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] PATH_INFO: `/v3/users/5a40f2ce6f8f4015aa2c634713753d47` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:20:01.311501 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a40f2ce6f8f4015aa2c634713753d47)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:20:01.313470 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:20:01.326136 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=100 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:20:01.477651 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a40f2ce6f8f4015aa2c634713753d47'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:01.478352 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a40f2ce6f8f4015aa2c634713753d47'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:01.492997 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a40f2ce6f8f4015aa2c634713753d47'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:01.557006 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a40f2ce6f8f4015aa2c634713753d47'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:01.564560 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a40f2ce6f8f4015aa2c634713753d47'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:01.571118 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1468/2918] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 07:20:01 2022] DELETE /identity/v3/users/5a40f2ce6f8f4015aa2c634713753d47 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 07:20:01.894967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfebd04-9e30-4c90-b6b7-fe52a06de61b service placement] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:20:01.906347 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfebd04-9e30-4c90-b6b7-fe52a06de61b service placement] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:20:01.963366 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:20:01.964259 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:20:01.964543 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:20:01.964818 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] PATH_INFO: `/v3/projects/1bb9151baf674b6c8bb7946ac1479252` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:20:01.966005 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb9151baf674b6c8bb7946ac1479252)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:20:01.967945 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:20:02.062317 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:20:02.065151 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb9151baf674b6c8bb7946ac1479252', 'request_id': 'req-d53d62af-cd1b-4fdd-ab23-07337c168448'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:02.133932 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb9151baf674b6c8bb7946ac1479252', 'request_id': 'req-d53d62af-cd1b-4fdd-ab23-07337c168448'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:02.140147 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb9151baf674b6c8bb7946ac1479252', 'request_id': 'req-d53d62af-cd1b-4fdd-ab23-07337c168448'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:02.151952 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] The token cache is being invalidate because project 1bb9151baf674b6c8bb7946ac1479252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 07:20:02.152236 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:02.152983 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:02.154549 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1451/2919] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 07:20:01 2022] DELETE /identity/v3/projects/1bb9151baf674b6c8bb7946ac1479252 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 07:20:02.158424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:20:02.159867 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:20:02.173252 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a0767-331c-421b-b70f-66cac71624a0 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:20:02.228548 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:20:02.229409 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:20:02.229694 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:20:02.229967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] PATH_INFO: `/v3/users/b108855148df469dab60a7b92649e294` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:20:02.243260 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b108855148df469dab60a7b92649e294)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:20:02.245161 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:20:02.419226 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b108855148df469dab60a7b92649e294'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:02.419833 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b108855148df469dab60a7b92649e294'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:02.432068 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b108855148df469dab60a7b92649e294'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:02.499676 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b108855148df469dab60a7b92649e294'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:02.505108 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:20:02.507581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b108855148df469dab60a7b92649e294'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:02.513755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1469/2920] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 07:20:02 2022] DELETE /identity/v3/users/b108855148df469dab60a7b92649e294 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 07:20:02.764444 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:20:02.765873 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:20:02.780538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d62af-cd1b-4fdd-ab23-07337c168448 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:20:02.838162 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:20:02.839056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:20:02.839334 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:20:02.839610 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] PATH_INFO: `/v3/projects/06d262db2e9b41418be20bcf4861771e` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:20:02.849683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d262db2e9b41418be20bcf4861771e)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:20:02.851628 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:20:02.964015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d262db2e9b41418be20bcf4861771e', 'request_id': 'req-50249e8a-ba73-4781-baca-1f1af1b23d60'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:03.036838 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d262db2e9b41418be20bcf4861771e', 'request_id': 'req-50249e8a-ba73-4781-baca-1f1af1b23d60'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:03.043373 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d262db2e9b41418be20bcf4861771e', 'request_id': 'req-50249e8a-ba73-4781-baca-1f1af1b23d60'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:03.055397 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] The token cache is being invalidate because project 06d262db2e9b41418be20bcf4861771e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 07:20:03.055683 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:03.056322 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:20:03.057876 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1452/2921] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 07:20:02 2022] DELETE /identity/v3/projects/06d262db2e9b41418be20bcf4861771e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 07:20:12.577539 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:20:13.051800 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:DELETE=11,keystone:SELECT=62,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:20:23.648134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:20:23.648134 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:20:23.751311 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6e9e-97a6-42c7-99c8-a176404ea9f2 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:20:23.807784 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0364613-fd77-4666-9668-c276f5dee5d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:20:23.808424 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0364613-fd77-4666-9668-c276f5dee5d5 service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:20:23.808705 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0364613-fd77-4666-9668-c276f5dee5d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:20:23.808978 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0364613-fd77-4666-9668-c276f5dee5d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:20:23.810745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d0364613-fd77-4666-9668-c276f5dee5d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:20:23.822153 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0364613-fd77-4666-9668-c276f5dee5d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:20:23.823741 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0364613-fd77-4666-9668-c276f5dee5d5 service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:20:23.833387 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1470/2922] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:20:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:20:33.829319 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=76 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:20:54.145166 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:20:54.147240 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:20:54.264885 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50249e8a-ba73-4781-baca-1f1af1b23d60 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:20:54.270430 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc575df-33c4-44ea-9ef9-647eb7db5f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:20:54.271075 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc575df-33c4-44ea-9ef9-647eb7db5f53 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:20:54.271360 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc575df-33c4-44ea-9ef9-647eb7db5f53 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:20:54.272221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc575df-33c4-44ea-9ef9-647eb7db5f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:20:54.274039 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-4cc575df-33c4-44ea-9ef9-647eb7db5f53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:20:54.351237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc575df-33c4-44ea-9ef9-647eb7db5f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:20:54.352808 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc575df-33c4-44ea-9ef9-647eb7db5f53 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:20:54.371047 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1453/2923] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:20:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:21:04.368424 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=91 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:21:53.852691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0364613-fd77-4666-9668-c276f5dee5d5 service placement] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:21:53.854066 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-d0364613-fd77-4666-9668-c276f5dee5d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:21:53.960396 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0364613-fd77-4666-9668-c276f5dee5d5 service placement] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:21:53.964007 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d597a-0aef-44fa-b5a9-8f9ce634c71c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:21:53.964646 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d597a-0aef-44fa-b5a9-8f9ce634c71c service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:21:53.964929 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d597a-0aef-44fa-b5a9-8f9ce634c71c service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:21:53.965203 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d597a-0aef-44fa-b5a9-8f9ce634c71c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:21:53.966955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8f2d597a-0aef-44fa-b5a9-8f9ce634c71c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application [None req-8f2d597a-0aef-44fa-b5a9-8f9ce634c71c service cinder] Could not find project: 1bb9151baf674b6c8bb7946ac1479252.: keystone.exception.ProjectNotFound: Could not find project: 1bb9151baf674b6c8bb7946ac1479252. Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 08 07:21:54.002130 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 07:21:54.003213 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 07:21:54.004403 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application with Lock( Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._enter() Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.creator() Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application created_value = creator( Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 07:21:54.005486 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 07:21:54.007046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1bb9151baf674b6c8bb7946ac1479252. Jun 08 07:21:54.007046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: ERROR keystone.server.flask.application Jun 08 07:21:54.007046 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1471/2924] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:21:53 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 08 07:21:54.040417 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc575df-33c4-44ea-9ef9-647eb7db5f53 service nova] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:21:54.049830 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc575df-33c4-44ea-9ef9-647eb7db5f53 service nova] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:21:54.053359 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd8818-ec81-443f-ab47-4cfe389c110c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:21:54.053989 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd8818-ec81-443f-ab47-4cfe389c110c service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:21:54.054300 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd8818-ec81-443f-ab47-4cfe389c110c service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:21:54.054580 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd8818-ec81-443f-ab47-4cfe389c110c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:21:54.056328 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-05cd8818-ec81-443f-ab47-4cfe389c110c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:21:54.126501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd8818-ec81-443f-ab47-4cfe389c110c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:21:54.127857 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd8818-ec81-443f-ab47-4cfe389c110c service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:21:54.137383 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1454/2925] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:21:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:22:03.970360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=46 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:22:04.133132 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=33 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:25:28.798384 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d597a-0aef-44fa-b5a9-8f9ce634c71c service cinder] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:25:28.799774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-8f2d597a-0aef-44fa-b5a9-8f9ce634c71c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:25:28.816049 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d597a-0aef-44fa-b5a9-8f9ce634c71c service cinder] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:25:28.820908 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecd462-9d55-494a-8a0c-e9666556f645 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:25:28.822109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecd462-9d55-494a-8a0c-e9666556f645 service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:25:28.822420 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecd462-9d55-494a-8a0c-e9666556f645 service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:25:28.822688 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecd462-9d55-494a-8a0c-e9666556f645 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:25:28.831357 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecd462-9d55-494a-8a0c-e9666556f645 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:25:28.832923 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecd462-9d55-494a-8a0c-e9666556f645 service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:25:28.842691 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1472/2926] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:25:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:25:38.838465 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=6 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:25:54.366753 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd8818-ec81-443f-ab47-4cfe389c110c service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:25:54.375496 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd8818-ec81-443f-ab47-4cfe389c110c service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:25:54.379119 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51919154-36ad-4796-a6ee-0015a62e5725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:25:54.379750 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919154-36ad-4796-a6ee-0015a62e5725 service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:25:54.380032 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919154-36ad-4796-a6ee-0015a62e5725 service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:25:54.380305 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919154-36ad-4796-a6ee-0015a62e5725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:25:54.388563 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51919154-36ad-4796-a6ee-0015a62e5725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:25:54.389968 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51919154-36ad-4796-a6ee-0015a62e5725 service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:25:54.398859 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1455/2927] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:25:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:26:04.394726 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=6 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:27:14.311786 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecd462-9d55-494a-8a0c-e9666556f645 service placement] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:27:14.313555 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-70ecd462-9d55-494a-8a0c-e9666556f645 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:27:14.349953 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecd462-9d55-494a-8a0c-e9666556f645 service placement] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:27:14.353829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d0910-ce9a-42da-9246-b198f7f0c702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:27:14.355028 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d0910-ce9a-42da-9246-b198f7f0c702 service cinder] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:27:14.355353 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d0910-ce9a-42da-9246-b198f7f0c702 service cinder] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:27:14.355579 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d0910-ce9a-42da-9246-b198f7f0c702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:27:14.364578 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d0910-ce9a-42da-9246-b198f7f0c702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:27:14.366492 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d0910-ce9a-42da-9246-b198f7f0c702 service cinder] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:27:14.392426 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51919154-36ad-4796-a6ee-0015a62e5725 service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:27:14.395702 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1473/2928] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:27:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:27:14.404249 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51919154-36ad-4796-a6ee-0015a62e5725 service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:27:14.407962 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76270a2-c366-4c0c-828c-19d8c43fc35e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c060a0a42824aa589135ea357165268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:27:14.408606 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76270a2-c366-4c0c-828c-19d8c43fc35e service cinder] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:27:14.408885 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76270a2-c366-4c0c-828c-19d8c43fc35e service cinder] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:27:14.409157 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76270a2-c366-4c0c-828c-19d8c43fc35e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:27:14.419145 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76270a2-c366-4c0c-828c-19d8c43fc35e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:27:14.420564 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76270a2-c366-4c0c-828c-19d8c43fc35e service cinder] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:27:14.436611 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1456/2929] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:27:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 07:27:20.256405 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a397a6e-be2d-443e-bd9f-e34067dbc27d None None] REQUEST_METHOD: `POST` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:27:20.256869 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a397a6e-be2d-443e-bd9f-e34067dbc27d None None] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:27:20.256991 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a397a6e-be2d-443e-bd9f-e34067dbc27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:27:20.283500 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.auth.core [None req-0a397a6e-be2d-443e-bd9f-e34067dbc27d None None] MFA Rules not processed for user `97e50253ceb84116a7195b68599ec377`. Rule list: `[]` (Enabled: `True`). {{(pid=80763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 07:27:20.284687 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0a397a6e-be2d-443e-bd9f-e34067dbc27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:27:20.291488 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1474/2930] 10.222.0.40 () {58 vars in 957 bytes} [Wed Jun 8 07:27:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 07:27:20.330056 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76270a2-c366-4c0c-828c-19d8c43fc35e service cinder] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:27:20.331550 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d76270a2-c366-4c0c-828c-19d8c43fc35e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:27:20.408507 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76270a2-c366-4c0c-828c-19d8c43fc35e service cinder] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:27:20.412037 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b450d13-fa6f-4003-ac51-95cb42130be7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5498a6912a08408d9ea30920faceee7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:27:20.412678 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450d13-fa6f-4003-ac51-95cb42130be7 service glance] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:27:20.412960 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450d13-fa6f-4003-ac51-95cb42130be7 service glance] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:27:20.413235 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450d13-fa6f-4003-ac51-95cb42130be7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:27:20.415006 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5b450d13-fa6f-4003-ac51-95cb42130be7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:27:20.446814 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b450d13-fa6f-4003-ac51-95cb42130be7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:27:20.448233 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b450d13-fa6f-4003-ac51-95cb42130be7 service glance] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:27:20.468450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1457/2931] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:27:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:27:20.678184 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a397a6e-be2d-443e-bd9f-e34067dbc27d None None] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:27:20.679645 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-0a397a6e-be2d-443e-bd9f-e34067dbc27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:27:20.751223 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a397a6e-be2d-443e-bd9f-e34067dbc27d None None] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:27:20.754812 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f52307-31c6-4f7f-9d92-0a7b9f2878f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:27:20.755461 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52307-31c6-4f7f-9d92-0a7b9f2878f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:27:20.755745 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52307-31c6-4f7f-9d92-0a7b9f2878f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:27:20.756020 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52307-31c6-4f7f-9d92-0a7b9f2878f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:27:20.757774 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-00f52307-31c6-4f7f-9d92-0a7b9f2878f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:27:20.767290 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52307-31c6-4f7f-9d92-0a7b9f2878f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:27:20.768764 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52307-31c6-4f7f-9d92-0a7b9f2878f2 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:27:20.776917 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1475/2932] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:27:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:27:21.165869 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b450d13-fa6f-4003-ac51-95cb42130be7 service glance] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:27:21.174756 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f52307-31c6-4f7f-9d92-0a7b9f2878f2 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:27:21.177307 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b450d13-fa6f-4003-ac51-95cb42130be7 service glance] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:27:21.182450 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072a446-2ae8-49a1-8600-b9627945531d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:27:21.183453 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a446-2ae8-49a1-8600-b9627945531d service placement] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:27:21.183576 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a446-2ae8-49a1-8600-b9627945531d service placement] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:27:21.183722 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f52307-31c6-4f7f-9d92-0a7b9f2878f2 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:27:21.183809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a446-2ae8-49a1-8600-b9627945531d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:27:21.186149 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-5072a446-2ae8-49a1-8600-b9627945531d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:27:21.187956 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b16c81-cec2-4493-a6a0-0c73ece3e43e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:27:21.188596 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b16c81-cec2-4493-a6a0-0c73ece3e43e service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:27:21.188901 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b16c81-cec2-4493-a6a0-0c73ece3e43e service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:27:21.189177 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b16c81-cec2-4493-a6a0-0c73ece3e43e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:27:21.190971 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-12b16c81-cec2-4493-a6a0-0c73ece3e43e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:27:21.198485 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072a446-2ae8-49a1-8600-b9627945531d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:27:21.201113 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072a446-2ae8-49a1-8600-b9627945531d service placement] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:27:21.205381 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b16c81-cec2-4493-a6a0-0c73ece3e43e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:27:21.206942 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b16c81-cec2-4493-a6a0-0c73ece3e43e service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:27:21.211191 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1458/2933] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:27:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:27:21.218478 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1476/2934] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:27:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 07:27:24.059904 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072a446-2ae8-49a1-8600-b9627945531d service placement] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:27:24.069245 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072a446-2ae8-49a1-8600-b9627945531d service placement] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:27:24.072789 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebbb79-5f86-4beb-a843-8291de1c2986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:27:24.073419 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebbb79-5f86-4beb-a843-8291de1c2986 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:27:24.073702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebbb79-5f86-4beb-a843-8291de1c2986 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:27:24.073978 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebbb79-5f86-4beb-a843-8291de1c2986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:27:24.075754 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-d7ebbb79-5f86-4beb-a843-8291de1c2986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:27:24.085324 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebbb79-5f86-4beb-a843-8291de1c2986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:27:24.086775 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebbb79-5f86-4beb-a843-8291de1c2986 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:27:24.095331 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1459/2935] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:27:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:27:24.943709 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b16c81-cec2-4493-a6a0-0c73ece3e43e service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:27:24.957620 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b16c81-cec2-4493-a6a0-0c73ece3e43e service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:27:24.963557 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b6b3c-cbdb-4609-9a8f-f9ed3c0c8cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:27:24.964292 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b6b3c-cbdb-4609-9a8f-f9ed3c0c8cc7 service nova] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:27:24.964824 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b6b3c-cbdb-4609-9a8f-f9ed3c0c8cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:27:24.965321 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b6b3c-cbdb-4609-9a8f-f9ed3c0c8cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:27:24.967222 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-1e6b6b3c-cbdb-4609-9a8f-f9ed3c0c8cc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:27:24.980633 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b6b3c-cbdb-4609-9a8f-f9ed3c0c8cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:27:24.982144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b6b3c-cbdb-4609-9a8f-f9ed3c0c8cc7 service nova] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:27:24.992843 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1477/2936] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:27:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 07:27:30.747553 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebbb79-5f86-4beb-a843-8291de1c2986 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:27:30.761498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebbb79-5f86-4beb-a843-8291de1c2986 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:27:30.767523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6a53e-6f93-49f0-b04d-b1cb805fd6c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8661ef27af34bbea11e215831d50843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:27:30.768161 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6a53e-6f93-49f0-b04d-b1cb805fd6c9 service nova] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:27:30.768449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6a53e-6f93-49f0-b04d-b1cb805fd6c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:27:30.768725 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6a53e-6f93-49f0-b04d-b1cb805fd6c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:27:30.770531 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-b8d6a53e-6f93-49f0-b04d-b1cb805fd6c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:27:30.782501 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6a53e-6f93-49f0-b04d-b1cb805fd6c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:27:30.784061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6a53e-6f93-49f0-b04d-b1cb805fd6c9 service nova] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:27:30.794565 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1460/2937] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:27:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:27:34.988276 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=61 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:27:40.790057 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=71 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:28:12.697146 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b6b3c-cbdb-4609-9a8f-f9ed3c0c8cc7 service nova] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:28:12.708635 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b6b3c-cbdb-4609-9a8f-f9ed3c0c8cc7 service nova] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:28:12.713072 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050881d7-e8a9-4b31-80d1-261c97c4afa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:28:12.713728 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050881d7-e8a9-4b31-80d1-261c97c4afa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:28:12.714009 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050881d7-e8a9-4b31-80d1-261c97c4afa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:28:12.714324 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050881d7-e8a9-4b31-80d1-261c97c4afa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:28:12.716140 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-050881d7-e8a9-4b31-80d1-261c97c4afa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:28:12.779755 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050881d7-e8a9-4b31-80d1-261c97c4afa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:28:12.781170 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050881d7-e8a9-4b31-80d1-261c97c4afa4 service neutron] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:28:12.790982 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1478/2938] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:28:15.941441 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6a53e-6f93-49f0-b04d-b1cb805fd6c9 service nova] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:28:15.953221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6a53e-6f93-49f0-b04d-b1cb805fd6c9 service nova] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:28:15.959626 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af059c2f-d431-41bf-8a2e-70d311352353 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:28:15.960309 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af059c2f-d431-41bf-8a2e-70d311352353 service placement] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:28:15.960594 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af059c2f-d431-41bf-8a2e-70d311352353 service placement] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:28:15.960874 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af059c2f-d431-41bf-8a2e-70d311352353 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:28:15.962729 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-af059c2f-d431-41bf-8a2e-70d311352353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:28:15.974644 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af059c2f-d431-41bf-8a2e-70d311352353 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:28:15.976223 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af059c2f-d431-41bf-8a2e-70d311352353 service placement] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:28:15.986720 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1461/2939] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:28:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:28:19.609521 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050881d7-e8a9-4b31-80d1-261c97c4afa4 service neutron] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:28:19.621697 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050881d7-e8a9-4b31-80d1-261c97c4afa4 service neutron] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:28:19.627137 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91369d19-e5c4-4647-b252-4eb80bda2b5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:28:19.627799 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91369d19-e5c4-4647-b252-4eb80bda2b5c service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:28:19.628086 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91369d19-e5c4-4647-b252-4eb80bda2b5c service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:28:19.628360 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91369d19-e5c4-4647-b252-4eb80bda2b5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:28:19.630144 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-91369d19-e5c4-4647-b252-4eb80bda2b5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:28:19.643157 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91369d19-e5c4-4647-b252-4eb80bda2b5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:28:19.645000 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91369d19-e5c4-4647-b252-4eb80bda2b5c service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:28:19.655282 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1479/2940] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:28:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:28:19.740148 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af059c2f-d431-41bf-8a2e-70d311352353 service placement] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:28:19.742008 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-af059c2f-d431-41bf-8a2e-70d311352353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:28:19.758524 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af059c2f-d431-41bf-8a2e-70d311352353 service placement] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:28:19.763061 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:28:19.763982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:28:19.764498 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:28:19.764777 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] PATH_INFO: `/v3/users/3574d4eb86234460889a586a4a6acbd0` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:28:19.765965 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3574d4eb86234460889a586a4a6acbd0)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:28:19.770466 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:28:19.964635 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3574d4eb86234460889a586a4a6acbd0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:19.965287 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3574d4eb86234460889a586a4a6acbd0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.024736 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3574d4eb86234460889a586a4a6acbd0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.041015 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3574d4eb86234460889a586a4a6acbd0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.047941 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3574d4eb86234460889a586a4a6acbd0'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.053982 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1462/2941] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 07:28:19 2022] DELETE /identity/v3/users/3574d4eb86234460889a586a4a6acbd0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 07:28:20.304964 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91369d19-e5c4-4647-b252-4eb80bda2b5c service placement] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:28:20.320316 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91369d19-e5c4-4647-b252-4eb80bda2b5c service placement] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:28:20.385581 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:28:20.386480 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:28:20.386769 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:28:20.387045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] PATH_INFO: `/v3/projects/8ec3068b348e4118b2331d4731e9d69a` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:28:20.391256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec3068b348e4118b2331d4731e9d69a)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:28:20.391256 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:28:20.498004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec3068b348e4118b2331d4731e9d69a', 'request_id': 'req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.576951 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec3068b348e4118b2331d4731e9d69a', 'request_id': 'req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.583825 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec3068b348e4118b2331d4731e9d69a', 'request_id': 'req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.594519 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] The token cache is being invalidate because project 8ec3068b348e4118b2331d4731e9d69a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 07:28:20.594850 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.595482 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.597019 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1480/2942] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 07:28:20 2022] DELETE /identity/v3/projects/8ec3068b348e4118b2331d4731e9d69a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 07:28:20.601090 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:28:20.602491 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:28:20.616252 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876561-c033-4e28-b0da-61713c6a2f08 admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:28:20.671078 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:28:20.671941 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:28:20.672221 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:28:20.672988 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] PATH_INFO: `/v3/users/c211e9f5498949ae93c328d478530101` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:28:20.686096 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c211e9f5498949ae93c328d478530101)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:28:20.688790 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:28:20.885967 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c211e9f5498949ae93c328d478530101'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.887085 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c211e9f5498949ae93c328d478530101'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.890376 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:28:20.977710 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c211e9f5498949ae93c328d478530101'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.992641 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c211e9f5498949ae93c328d478530101'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:20.999449 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c211e9f5498949ae93c328d478530101'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:21.006054 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1463/2943] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 07:28:20 2022] DELETE /identity/v3/users/c211e9f5498949ae93c328d478530101 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 07:28:21.272829 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:28:21.274886 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:28:21.292036 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d43d-e895-40d7-8e8b-9d5b459f1fe2 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:28:21.301955 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:28:21.350216 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:28:21.351109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:28:21.351395 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:28:21.351677 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] PATH_INFO: `/v3/projects/830ee72c5d1f4259b01fbcab29555100` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:28:21.361909 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=830ee72c5d1f4259b01fbcab29555100)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:28:21.363853 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:28:21.502035 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '830ee72c5d1f4259b01fbcab29555100', 'request_id': 'req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:21.577004 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '830ee72c5d1f4259b01fbcab29555100', 'request_id': 'req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:21.585047 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '830ee72c5d1f4259b01fbcab29555100', 'request_id': 'req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:21.595987 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] The token cache is being invalidate because project 830ee72c5d1f4259b01fbcab29555100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 07:28:21.596279 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:21.596915 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:21.598499 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1481/2944] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 07:28:21 2022] DELETE /identity/v3/projects/830ee72c5d1f4259b01fbcab29555100 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 07:28:27.738538 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:28:27.739928 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:28:27.794168 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea77b0e-6feb-46b2-a4f7-8e88d81fc20a admin admin] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:28:27.840237 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0997f8d-e1bc-4c81-9e37-d1568a01dfe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11838a2908884cc79df912b3b2199564', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:28:27.840878 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0997f8d-e1bc-4c81-9e37-d1568a01dfe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:28:27.841160 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0997f8d-e1bc-4c81-9e37-d1568a01dfe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:28:27.841435 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0997f8d-e1bc-4c81-9e37-d1568a01dfe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:28:27.843202 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.fernet_utils [None req-c0997f8d-e1bc-4c81-9e37-d1568a01dfe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:28:27.903267 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0997f8d-e1bc-4c81-9e37-d1568a01dfe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:28:27.904702 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0997f8d-e1bc-4c81-9e37-d1568a01dfe2 service neutron] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:28:27.914802 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1464/2945] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:28:28.522819 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:28:28.527736 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:28:28.538045 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7fd84-5dce-48f0-a8e6-986dd5fce6b6 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:28:28.542673 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:28:28.543547 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:28:28.543832 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:28:28.544109 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] PATH_INFO: `/v3/users/97e50253ceb84116a7195b68599ec377` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:28:28.545303 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e50253ceb84116a7195b68599ec377)` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:28:28.547879 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:28:28.750126 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e50253ceb84116a7195b68599ec377'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:28.750836 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e50253ceb84116a7195b68599ec377'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:28.762734 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e50253ceb84116a7195b68599ec377'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:28.830329 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e50253ceb84116a7195b68599ec377'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:28.837411 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.notifications [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e50253ceb84116a7195b68599ec377'} {{(pid=80763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:28.843524 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1482/2946] 10.222.0.40 () {58 vars in 1223 bytes} [Wed Jun 8 07:28:28 2022] DELETE /identity/v3/users/97e50253ceb84116a7195b68599ec377 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 07:28:29.077422 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0997f8d-e1bc-4c81-9e37-d1568a01dfe2 service neutron] Authenticating user token {{(pid=80764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:28:29.089809 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0997f8d-e1bc-4c81-9e37-d1568a01dfe2 service neutron] Validating token access rules against request {{(pid=80764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:28:29.120653 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:28:29.149816 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b20259d4d74838a9e50d6db7cf7a75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87773f44fe964196963231d64fa11c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:28:29.150707 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:28:29.150992 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:28:29.151274 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] PATH_INFO: `/v3/projects/c674add339db4b3095b101825ee2654e` {{(pid=80764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:28:29.152470 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c674add339db4b3095b101825ee2654e)` {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:28:29.154411 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] RBAC: Authorization granted {{(pid=80764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:28:29.282163 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c674add339db4b3095b101825ee2654e', 'request_id': 'req-88a1451a-fd08-41d3-ba23-9febea674b73'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:29.350523 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c674add339db4b3095b101825ee2654e', 'request_id': 'req-88a1451a-fd08-41d3-ba23-9febea674b73'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:29.356440 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c674add339db4b3095b101825ee2654e', 'request_id': 'req-88a1451a-fd08-41d3-ba23-9febea674b73'} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:29.367451 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] The token cache is being invalidate because project c674add339db4b3095b101825ee2654e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 07:28:29.367737 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:29.368390 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG keystone.notifications [None req-88a1451a-fd08-41d3-ba23-9febea674b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 07:28:29.369913 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: [pid: 80764|app: 0|req: 1465/2947] 10.222.0.40 () {58 vars in 1232 bytes} [Wed Jun 8 07:28:29 2022] DELETE /identity/v3/projects/c674add339db4b3095b101825ee2654e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 07:28:38.839785 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=79,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:28:39.364425 dv-cinder-844920-1-iscsi devstack@keystone.service[80764]: DEBUG dbcounter [-] [80764] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 07:30:35.650589 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] Authenticating user token {{(pid=80763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 07:30:35.651967 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:30:35.743080 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9883f8f-8013-4540-90a9-ab032bbe62d2 admin admin] Validating token access rules against request {{(pid=80763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 07:30:35.800091 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c1620-5400-4751-ad7e-c678f28a2e10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e0226354d14b9b9c4184063b2df9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58bfdd3959af4837be6e8a4a1894fa43', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 07:30:35.800734 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c1620-5400-4751-ad7e-c678f28a2e10 service placement] REQUEST_METHOD: `GET` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 07:30:35.801012 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c1620-5400-4751-ad7e-c678f28a2e10 service placement] SCRIPT_NAME: `/identity` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 07:30:35.801283 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c1620-5400-4751-ad7e-c678f28a2e10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 07:30:35.803067 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.fernet_utils [None req-445c1620-5400-4751-ad7e-c678f28a2e10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 07:30:35.813885 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c1620-5400-4751-ad7e-c678f28a2e10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 07:30:35.815463 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c1620-5400-4751-ad7e-c678f28a2e10 service placement] RBAC: Authorization granted {{(pid=80763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 07:30:35.824987 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: [pid: 80763|app: 0|req: 1483/2948] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jun 8 07:30:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 07:30:45.820912 dv-cinder-844920-1-iscsi devstack@keystone.service[80763]: DEBUG dbcounter [-] [80763] Writing DB stats keystone:SELECT=67 {{(pid=80763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}